-- Logs begin at Wed 2022-05-04 13:02:38 UTC, end at Wed 2022-05-04 14:09:13 UTC. -- May 04 13:33:37.357996 dv-cinder-839793-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 04 13:33:37.365849 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 13:33:37 2022] *** May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: nodename: dv-cinder-839793-6-iscsi May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: machine: x86_64 May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: clock source: unix May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: pcre jit disabled May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: detected number of CPU cores: 4 May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: current working directory: / May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: detected binary path: /usr/bin/uwsgi-core May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: your processes number limit is 47680 May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: your memory page size is 4096 bytes May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: detected max file descriptor number: 2048 May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: lock engine: pthread robust mutexes May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: thunder lock: enabled May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 04 13:33:37.371240 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 13:33:37.414528 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: Python main interpreter initialized at 0x555f451449c0 May 04 13:33:37.414528 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: python threads support enabled May 04 13:33:37.414528 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: your server socket listen backlog is limited to 100 connections May 04 13:33:37.414528 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: your mercy for graceful operations on workers is 90 seconds May 04 13:33:37.414902 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: mapped 403077 bytes (393 KB) for 2 cores May 04 13:33:37.414978 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: *** Operational MODE: preforking *** May 04 13:33:37.415222 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: *** uWSGI is running in multiple interpreter mode *** May 04 13:33:37.415222 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: spawned uWSGI master process (pid: 86411) May 04 13:33:37.415435 dv-cinder-839793-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 04 13:33:37.416035 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: spawned uWSGI worker 1 (pid: 86422, cores: 1) May 04 13:33:37.416837 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: spawned uWSGI worker 2 (pid: 86423, cores: 1) May 04 13:33:37.416837 dv-cinder-839793-6-iscsi devstack@keystone.service[86411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 13:33:43.121027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 13:33:43.121027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: from cryptography.utils import int_from_bytes May 04 13:33:43.121794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 13:33:43.121794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: from cryptography.utils import int_from_bytes May 04 13:33:43.128242 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 13:33:43.128242 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: from cryptography.utils import int_from_bytes May 04 13:33:43.128699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 13:33:43.128699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: from cryptography.utils import int_from_bytes May 04 13:33:43.170378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 13:33:43.170604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 13:33:43.170758 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] command line args: [] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 13:33:43.171015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 13:33:43.171192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ================================================================================ {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 13:33:43.171464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] admin_token = **** {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.171708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] config_dir = [] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.171894 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.172601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] config_source = [] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.172794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] debug = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.172993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.175366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.175366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.175366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.175366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.175366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] list_limit = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.175366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] log_config_append = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.175366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.175366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] log_dir = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.175366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] log_file = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.177058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.177058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.177058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.177058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.177058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.177058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.177058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.178327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.178491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 13:33:43.178720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.178893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 13:33:43.179131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.179305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] command line args: [] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 13:33:43.179536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.179707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 13:33:43.179906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.180071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ================================================================================ {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 13:33:43.180237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.180403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] admin_token = **** {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.180543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.180671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] config_dir = [] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.180671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.180963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.181099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] config_source = [] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.181099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] debug = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.181359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.181528 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.181696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] publish_errors = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.181836 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.181965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.182099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.182236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.182372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.182507 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.182644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.182778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.182953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] list_limit = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.183087 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.183249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] log_config_append = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.183396 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] standard_threads = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.183533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.183533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] log_dir = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.183788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.183925 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] log_file = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.184054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.184054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.184315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.184450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] use_journal = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.184578 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.184711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] use_json = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.184711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] use_stderr = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.184968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.185105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] use_syslog = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.185239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.185376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.185540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.185540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.185832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.185968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.186103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.186237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.186439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.186593 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.186723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.186851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.186978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.187112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.187258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.187403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.187538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.187669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.187796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.187931 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.188103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.188240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.188382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.188382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.188382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.188744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.188744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] publish_errors = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.188995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.189129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.189258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.189394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.189635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.189794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.189955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.190194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.190352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.190503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.190633 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.190762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] standard_threads = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.190896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.191025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.191159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.191399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.191532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.191661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.191661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] use_journal = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.191916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.192051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] use_json = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.192191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.192336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] use_stderr = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.192471 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.192599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] use_syslog = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.192599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 13:33:43.192845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.192845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.193102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.193236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.193364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.193491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.193624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.193761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.193897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.194031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.194170 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.194305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.194305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.194557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.194692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.194820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.194948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.195075 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.195278 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.195426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.195556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.195684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.196065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.196208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.196336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.196472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.196601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.196729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.196863 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.196992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.197120 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.197256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.197386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.197513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.197641 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.197768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.197895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.198108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.198245 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.198374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.198501 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.198634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.198762 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.198897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.199026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.199026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.199298 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.199429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.199557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.199692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.199831 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.199960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.200096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.200233 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.200370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.200498 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.200626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.200754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.200881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.201009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.201144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.201273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.201400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.201528 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.202739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.202913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.203147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.203386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.203575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.203767 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.203997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.204165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.204400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.204565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.204758 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.204987 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.205155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.205358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.205588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.205788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.206018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.206220 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.206386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.206621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.206829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.206996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.207190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.207389 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.207584 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.207786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.207972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.208106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.208272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.208401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.208563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.208697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.208835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.208977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.209108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.209277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.209412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.209547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.209683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.209819 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.209967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.210108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.210237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.210366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.210495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.210665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.210801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.210931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.211060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.211189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.211355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.211496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.211627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.211763 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.211905 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.212034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.212169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.212307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.212437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.212566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.212694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.212824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.212952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.213089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.213255 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.213417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.213559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.213701 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.213831 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.213960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.214164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.214296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.214425 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.214555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.214690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.214822 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.214822 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.215122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.215277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.215410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.215539 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.215694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.215826 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.215956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.216084 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.216214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.216214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.216475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.216605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.216735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.216869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.217000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.217128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.217265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] auth.external = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.217413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.217558 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.217688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.217817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.217947 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.218077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.218205 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.218343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] auth.password = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.218479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.218610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] auth.token = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.218738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.218867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.219552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.219692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.219836 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.219967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.220189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.220354 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.220487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.220628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.220760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.220889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.221018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.221147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.221277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.221415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] credential.caching = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.221546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.221685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.221815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.221943 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.222082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.222310 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.222467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.222610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.222742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.222871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.223002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.223130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.223282 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.223426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.223557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.223696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.223827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.223956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.224085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.224224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.224356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.224492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.224629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.224759 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.224897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.225036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.225167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.225297 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.225427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] auth.external = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.225567 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.225706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.225844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] federation.caching = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.225844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.226101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.226234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.226365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.226507 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.226639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] auth.password = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.226777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.226907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] auth.token = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.227037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.227167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.227372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.227507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.227637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.227767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.227898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.228034 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.228176 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.228315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.228447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.228577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.228707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.228842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.228981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.caching = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.229118 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] credential.caching = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.229259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.229389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.229520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.229650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.229790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.229922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.230068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.230200 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.230330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.230460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.230666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.230799 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.230929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.231069 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.231200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.231354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.231496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.231629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.231765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.231894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.232025 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.232154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.232293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.232424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.232554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.232684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.232815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.232954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.233093 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.233224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.233355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.233485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] federation.caching = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.233615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.233615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.233615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.233986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.234116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.234246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.234383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.234514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.235345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.235487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.235624 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.235761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.235907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.236054 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.236192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.236329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.236466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.236602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.236739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.236884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.237023 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.237160 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.237306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.237444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.237581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.237726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.caching = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.237865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.238002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.238139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.238275 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.238413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.238558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.238696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.238832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.238969 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.238969 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.239267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.239422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.239560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.239697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.239833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.239968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.240112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.240262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.240400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.240544 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.240682 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.240818 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.240954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.241114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.241253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.241389 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.241526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.241662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.241798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.241943 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.242082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.242219 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.242355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.242492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.242628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.242777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.242928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.243065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.243226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.243373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.243510 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.243658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.243658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.243918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.244055 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.244192 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.244328 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.244478 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.244617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.244753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.244908 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.245046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.245183 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.245328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.245466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.245603 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.245739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.245875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.246011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.246155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.246294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.246431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.246567 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.246703 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.246853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.246998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.247136 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.247320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.247460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.247595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.247732 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.247879 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.248018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.248155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.248298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.248436 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.248573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.248728 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.248866 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.249010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.249148 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.249284 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.249421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.249565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.249703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.249844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.249982 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.250124 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.250290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.250435 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.250574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.250721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.250858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.250994 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.251138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.251298 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.251446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.251585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.251722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.251857 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.252001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.252138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.252274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.252410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.252547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.252693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.252839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.252839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.253098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.253234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.253370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.253506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] resource.caching = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.253652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.253790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.253925 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.254062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.254062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.254318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.254318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.254595 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.254733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.254869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.255005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.255141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.255313 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.255453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.255590 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.255727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.255863 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.256006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.256152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.256291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] role.caching = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.256437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.256574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] role.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.256574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.256840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.256985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.257122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.257258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.257396 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.257532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.257668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.257883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.258023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.258160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.258302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.258450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.258586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.258731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.258870 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.258870 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.259127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.259127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.259449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.259598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.259737 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.259880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.260020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.260165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.260316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.260461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.260600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.260600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.260857 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.260994 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.261130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.261275 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.261413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.261550 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.261685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.261821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.261956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.262102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.262249 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.262386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.262522 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.262658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.262803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.262945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] resource.caching = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.263089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.263244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.263388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.263525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.263673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.263811 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.263990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.264143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.264281 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.264418 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.264564 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.264703 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.264839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.264975 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.265112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.265248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.265393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.265537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.265675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.266319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] role.caching = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.266461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.266608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] role.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.266753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] token.caching = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.266892 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.267028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.267164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.267335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.267473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.267622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.267760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.267896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.268033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.268170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.268307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.268466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.268605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.268742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.268878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.269014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.269150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.269297 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.269436 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.269573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.269709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.269845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.269845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.270111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.270250 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.270397 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.270535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.270681 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.270819 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.270963 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.271102 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.271256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.271400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.271537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.271674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.connection = **** {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.271826 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.271977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.272115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.272262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.272398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.272536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.272673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.272819 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.272958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.273095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.273231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.273367 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.273503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.273649 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.273786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.273923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.274060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.274207 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.274343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.274488 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.274628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.274764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.274764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.275021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.275158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.275367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.275508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.275645 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.275782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.275919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.276066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.276213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.276352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.276489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] token.caching = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.276626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.276763 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.276899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 13:33:43.277046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.277046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.277046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.277046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.277046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.277046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.277046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.277046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.277046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.278349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.278349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.278349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.278349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.278349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.278349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.278349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.278349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.connection = **** {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.278349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.279520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.279520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.279520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.279520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.279520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.279520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.279520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.279520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.279520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.280749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.280749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.280749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.280749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.280749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.280749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.280749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.280749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 13:33:43.280749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86423) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 13:33:43.286252 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.286483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.286705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.290223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.290441 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.290669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.298831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.299816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.324094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.324325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.329303 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.329538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.377266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.378176 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.428959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.429307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.430548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.430787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.494678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.494935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.495084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.495290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.495444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.495587 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.495587 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.495856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.496015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.496167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.496167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.496167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.519149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.519387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.519615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.519837 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.519985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.520126 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.520266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.520416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.520579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.520579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.520858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.520858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.520858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.521259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.532209 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.532813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.546664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.546907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.547139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.547376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.547588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.547734 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.547877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.548030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.548171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.548312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.548312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.548574 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.548721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.548860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86423) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 13:33:43.565336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.565551 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 13:33:43.565894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.566097 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 13:33:43.566369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.566634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.566895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.567154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.569237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.569450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 13:33:43.569783 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.569983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 13:33:43.570254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.570516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.571034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.571311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.579123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.582911 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.583190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.583321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.583543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.583633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.583807 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.583891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.591978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.592198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.595833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.596111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.596198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.596390 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.596490 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.596718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.596802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.597042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.597126 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.597302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.597395 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.597560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.597640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.597829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.597914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.598090 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.598172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.598363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.598449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.598630 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.598721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.598906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.625704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.626590 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.627386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.627618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.628250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.628528 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.632966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.633242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.633520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.633905 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.634183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.634462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.641379 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.641666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.642488 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.642775 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.646314 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.646595 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.646874 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.647151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.647442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.647521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.647715 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.647800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.647972 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.648064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.648243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.648327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.648585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.648856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.649125 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.649390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.666934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.667222 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.668234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.668514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.671862 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.673063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.675575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.675867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.676713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.677004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.680930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.682028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.684618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.685615 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.688924 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.689221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.689504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.689786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.689931 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.690148 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.690290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.690427 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.690572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.690766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.691041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.691338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.710181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.710552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.710817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.711079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.711294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.711667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.711936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.712202 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.719321 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.720573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.721027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.721299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.722306 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.722578 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.724383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.724660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.724952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.725231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.725508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.725676 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.725962 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.726262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.726543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.726820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.739523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.739808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.740085 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.740360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.740512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.740675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.740818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.740959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.741099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.741252 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.741402 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.741544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.741774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.742052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.759970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.760912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.763266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.764252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.767134 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.768192 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.768780 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.769807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.770409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.770683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.770958 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.771458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.771740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.772029 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.778398 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.779509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.780023 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.781127 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.783273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.783562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.783854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.784129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.784389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.784678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.784970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.785247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.793360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.793652 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.793930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.794550 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.794845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.795125 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.801982 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.802259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.802542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.802821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.803086 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.803259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86423) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 13:33:43.803407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.803570 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.803711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.803851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.803989 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.804130 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.804278 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.804419 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.804557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.804713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.804910 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.805081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.805222 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.805361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.805499 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.805499 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.805770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.805770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.806036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.806172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.806431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.806699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86423) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 13:33:43.845421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555f451449c0 pid: 86422 (default app) May 04 13:33:43.846867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555f451449c0 pid: 86423 (default app) May 04 13:33:43.848805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247a4ac-a2d5-4e7d-8869-5ecf11b7eb41 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:43.849104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247a4ac-a2d5-4e7d-8869-5ecf11b7eb41 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:43.849384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247a4ac-a2d5-4e7d-8869-5ecf11b7eb41 None None] PATH_INFO: `/v3` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:43.853496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 791 bytes} [Wed May 4 13:33:43 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:33:51.852565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee094-a075-4448-afa1-28f1cb2c1371 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:51.853181 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee094-a075-4448-afa1-28f1cb2c1371 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:51.853181 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee094-a075-4448-afa1-28f1cb2c1371 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:51.857573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1/2] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:33:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:33:51.863434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb861820-259d-4eee-a776-3184d1bc43b7 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:51.863976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb861820-259d-4eee-a776-3184d1bc43b7 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:51.863976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb861820-259d-4eee-a776-3184d1bc43b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:51.894915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG oslo_db.sqlalchemy.engines [None req-eb861820-259d-4eee-a776-3184d1bc43b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 13:33:52.088109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG passlib.handlers.bcrypt [None req-eb861820-259d-4eee-a776-3184d1bc43b7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86422) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 13:33:52.088776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG passlib.handlers.bcrypt [None req-eb861820-259d-4eee-a776-3184d1bc43b7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86422) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 13:33:52.144551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-eb861820-259d-4eee-a776-3184d1bc43b7 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:33:52.146089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-eb861820-259d-4eee-a776-3184d1bc43b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:33:52.268019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 2/3] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:33:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 13:33:52.438583 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee094-a075-4448-afa1-28f1cb2c1371 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:33:52.472764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG oslo_db.sqlalchemy.engines [None req-cc9ee094-a075-4448-afa1-28f1cb2c1371 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86423) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 13:33:52.597624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee094-a075-4448-afa1-28f1cb2c1371 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:33:52.601789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93887c-d5a3-4ee0-a2de-91ad784280cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:33:52.602446 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93887c-d5a3-4ee0-a2de-91ad784280cc admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:52.602724 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93887c-d5a3-4ee0-a2de-91ad784280cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:52.602993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93887c-d5a3-4ee0-a2de-91ad784280cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:52.611145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93887c-d5a3-4ee0-a2de-91ad784280cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:33:52.663380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1f93887c-d5a3-4ee0-a2de-91ad784280cc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 13:33:52.663719 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93887c-d5a3-4ee0-a2de-91ad784280cc admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:33:52.673123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1324 bytes} [Wed May 4 13:33:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:33:52.679457 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb861820-259d-4eee-a776-3184d1bc43b7 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:33:52.693965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb861820-259d-4eee-a776-3184d1bc43b7 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:33:52.698591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec68d7-bf54-4338-9c0d-08f2e04a8254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:33:52.699742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec68d7-bf54-4338-9c0d-08f2e04a8254 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:52.700030 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec68d7-bf54-4338-9c0d-08f2e04a8254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:52.700315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec68d7-bf54-4338-9c0d-08f2e04a8254 admin admin] PATH_INFO: `/v3/projects/f25742121cef4f95a3f20f4e6e3a0601` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:52.701832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec68d7-bf54-4338-9c0d-08f2e04a8254 admin admin] RBAC: Authorizing `identity:get_project(project_id=f25742121cef4f95a3f20f4e6e3a0601)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:33:52.753394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: WARNING keystone.common.rbac_enforcer.enforcer [None req-44ec68d7-bf54-4338-9c0d-08f2e04a8254 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 13:33:52.753737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec68d7-bf54-4338-9c0d-08f2e04a8254 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:33:52.758445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 3/5] 10.222.0.73 () {56 vars in 1207 bytes} [Wed May 4 13:33:52 2022] GET /identity/v3/projects/f25742121cef4f95a3f20f4e6e3a0601 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:33:54.970898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4ef84-0620-420c-a61d-f20f2224cd2f None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:54.971481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4ef84-0620-420c-a61d-f20f2224cd2f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:54.971481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4ef84-0620-420c-a61d-f20f2224cd2f None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:54.975554 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 3/6] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:33:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:33:54.980896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf0a55-7701-449b-9126-7819334f4cff None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:54.981324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf0a55-7701-449b-9126-7819334f4cff None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:54.981450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf0a55-7701-449b-9126-7819334f4cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:55.002666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-badf0a55-7701-449b-9126-7819334f4cff None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:33:55.005300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-badf0a55-7701-449b-9126-7819334f4cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:33:55.014020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:33:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 13:33:55.037177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4ef84-0620-420c-a61d-f20f2224cd2f None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:33:55.049958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4ef84-0620-420c-a61d-f20f2224cd2f None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:33:55.054232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafe1e4-a1d9-45c9-a8be-12b8c97e89f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:33:55.054858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafe1e4-a1d9-45c9-a8be-12b8c97e89f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:55.055137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafe1e4-a1d9-45c9-a8be-12b8c97e89f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:55.055446 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafe1e4-a1d9-45c9-a8be-12b8c97e89f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:55.062982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafe1e4-a1d9-45c9-a8be-12b8c97e89f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:33:55.064768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafe1e4-a1d9-45c9-a8be-12b8c97e89f7 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:33:55.073599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1324 bytes} [Wed May 4 13:33:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:33:55.079169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf0a55-7701-449b-9126-7819334f4cff None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:33:55.087920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf0a55-7701-449b-9126-7819334f4cff None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:33:55.092172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b820672-16dd-41a3-8a79-6c3447f37398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:33:55.093027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820672-16dd-41a3-8a79-6c3447f37398 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:55.093309 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820672-16dd-41a3-8a79-6c3447f37398 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:55.094096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b820672-16dd-41a3-8a79-6c3447f37398 admin admin] PATH_INFO: `/v3/users/9672a6cf62bd46598e30f140bf9a1184` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:55.095485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b820672-16dd-41a3-8a79-6c3447f37398 admin admin] RBAC: Authorizing `identity:get_user(user_id=9672a6cf62bd46598e30f140bf9a1184)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:33:55.097272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b820672-16dd-41a3-8a79-6c3447f37398 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:33:55.098801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 5/9] 10.222.0.73 () {56 vars in 1198 bytes} [Wed May 4 13:33:55 2022] GET /identity/v3/users/9672a6cf62bd46598e30f140bf9a1184 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:33:57.373592 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818df67-219c-43cc-84dd-ff11a75d6f38 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:57.374111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818df67-219c-43cc-84dd-ff11a75d6f38 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:57.374199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818df67-219c-43cc-84dd-ff11a75d6f38 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:57.376043 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 5/10] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:33:57.381037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd835f-773a-4911-a763-ed8ed8d931f6 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:57.381431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd835f-773a-4911-a763-ed8ed8d931f6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:57.381678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd835f-773a-4911-a763-ed8ed8d931f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:57.395863 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62f71e-0a57-4541-b188-8da967d88aed None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:57.396149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62f71e-0a57-4541-b188-8da967d88aed None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:57.396427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62f71e-0a57-4541-b188-8da967d88aed None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:57.397791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 6/11] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:33:57.403539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ee1a5-aa86-4c7c-8028-6eae3d0df9b1 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:57.403825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ee1a5-aa86-4c7c-8028-6eae3d0df9b1 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:57.404102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ee1a5-aa86-4c7c-8028-6eae3d0df9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:57.445818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG passlib.handlers.bcrypt [None req-7c8ee1a5-aa86-4c7c-8028-6eae3d0df9b1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86423) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 13:33:57.446245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG passlib.handlers.bcrypt [None req-7c8ee1a5-aa86-4c7c-8028-6eae3d0df9b1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86423) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 13:33:57.493614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-7c8ee1a5-aa86-4c7c-8028-6eae3d0df9b1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:33:57.495249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7c8ee1a5-aa86-4c7c-8028-6eae3d0df9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:33:57.507289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-77cd835f-773a-4911-a763-ed8ed8d931f6 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:33:57.508439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-77cd835f-773a-4911-a763-ed8ed8d931f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:33:57.584425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 6/12] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:33:57.592060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 7/13] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:33:57.606664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd835f-773a-4911-a763-ed8ed8d931f6 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:33:57.613742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ee1a5-aa86-4c7c-8028-6eae3d0df9b1 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:33:57.700535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd835f-773a-4911-a763-ed8ed8d931f6 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:33:57.708007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ee1a5-aa86-4c7c-8028-6eae3d0df9b1 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:33:57.731348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd2cae-35e1-450a-b7a4-e22b5f1b00b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:33:57.732140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd2cae-35e1-450a-b7a4-e22b5f1b00b0 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:57.732426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd2cae-35e1-450a-b7a4-e22b5f1b00b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:57.732693 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd2cae-35e1-450a-b7a4-e22b5f1b00b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:57.740259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a93722-b2dd-4986-867f-636eefbf3307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:33:57.741133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93722-b2dd-4986-867f-636eefbf3307 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:57.741414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93722-b2dd-4986-867f-636eefbf3307 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:57.741689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93722-b2dd-4986-867f-636eefbf3307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:57.743990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd2cae-35e1-450a-b7a4-e22b5f1b00b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-68dd2cae-35e1-450a-b7a4-e22b5f1b00b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:33:57.755543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:33:57.756572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:33:57.757515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 7/14] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:33:57.762445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd2cae-35e1-450a-b7a4-e22b5f1b00b0 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:33:57.805818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a93722-b2dd-4986-867f-636eefbf3307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:33:57.807349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a93722-b2dd-4986-867f-636eefbf3307 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:33:57.853691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd2cae-35e1-450a-b7a4-e22b5f1b00b0 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:33:57.885545 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984eaa93-574f-4d72-89d7-14e6d23a3f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:33:57.886184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eaa93-574f-4d72-89d7-14e6d23a3f51 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:57.886466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eaa93-574f-4d72-89d7-14e6d23a3f51 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:57.886736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eaa93-574f-4d72-89d7-14e6d23a3f51 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:57.887509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984eaa93-574f-4d72-89d7-14e6d23a3f51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:33:57.887811 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984eaa93-574f-4d72-89d7-14e6d23a3f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:33:57.889182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984eaa93-574f-4d72-89d7-14e6d23a3f51 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:33:57.898544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 8/15] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:33:57.900507 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 8/16] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:33:57.904249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a93722-b2dd-4986-867f-636eefbf3307 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:33:57.905687 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984eaa93-574f-4d72-89d7-14e6d23a3f51 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:33:57.998135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a93722-b2dd-4986-867f-636eefbf3307 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:33:57.998324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984eaa93-574f-4d72-89d7-14e6d23a3f51 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:33:58.028895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c618a54-9bbf-41b2-ada9-f70b2c622ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:33:58.029676 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c618a54-9bbf-41b2-ada9-f70b2c622ed5 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:58.029954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c618a54-9bbf-41b2-ada9-f70b2c622ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:58.030221 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c618a54-9bbf-41b2-ada9-f70b2c622ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:58.030681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d10f42-92b6-4f90-8a9d-6d8be8634087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:33:58.032094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d10f42-92b6-4f90-8a9d-6d8be8634087 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:58.032375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d10f42-92b6-4f90-8a9d-6d8be8634087 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:58.032648 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d10f42-92b6-4f90-8a9d-6d8be8634087 None admin] PATH_INFO: `/v3/users/9672a6cf62bd46598e30f140bf9a1184` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:58.033844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d10f42-92b6-4f90-8a9d-6d8be8634087 None admin] RBAC: Authorizing `identity:get_user(user_id=9672a6cf62bd46598e30f140bf9a1184)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:33:58.035323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d10f42-92b6-4f90-8a9d-6d8be8634087 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:33:58.036937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 9/17] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:33:57 2022] GET /identity/v3/users/9672a6cf62bd46598e30f140bf9a1184 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:33:58.042606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d10f42-92b6-4f90-8a9d-6d8be8634087 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:33:58.143011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d10f42-92b6-4f90-8a9d-6d8be8634087 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:33:58.157376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c618a54-9bbf-41b2-ada9-f70b2c622ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:33:58.158867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c618a54-9bbf-41b2-ada9-f70b2c622ed5 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:33:58.176550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832797f4-35b4-4ef0-8f7f-72f385b92409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:33:58.177338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832797f4-35b4-4ef0-8f7f-72f385b92409 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:58.177621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832797f4-35b4-4ef0-8f7f-72f385b92409 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:58.177895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832797f4-35b4-4ef0-8f7f-72f385b92409 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:58.179064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832797f4-35b4-4ef0-8f7f-72f385b92409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-7c618a54-9bbf-41b2-ada9-f70b2c622ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:33:58.179939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:33:58.180873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:33:58.181812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:33:58.181812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:33:58.181812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:33:58.181812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:33:58.182081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832797f4-35b4-4ef0-8f7f-72f385b92409 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:33:58.182162 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 9/18] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:33:58.182235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 10/19] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:33:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:33:58.186853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c618a54-9bbf-41b2-ada9-f70b2c622ed5 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:33:58.188631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832797f4-35b4-4ef0-8f7f-72f385b92409 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:33:58.280186 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832797f4-35b4-4ef0-8f7f-72f385b92409 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:33:58.282371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c618a54-9bbf-41b2-ada9-f70b2c622ed5 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:33:58.311899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d223d82-8c20-4e0e-852f-b54897609b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:33:58.312577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d223d82-8c20-4e0e-852f-b54897609b01 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:58.312852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d223d82-8c20-4e0e-852f-b54897609b01 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:58.313122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d223d82-8c20-4e0e-852f-b54897609b01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:58.313942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d223d82-8c20-4e0e-852f-b54897609b01 None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.domain.id=default, user.id=9672a6cf62bd46598e30f140bf9a1184) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:33:58.314247 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d223d82-8c20-4e0e-852f-b54897609b01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:33:58.315697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d223d82-8c20-4e0e-852f-b54897609b01 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:33:58.318050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d4c56-8be8-4202-847c-a4701fc9ae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:33:58.318711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d4c56-8be8-4202-847c-a4701fc9ae20 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:33:58.318990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d4c56-8be8-4202-847c-a4701fc9ae20 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:33:58.319296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d4c56-8be8-4202-847c-a4701fc9ae20 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:33:58.320019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d4c56-8be8-4202-847c-a4701fc9ae20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:33:58.320337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d4c56-8be8-4202-847c-a4701fc9ae20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:33:58.321941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d4c56-8be8-4202-847c-a4701fc9ae20 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:33:58.322562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 11/20] 10.222.0.73 () {56 vars in 1322 bytes} [Wed May 4 13:33:58 2022] GET /identity/v3/role_assignments?user.id=9672a6cf62bd46598e30f140bf9a1184&scope.domain.id=default&role.id=70e67f35994843ae942d4f1703d5619e => generated 233 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:33:58.340848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 10/21] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:01.020461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f0de8-9619-43b0-97eb-b2d54e85ff90 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.021466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f0de8-9619-43b0-97eb-b2d54e85ff90 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.021946 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f0de8-9619-43b0-97eb-b2d54e85ff90 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:01.024199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 12/22] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:01.029135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec40c8b-c1e5-49f9-96fd-490103a17fda None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.029969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec40c8b-c1e5-49f9-96fd-490103a17fda None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.030455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec40c8b-c1e5-49f9-96fd-490103a17fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:01.049171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff7f3e-6c83-46f8-a71e-6b704a24db5b None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.049785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff7f3e-6c83-46f8-a71e-6b704a24db5b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.050290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff7f3e-6c83-46f8-a71e-6b704a24db5b None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:01.052302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 13/23] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:01.053286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-0ec40c8b-c1e5-49f9-96fd-490103a17fda None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:01.054558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0ec40c8b-c1e5-49f9-96fd-490103a17fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:01.058543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09b5bd-5049-4680-8e43-7a471f381b81 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.059121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09b5bd-5049-4680-8e43-7a471f381b81 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.059631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09b5bd-5049-4680-8e43-7a471f381b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:01.089606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-7e09b5bd-5049-4680-8e43-7a471f381b81 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:01.089606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7e09b5bd-5049-4680-8e43-7a471f381b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:01.194011 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 11/24] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:01.218691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 14/25] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:01.240346 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec40c8b-c1e5-49f9-96fd-490103a17fda None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:01.254102 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09b5bd-5049-4680-8e43-7a471f381b81 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:01.360143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09b5bd-5049-4680-8e43-7a471f381b81 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:01.403576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d5985-9e59-494d-89eb-d22ea7fc0d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:01.406678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d5985-9e59-494d-89eb-d22ea7fc0d58 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.406966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d5985-9e59-494d-89eb-d22ea7fc0d58 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.407474 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d5985-9e59-494d-89eb-d22ea7fc0d58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:01.418574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d5985-9e59-494d-89eb-d22ea7fc0d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-036d5985-9e59-494d-89eb-d22ea7fc0d58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:01.427348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:01.428331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:01.429261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:01.429261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:01.429261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:01.429261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:01.429261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:01.429261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:01.429261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:01.429261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:01.429261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:01.429261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:01.429261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:01.429261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:01.431137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 15/26] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:01.432570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab671f6-6b1a-462e-a30a-0ad6fa0144bc None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.432997 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab671f6-6b1a-462e-a30a-0ad6fa0144bc None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.433399 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab671f6-6b1a-462e-a30a-0ad6fa0144bc None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:01.439319 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 16/27] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:01.441185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa226a8-ea13-42d8-b435-aa329274faa1 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.441614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa226a8-ea13-42d8-b435-aa329274faa1 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.442028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa226a8-ea13-42d8-b435-aa329274faa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:01.459392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-5fa226a8-ea13-42d8-b435-aa329274faa1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:01.460746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-5fa226a8-ea13-42d8-b435-aa329274faa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:01.473119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec40c8b-c1e5-49f9-96fd-490103a17fda None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:01.526853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 17/28] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:01.532194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa226a8-ea13-42d8-b435-aa329274faa1 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:01.571156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb11ce-d25e-49b4-a789-d130e1dc12eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:01.571920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb11ce-d25e-49b4-a789-d130e1dc12eb None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.572202 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb11ce-d25e-49b4-a789-d130e1dc12eb None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.572475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb11ce-d25e-49b4-a789-d130e1dc12eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:01.593381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb11ce-d25e-49b4-a789-d130e1dc12eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:01.594834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb11ce-d25e-49b4-a789-d130e1dc12eb None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-91fb11ce-d25e-49b4-a789-d130e1dc12eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:34:01.629027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:01.629997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:01.630939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:34:01.630939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:34:01.630939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:34:01.630939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:01.634823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 12/29] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:01.638316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb11ce-d25e-49b4-a789-d130e1dc12eb None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:01.704997 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa226a8-ea13-42d8-b435-aa329274faa1 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:01.757823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb11ce-d25e-49b4-a789-d130e1dc12eb None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:01.771017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a27a1-0454-4f54-8eaf-341a0c195093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:01.772073 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a27a1-0454-4f54-8eaf-341a0c195093 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.772585 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a27a1-0454-4f54-8eaf-341a0c195093 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.773058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a27a1-0454-4f54-8eaf-341a0c195093 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:01.774017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a27a1-0454-4f54-8eaf-341a0c195093 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:01.774520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a27a1-0454-4f54-8eaf-341a0c195093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:01.776164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a27a1-0454-4f54-8eaf-341a0c195093 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:01.787111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 18/30] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:01.788133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a27a1-0454-4f54-8eaf-341a0c195093 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:01.812053 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb7ced-212a-4768-a569-99f1b55c543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:01.813470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb7ced-212a-4768-a569-99f1b55c543d None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.813922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb7ced-212a-4768-a569-99f1b55c543d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.814583 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb7ced-212a-4768-a569-99f1b55c543d None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:01.815659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb7ced-212a-4768-a569-99f1b55c543d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:01.817775 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb7ced-212a-4768-a569-99f1b55c543d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:01.893582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a27a1-0454-4f54-8eaf-341a0c195093 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:01.929657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d0c34-da7c-4326-ab06-b5ece0ed3b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:01.930542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0c34-da7c-4326-ab06-b5ece0ed3b36 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.930980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0c34-da7c-4326-ab06-b5ece0ed3b36 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.931419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d0c34-da7c-4326-ab06-b5ece0ed3b36 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:01.932371 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d0c34-da7c-4326-ab06-b5ece0ed3b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:01.932835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d0c34-da7c-4326-ab06-b5ece0ed3b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:01.934339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d0c34-da7c-4326-ab06-b5ece0ed3b36 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:01.944341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 13/31] 10.222.0.73 () {60 vars in 1131 bytes} [Wed May 4 13:34:01 2022] POST /identity/v3/roles => generated 219 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:34:01.946295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0086b-864f-4c37-9ada-61531d1fc70d None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.946700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0086b-864f-4c37-9ada-61531d1fc70d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.947090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0086b-864f-4c37-9ada-61531d1fc70d None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:01.953940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 19/33] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:01.955237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d0c34-da7c-4326-ab06-b5ece0ed3b36 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:01.955799 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 14/33] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:01.957311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a4201-9938-4b6a-9990-8f6430274726 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:01.957601 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a4201-9938-4b6a-9990-8f6430274726 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:01.957885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a4201-9938-4b6a-9990-8f6430274726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:02.000489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-398a4201-9938-4b6a-9990-8f6430274726 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:02.002058 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-398a4201-9938-4b6a-9990-8f6430274726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:02.085123 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d0c34-da7c-4326-ab06-b5ece0ed3b36 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:02.129406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149b6a8-10b5-4bdd-bde2-53f2e4f6410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:02.130302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149b6a8-10b5-4bdd-bde2-53f2e4f6410f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:02.131461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149b6a8-10b5-4bdd-bde2-53f2e4f6410f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:02.131739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149b6a8-10b5-4bdd-bde2-53f2e4f6410f None admin] PATH_INFO: `/v3/users/9672a6cf62bd46598e30f140bf9a1184` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:02.135999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149b6a8-10b5-4bdd-bde2-53f2e4f6410f None admin] RBAC: Authorizing `identity:get_user(user_id=9672a6cf62bd46598e30f140bf9a1184)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:02.137538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149b6a8-10b5-4bdd-bde2-53f2e4f6410f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:02.139730 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 20/34] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:01 2022] GET /identity/v3/users/9672a6cf62bd46598e30f140bf9a1184 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:02.141081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149b6a8-10b5-4bdd-bde2-53f2e4f6410f None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:02.164940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 15/35] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:02.165787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a4201-9938-4b6a-9990-8f6430274726 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:02.283038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149b6a8-10b5-4bdd-bde2-53f2e4f6410f None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:02.304865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a4201-9938-4b6a-9990-8f6430274726 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:02.338117 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ed73-5253-4e9f-8c50-dd7f37e95d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:02.338792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ed73-5253-4e9f-8c50-dd7f37e95d09 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:02.339075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ed73-5253-4e9f-8c50-dd7f37e95d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:02.339409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ed73-5253-4e9f-8c50-dd7f37e95d09 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:02.340108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84ed73-5253-4e9f-8c50-dd7f37e95d09 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:02.342751 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84ed73-5253-4e9f-8c50-dd7f37e95d09 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:02.356689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096b728-2397-430f-aa5e-e133b2d32cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:02.357823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b728-2397-430f-aa5e-e133b2d32cc4 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:02.358308 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b728-2397-430f-aa5e-e133b2d32cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:02.358786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b728-2397-430f-aa5e-e133b2d32cc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:02.360575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096b728-2397-430f-aa5e-e133b2d32cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:02.362349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096b728-2397-430f-aa5e-e133b2d32cc4 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:02.369392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 16/36] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:02.369392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096b728-2397-430f-aa5e-e133b2d32cc4 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:02.477845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096b728-2397-430f-aa5e-e133b2d32cc4 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:02.493538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 21/37] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:34:02 2022] POST /identity/v3/projects => generated 301 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:34:02.500509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ed73-5253-4e9f-8c50-dd7f37e95d09 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:02.516010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0896ad-7513-4621-881c-0ef92e5c9752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:02.517108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0896ad-7513-4621-881c-0ef92e5c9752 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:02.517603 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0896ad-7513-4621-881c-0ef92e5c9752 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:02.518088 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0896ad-7513-4621-881c-0ef92e5c9752 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:02.519077 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0896ad-7513-4621-881c-0ef92e5c9752 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:02.520817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0896ad-7513-4621-881c-0ef92e5c9752 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:02.547287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 17/38] 10.222.0.73 () {60 vars in 1131 bytes} [Wed May 4 13:34:02 2022] POST /identity/v3/roles => generated 225 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:34:02.547287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f407c8-02f0-4aaa-902b-8d7ab9750d39 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:02.547287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f407c8-02f0-4aaa-902b-8d7ab9750d39 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:02.547287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f407c8-02f0-4aaa-902b-8d7ab9750d39 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:02.549140 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 18/39] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:02.561057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7235c-490e-4013-a70b-08f805695c30 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:02.561374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7235c-490e-4013-a70b-08f805695c30 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:02.561626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7235c-490e-4013-a70b-08f805695c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:02.597934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d2b7235c-490e-4013-a70b-08f805695c30 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:02.600047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d2b7235c-490e-4013-a70b-08f805695c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:02.663819 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ed73-5253-4e9f-8c50-dd7f37e95d09 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:02.703330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02252c-5382-4bae-bf76-1ff95d2e32c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:02.704233 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02252c-5382-4bae-bf76-1ff95d2e32c8 None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:02.704516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02252c-5382-4bae-bf76-1ff95d2e32c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:02.704856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02252c-5382-4bae-bf76-1ff95d2e32c8 None admin] PATH_INFO: `/v3/domains/default/users/9672a6cf62bd46598e30f140bf9a1184/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:02.708084 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02252c-5382-4bae-bf76-1ff95d2e32c8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9672a6cf62bd46598e30f140bf9a1184, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:02.709717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02252c-5382-4bae-bf76-1ff95d2e32c8 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:02.716252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 19/40] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:02.719166 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d13d1d-9c59-46ac-a8f2-1f2fc54dd6c5 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:02.719578 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d13d1d-9c59-46ac-a8f2-1f2fc54dd6c5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:02.720141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d13d1d-9c59-46ac-a8f2-1f2fc54dd6c5 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:02.724248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 20/41] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:02.732025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cce74-8e34-4755-b187-917dbf2a8048 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:02.732313 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cce74-8e34-4755-b187-917dbf2a8048 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:02.732578 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cce74-8e34-4755-b187-917dbf2a8048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:02.738782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 22/42] 10.222.0.73 () {58 vars in 1361 bytes} [Wed May 4 13:34:02 2022] PUT /identity/v3/domains/default/users/9672a6cf62bd46598e30f140bf9a1184/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:34:02.745004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02252c-5382-4bae-bf76-1ff95d2e32c8 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:02.761728 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-6a5cce74-8e34-4755-b187-917dbf2a8048 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:02.763168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6a5cce74-8e34-4755-b187-917dbf2a8048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:02.872919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 21/43] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:02.893967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02252c-5382-4bae-bf76-1ff95d2e32c8 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:02.896530 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cce74-8e34-4755-b187-917dbf2a8048 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:02.929179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48710810-5675-4282-a56b-01e9f45b1854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:02.929990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48710810-5675-4282-a56b-01e9f45b1854 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:02.930271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48710810-5675-4282-a56b-01e9f45b1854 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:02.930547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48710810-5675-4282-a56b-01e9f45b1854 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:02.931793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48710810-5675-4282-a56b-01e9f45b1854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:02.933307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48710810-5675-4282-a56b-01e9f45b1854 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:02.935115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 23/44] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:02.942066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48710810-5675-4282-a56b-01e9f45b1854 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:03.003725 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cce74-8e34-4755-b187-917dbf2a8048 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:03.036872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861849d-7bcb-4f7b-ad4d-e526d6f2b5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:03.037545 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861849d-7bcb-4f7b-ad4d-e526d6f2b5ab None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:03.037825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861849d-7bcb-4f7b-ad4d-e526d6f2b5ab None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:03.038098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861849d-7bcb-4f7b-ad4d-e526d6f2b5ab None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:03.038851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861849d-7bcb-4f7b-ad4d-e526d6f2b5ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:03.040268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861849d-7bcb-4f7b-ad4d-e526d6f2b5ab None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:03.042573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48710810-5675-4282-a56b-01e9f45b1854 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:03.053535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 22/45] 10.222.0.73 () {60 vars in 1131 bytes} [Wed May 4 13:34:02 2022] POST /identity/v3/roles => generated 223 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:34:03.078809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb086784-bbe5-4935-a263-86fe4f3b77fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:03.079554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb086784-bbe5-4935-a263-86fe4f3b77fd None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:03.079836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb086784-bbe5-4935-a263-86fe4f3b77fd None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:03.080111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb086784-bbe5-4935-a263-86fe4f3b77fd None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:03.080884 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb086784-bbe5-4935-a263-86fe4f3b77fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:03.082384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb086784-bbe5-4935-a263-86fe4f3b77fd None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:03.119245 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 24/46] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:34:02 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:34:05.004030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66aa35-5a7f-444a-8c1c-fdfec6cc2e76 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:05.004556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66aa35-5a7f-444a-8c1c-fdfec6cc2e76 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:05.004665 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66aa35-5a7f-444a-8c1c-fdfec6cc2e76 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:05.005953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 23/47] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:05.011351 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61e77-4fa5-4bcd-9fca-51404dfc6417 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:05.011766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61e77-4fa5-4bcd-9fca-51404dfc6417 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:05.011914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61e77-4fa5-4bcd-9fca-51404dfc6417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:05.028394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-93c61e77-4fa5-4bcd-9fca-51404dfc6417 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:05.029866 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-93c61e77-4fa5-4bcd-9fca-51404dfc6417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:05.093476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 25/48] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:05.116670 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66aa35-5a7f-444a-8c1c-fdfec6cc2e76 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:05.214692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66aa35-5a7f-444a-8c1c-fdfec6cc2e76 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:05.251439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d038eb3-39dc-4e13-bc8b-230338bf55da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:05.252248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038eb3-39dc-4e13-bc8b-230338bf55da None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:05.252529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038eb3-39dc-4e13-bc8b-230338bf55da None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:05.252801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038eb3-39dc-4e13-bc8b-230338bf55da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:05.266112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d038eb3-39dc-4e13-bc8b-230338bf55da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-6d038eb3-39dc-4e13-bc8b-230338bf55da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:05.274881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:05.275844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:05.276607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 24/49] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:34:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:05.283408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61e77-4fa5-4bcd-9fca-51404dfc6417 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:05.378202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61e77-4fa5-4bcd-9fca-51404dfc6417 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:05.411146 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3de1be-4b80-4182-9146-9c7ccbb71246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:05.411837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3de1be-4b80-4182-9146-9c7ccbb71246 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:05.412117 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3de1be-4b80-4182-9146-9c7ccbb71246 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:05.412389 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3de1be-4b80-4182-9146-9c7ccbb71246 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:05.413135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3de1be-4b80-4182-9146-9c7ccbb71246 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:05.413436 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3de1be-4b80-4182-9146-9c7ccbb71246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:05.414803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3de1be-4b80-4182-9146-9c7ccbb71246 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:05.423584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 26/50] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:05.428907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d038eb3-39dc-4e13-bc8b-230338bf55da None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:05.458520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd7b00-4b36-4f48-bcd0-9c105c76b639 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:05.458809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd7b00-4b36-4f48-bcd0-9c105c76b639 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:05.459088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd7b00-4b36-4f48-bcd0-9c105c76b639 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:05.460483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 27/51] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:34:05.465636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72bdd3-7ada-4e60-8f9b-f50104825bbd None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:05.465998 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72bdd3-7ada-4e60-8f9b-f50104825bbd None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:05.466274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72bdd3-7ada-4e60-8f9b-f50104825bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:05.482838 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6c72bdd3-7ada-4e60-8f9b-f50104825bbd None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:05.484659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6c72bdd3-7ada-4e60-8f9b-f50104825bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:05.526943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d038eb3-39dc-4e13-bc8b-230338bf55da None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:05.548531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 28/52] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:05.558029 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beba35-16a5-45de-98dd-94962b21a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:05.559180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beba35-16a5-45de-98dd-94962b21a938 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:05.559484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beba35-16a5-45de-98dd-94962b21a938 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:05.559751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beba35-16a5-45de-98dd-94962b21a938 None admin] PATH_INFO: `/v3/users/9672a6cf62bd46598e30f140bf9a1184` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:05.561176 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beba35-16a5-45de-98dd-94962b21a938 None admin] RBAC: Authorizing `identity:get_user(user_id=9672a6cf62bd46598e30f140bf9a1184)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:05.563179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beba35-16a5-45de-98dd-94962b21a938 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:05.564814 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 25/53] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:05 2022] GET /identity/v3/users/9672a6cf62bd46598e30f140bf9a1184 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:05.570142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72bdd3-7ada-4e60-8f9b-f50104825bbd None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:05.571665 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beba35-16a5-45de-98dd-94962b21a938 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:05.664551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72bdd3-7ada-4e60-8f9b-f50104825bbd None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:05.668285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beba35-16a5-45de-98dd-94962b21a938 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:05.705132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e102f6-6da7-4822-9e62-9de048c61cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:05.705983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e102f6-6da7-4822-9e62-9de048c61cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:05.706276 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e102f6-6da7-4822-9e62-9de048c61cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:05.706702 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e102f6-6da7-4822-9e62-9de048c61cf3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:05.707952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e102f6-6da7-4822-9e62-9de048c61cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:05.709523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e102f6-6da7-4822-9e62-9de048c61cf3 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:05.710284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387097f-2532-4968-bc7f-51ac6bd898ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:05.711091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 26/54] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:05.711570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387097f-2532-4968-bc7f-51ac6bd898ab None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:05.712088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387097f-2532-4968-bc7f-51ac6bd898ab None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:05.712566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387097f-2532-4968-bc7f-51ac6bd898ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:05.714584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387097f-2532-4968-bc7f-51ac6bd898ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:05.717285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387097f-2532-4968-bc7f-51ac6bd898ab None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:05.719633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e102f6-6da7-4822-9e62-9de048c61cf3 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:05.719870 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 29/55] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:05.728102 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387097f-2532-4968-bc7f-51ac6bd898ab None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:05.864281 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e102f6-6da7-4822-9e62-9de048c61cf3 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:05.868560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387097f-2532-4968-bc7f-51ac6bd898ab None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:05.912228 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820c0f9-0d51-4577-bb92-8b09d2357c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:05.913278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820c0f9-0d51-4577-bb92-8b09d2357c4f None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:05.913759 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820c0f9-0d51-4577-bb92-8b09d2357c4f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:05.914228 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820c0f9-0d51-4577-bb92-8b09d2357c4f None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:05.915511 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820c0f9-0d51-4577-bb92-8b09d2357c4f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:05.917012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f484a-4388-489b-a20a-728df8327643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:05.918003 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f484a-4388-489b-a20a-728df8327643 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:05.918091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820c0f9-0d51-4577-bb92-8b09d2357c4f None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:05.918496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f484a-4388-489b-a20a-728df8327643 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:05.918936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f484a-4388-489b-a20a-728df8327643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:05.920416 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f484a-4388-489b-a20a-728df8327643 None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.domain.id=default, user.id=9672a6cf62bd46598e30f140bf9a1184) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:05.920943 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f484a-4388-489b-a20a-728df8327643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:05.924006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f484a-4388-489b-a20a-728df8327643 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:05.929804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 30/56] 10.222.0.73 () {56 vars in 1322 bytes} [Wed May 4 13:34:05 2022] GET /identity/v3/role_assignments?user.id=9672a6cf62bd46598e30f140bf9a1184&scope.domain.id=default&role.id=70e67f35994843ae942d4f1703d5619e => generated 530 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:05.948864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 27/57] 10.222.0.73 () {60 vars in 1140 bytes} [Wed May 4 13:34:05 2022] POST /identity/v3/projects => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:34:08.196476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bbf41-128d-4110-b4bf-3ec392d93037 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:08.196992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bbf41-128d-4110-b4bf-3ec392d93037 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:08.197074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bbf41-128d-4110-b4bf-3ec392d93037 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:08.198380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 31/58] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:08.203415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3383df-c828-4978-a8b3-f3923999a133 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:08.203832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3383df-c828-4978-a8b3-f3923999a133 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:08.203999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3383df-c828-4978-a8b3-f3923999a133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:08.220080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-dc3383df-c828-4978-a8b3-f3923999a133 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:08.221240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-dc3383df-c828-4978-a8b3-f3923999a133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:08.283191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 28/59] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:08.307678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bbf41-128d-4110-b4bf-3ec392d93037 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:08.402083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bbf41-128d-4110-b4bf-3ec392d93037 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:08.432510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b355c9c-ccfd-49ae-99fd-186cbdb4481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:08.433282 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b355c9c-ccfd-49ae-99fd-186cbdb4481b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:08.433566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b355c9c-ccfd-49ae-99fd-186cbdb4481b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:08.433842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b355c9c-ccfd-49ae-99fd-186cbdb4481b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:08.434997 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b355c9c-ccfd-49ae-99fd-186cbdb4481b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:08.436468 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b355c9c-ccfd-49ae-99fd-186cbdb4481b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:08.438558 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 32/60] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:08.443862 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3383df-c828-4978-a8b3-f3923999a133 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:08.535856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3383df-c828-4978-a8b3-f3923999a133 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:08.567345 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad6a43-4b83-4838-94a2-8b9f13f7ce09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:08.567999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad6a43-4b83-4838-94a2-8b9f13f7ce09 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:08.568284 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad6a43-4b83-4838-94a2-8b9f13f7ce09 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:08.568562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad6a43-4b83-4838-94a2-8b9f13f7ce09 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:08.569275 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad6a43-4b83-4838-94a2-8b9f13f7ce09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:08.570956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad6a43-4b83-4838-94a2-8b9f13f7ce09 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:08.595523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 29/61] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:34:08 2022] POST /identity/v3/users => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:34:12.079241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f28c84-3715-476e-a347-f552707354ed None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.079241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f28c84-3715-476e-a347-f552707354ed None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.079241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f28c84-3715-476e-a347-f552707354ed None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.080197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 33/62] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:12.084993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8427244-59fd-42be-afa1-21ccae921cf4 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.085941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8427244-59fd-42be-afa1-21ccae921cf4 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.086437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8427244-59fd-42be-afa1-21ccae921cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.108385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-e8427244-59fd-42be-afa1-21ccae921cf4 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:12.110502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e8427244-59fd-42be-afa1-21ccae921cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:12.175021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239f935-02d6-4735-83ff-914eaed2378c None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.175337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239f935-02d6-4735-83ff-914eaed2378c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.175619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239f935-02d6-4735-83ff-914eaed2378c None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.177260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 34/63] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:12.187014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36281-8792-4b4d-bf5f-8b704bc1b8a8 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.187340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36281-8792-4b4d-bf5f-8b704bc1b8a8 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.187620 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed36281-8792-4b4d-bf5f-8b704bc1b8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.193821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 30/64] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:12.216972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8427244-59fd-42be-afa1-21ccae921cf4 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:12.224243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-4ed36281-8792-4b4d-bf5f-8b704bc1b8a8 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:12.225448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4ed36281-8792-4b4d-bf5f-8b704bc1b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:12.332961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 35/65] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:12.359982 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed36281-8792-4b4d-bf5f-8b704bc1b8a8 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:12.399188 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8427244-59fd-42be-afa1-21ccae921cf4 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:12.439822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca98e9-ead8-41dc-aad1-3ab4690c4d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:12.440913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca98e9-ead8-41dc-aad1-3ab4690c4d1d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.441373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca98e9-ead8-41dc-aad1-3ab4690c4d1d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.441822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca98e9-ead8-41dc-aad1-3ab4690c4d1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.453274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca98e9-ead8-41dc-aad1-3ab4690c4d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-2aca98e9-ead8-41dc-aad1-3ab4690c4d1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:12.461253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:12.462156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:12.463167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 31/66] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:12.463841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53804-c2b8-476f-8fac-7cac28829b37 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.464383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53804-c2b8-476f-8fac-7cac28829b37 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.464383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53804-c2b8-476f-8fac-7cac28829b37 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.465594 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 32/67] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:12.466802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53136df-ac6a-4e35-9b7b-cbd560e2caa0 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.467265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53136df-ac6a-4e35-9b7b-cbd560e2caa0 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.467778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53136df-ac6a-4e35-9b7b-cbd560e2caa0 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.470004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 33/68] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:12.470937 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53136df-ac6a-4e35-9b7b-cbd560e2caa0 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:12.478846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed36281-8792-4b4d-bf5f-8b704bc1b8a8 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:12.513108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226692a3-a266-4b80-b9f0-d21f11d8ef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:12.514133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226692a3-a266-4b80-b9f0-d21f11d8ef42 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.514556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226692a3-a266-4b80-b9f0-d21f11d8ef42 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.515561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226692a3-a266-4b80-b9f0-d21f11d8ef42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.525468 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226692a3-a266-4b80-b9f0-d21f11d8ef42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-226692a3-a266-4b80-b9f0-d21f11d8ef42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:12.534286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:12.535361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:12.536301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:12.536301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:12.536301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:12.536301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:12.536301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:12.536301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:12.536301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:12.536301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:12.536301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:12.536301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:12.536301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:12.536301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:12.538279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 36/69] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:34:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:12.544328 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c071c-24ba-477d-a732-51835e59fa5f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.544622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c071c-24ba-477d-a732-51835e59fa5f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.544969 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c071c-24ba-477d-a732-51835e59fa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.563785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-889c071c-24ba-477d-a732-51835e59fa5f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:12.565143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-889c071c-24ba-477d-a732-51835e59fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:12.572022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53136df-ac6a-4e35-9b7b-cbd560e2caa0 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:12.605022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1471c8-f5ae-431c-8350-f015fadd655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:12.605618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1471c8-f5ae-431c-8350-f015fadd655a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.605907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1471c8-f5ae-431c-8350-f015fadd655a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.606184 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1471c8-f5ae-431c-8350-f015fadd655a None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.606934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1471c8-f5ae-431c-8350-f015fadd655a None admin] RBAC: Adding query filter params (name=member) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:12.607267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1471c8-f5ae-431c-8350-f015fadd655a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:12.608647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1471c8-f5ae-431c-8350-f015fadd655a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:12.620230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 34/70] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:12.621439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c07ba-66df-4d6b-a92f-c792ffd5804d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.621729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c07ba-66df-4d6b-a92f-c792ffd5804d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.622007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c07ba-66df-4d6b-a92f-c792ffd5804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.630915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 37/71] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:12.631795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c071c-24ba-477d-a732-51835e59fa5f None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:12.637827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-665c07ba-66df-4d6b-a92f-c792ffd5804d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:12.639358 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-665c07ba-66df-4d6b-a92f-c792ffd5804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:12.701760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 35/72] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:12.703610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff4bff-bcb0-46ec-b291-1b796a296a8a None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.703899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff4bff-bcb0-46ec-b291-1b796a296a8a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.704175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff4bff-bcb0-46ec-b291-1b796a296a8a None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.705415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 36/73] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:12.706106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff4bff-bcb0-46ec-b291-1b796a296a8a None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:12.727962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c071c-24ba-477d-a732-51835e59fa5f None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:12.759184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15841e36-1dcf-4a64-9ec3-8912bdc29a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:12.759868 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15841e36-1dcf-4a64-9ec3-8912bdc29a21 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.760147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15841e36-1dcf-4a64-9ec3-8912bdc29a21 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.760418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15841e36-1dcf-4a64-9ec3-8912bdc29a21 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.761162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15841e36-1dcf-4a64-9ec3-8912bdc29a21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:12.761467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15841e36-1dcf-4a64-9ec3-8912bdc29a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:12.762844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15841e36-1dcf-4a64-9ec3-8912bdc29a21 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:12.775136 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 38/74] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:34:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:12.775136 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15841e36-1dcf-4a64-9ec3-8912bdc29a21 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:12.816269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff4bff-bcb0-46ec-b291-1b796a296a8a None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:12.848701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fdd89-9755-478b-a44d-1c6ca78e078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:12.849568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fdd89-9755-478b-a44d-1c6ca78e078a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.849854 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fdd89-9755-478b-a44d-1c6ca78e078a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.850131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fdd89-9755-478b-a44d-1c6ca78e078a None admin] PATH_INFO: `/v3/users/d7c7a65e48834491a829f72b9785f1ff` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.864527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fdd89-9755-478b-a44d-1c6ca78e078a None admin] RBAC: Authorizing `identity:get_user(user_id=d7c7a65e48834491a829f72b9785f1ff)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:12.865920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fdd89-9755-478b-a44d-1c6ca78e078a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:12.867625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 37/75] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:12 2022] GET /identity/v3/users/d7c7a65e48834491a829f72b9785f1ff => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:12.868793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29558f1f-43e3-4407-8b20-7ba946ff3e48 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.869082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29558f1f-43e3-4407-8b20-7ba946ff3e48 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.869363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29558f1f-43e3-4407-8b20-7ba946ff3e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.869959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15841e36-1dcf-4a64-9ec3-8912bdc29a21 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:12.885430 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-29558f1f-43e3-4407-8b20-7ba946ff3e48 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:12.886614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-29558f1f-43e3-4407-8b20-7ba946ff3e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:12.902896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0ccec-d8c0-4355-b2e2-ab57fcdc863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:12.903708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ccec-d8c0-4355-b2e2-ab57fcdc863b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:12.903995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ccec-d8c0-4355-b2e2-ab57fcdc863b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:12.904274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ccec-d8c0-4355-b2e2-ab57fcdc863b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:12.916749 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0ccec-d8c0-4355-b2e2-ab57fcdc863b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-c8e0ccec-d8c0-4355-b2e2-ab57fcdc863b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:12.924789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:12.925662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:12.926431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 39/76] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:34:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:12.927066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0ccec-d8c0-4355-b2e2-ab57fcdc863b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:12.955241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 38/77] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:12.956035 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29558f1f-43e3-4407-8b20-7ba946ff3e48 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:13.020808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0ccec-d8c0-4355-b2e2-ab57fcdc863b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:13.049165 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29558f1f-43e3-4407-8b20-7ba946ff3e48 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:13.051702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa6365-97e1-4eb1-964d-43f3d9a79a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:13.052546 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa6365-97e1-4eb1-964d-43f3d9a79a66 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:13.052786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa6365-97e1-4eb1-964d-43f3d9a79a66 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:13.053067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa6365-97e1-4eb1-964d-43f3d9a79a66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:13.063248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa6365-97e1-4eb1-964d-43f3d9a79a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-45fa6365-97e1-4eb1-964d-43f3d9a79a66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:13.071028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:13.071882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:13.072643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 40/78] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:13.073349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa6365-97e1-4eb1-964d-43f3d9a79a66 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:13.085573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6164e-1629-41cb-b615-cbfde92a03b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:13.086439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6164e-1629-41cb-b615-cbfde92a03b4 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:13.086713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6164e-1629-41cb-b615-cbfde92a03b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:13.086982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6164e-1629-41cb-b615-cbfde92a03b4 None admin] PATH_INFO: `/v3/users/d7c7a65e48834491a829f72b9785f1ff` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:13.088190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6164e-1629-41cb-b615-cbfde92a03b4 None admin] RBAC: Authorizing `identity:get_user(user_id=d7c7a65e48834491a829f72b9785f1ff)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:13.089630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6164e-1629-41cb-b615-cbfde92a03b4 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:13.091566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 39/79] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:12 2022] GET /identity/v3/users/d7c7a65e48834491a829f72b9785f1ff => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:13.092334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6164e-1629-41cb-b615-cbfde92a03b4 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:13.166312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa6365-97e1-4eb1-964d-43f3d9a79a66 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:13.188919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6164e-1629-41cb-b615-cbfde92a03b4 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:13.197739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e93ace-b565-4ea5-81e9-ac44529adac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:13.198379 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e93ace-b565-4ea5-81e9-ac44529adac2 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:13.198661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e93ace-b565-4ea5-81e9-ac44529adac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:13.198935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e93ace-b565-4ea5-81e9-ac44529adac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:13.221449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924af86-cae6-49b8-8dae-fc78f993ea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:13.222107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924af86-cae6-49b8-8dae-fc78f993ea5a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:13.222395 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924af86-cae6-49b8-8dae-fc78f993ea5a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:13.222675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924af86-cae6-49b8-8dae-fc78f993ea5a None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:13.223452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924af86-cae6-49b8-8dae-fc78f993ea5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:13.223760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924af86-cae6-49b8-8dae-fc78f993ea5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:13.225131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924af86-cae6-49b8-8dae-fc78f993ea5a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:13.232833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 40/80] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:13.233608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924af86-cae6-49b8-8dae-fc78f993ea5a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:13.262607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e93ace-b565-4ea5-81e9-ac44529adac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:13.264106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e93ace-b565-4ea5-81e9-ac44529adac2 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:13.327872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924af86-cae6-49b8-8dae-fc78f993ea5a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:13.357409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 41/81] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:13.358245 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e93ace-b565-4ea5-81e9-ac44529adac2 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:13.364020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1d297-8f26-4728-80a2-81202ff8dc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:13.364820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1d297-8f26-4728-80a2-81202ff8dc86 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:13.365107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1d297-8f26-4728-80a2-81202ff8dc86 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:13.365383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1d297-8f26-4728-80a2-81202ff8dc86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:13.366568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1d297-8f26-4728-80a2-81202ff8dc86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:13.368044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1d297-8f26-4728-80a2-81202ff8dc86 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:13.369626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 41/82] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:13.370381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1d297-8f26-4728-80a2-81202ff8dc86 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:13.454274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e93ace-b565-4ea5-81e9-ac44529adac2 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:13.462745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1d297-8f26-4728-80a2-81202ff8dc86 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:13.485799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fff5e3-0090-4f4b-bab6-8c54834f1c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:13.486456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fff5e3-0090-4f4b-bab6-8c54834f1c9c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:13.486739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fff5e3-0090-4f4b-bab6-8c54834f1c9c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:13.487021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fff5e3-0090-4f4b-bab6-8c54834f1c9c None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:13.487789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fff5e3-0090-4f4b-bab6-8c54834f1c9c None admin] RBAC: Adding query filter params (name=member) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:13.488097 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fff5e3-0090-4f4b-bab6-8c54834f1c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:13.489477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fff5e3-0090-4f4b-bab6-8c54834f1c9c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:13.494384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9515b9-0217-4da0-8bc7-b1631a014af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:13.495025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9515b9-0217-4da0-8bc7-b1631a014af8 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:13.495340 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9515b9-0217-4da0-8bc7-b1631a014af8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:13.495617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9515b9-0217-4da0-8bc7-b1631a014af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:13.497266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 42/83] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:13.497926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fff5e3-0090-4f4b-bab6-8c54834f1c9c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:13.563304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9515b9-0217-4da0-8bc7-b1631a014af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:13.564787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9515b9-0217-4da0-8bc7-b1631a014af8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:13.589927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fff5e3-0090-4f4b-bab6-8c54834f1c9c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:13.620846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdb49a-9e61-474d-87ce-cc5ed98a99f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:13.621701 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdb49a-9e61-474d-87ce-cc5ed98a99f0 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:13.621982 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdb49a-9e61-474d-87ce-cc5ed98a99f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:13.622258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdb49a-9e61-474d-87ce-cc5ed98a99f0 None admin] PATH_INFO: `/v3/users/9672a6cf62bd46598e30f140bf9a1184` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:13.623480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdb49a-9e61-474d-87ce-cc5ed98a99f0 None admin] RBAC: Authorizing `identity:get_user(user_id=9672a6cf62bd46598e30f140bf9a1184)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:13.625512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdb49a-9e61-474d-87ce-cc5ed98a99f0 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:13.627111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 43/84] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:13 2022] GET /identity/v3/users/9672a6cf62bd46598e30f140bf9a1184 => generated 247 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:13.627889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdb49a-9e61-474d-87ce-cc5ed98a99f0 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:13.661659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 42/85] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:13.662653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9515b9-0217-4da0-8bc7-b1631a014af8 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:13.723074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdb49a-9e61-474d-87ce-cc5ed98a99f0 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:13.754277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304be79-d034-4da2-9e68-005b494a53bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:13.754448 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9515b9-0217-4da0-8bc7-b1631a014af8 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:13.755132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304be79-d034-4da2-9e68-005b494a53bd None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:13.755449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304be79-d034-4da2-9e68-005b494a53bd None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:13.755734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304be79-d034-4da2-9e68-005b494a53bd None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:13.756914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304be79-d034-4da2-9e68-005b494a53bd None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:13.758373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304be79-d034-4da2-9e68-005b494a53bd None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:13.760087 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 44/86] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:13 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:13.760849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304be79-d034-4da2-9e68-005b494a53bd None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:13.787135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b779ce-0354-404f-ade8-1405c36f00bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:13.787828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b779ce-0354-404f-ade8-1405c36f00bc None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:13.788109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b779ce-0354-404f-ade8-1405c36f00bc None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:13.788382 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b779ce-0354-404f-ade8-1405c36f00bc None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:13.789079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b779ce-0354-404f-ade8-1405c36f00bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:13.790498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b779ce-0354-404f-ade8-1405c36f00bc None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:13.809636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 43/87] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:34:13 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:34:13.810431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b779ce-0354-404f-ade8-1405c36f00bc None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:13.873547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304be79-d034-4da2-9e68-005b494a53bd None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:13.908239 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4783a2-9c65-4c01-a007-7dc96f6a9d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:13.909145 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4783a2-9c65-4c01-a007-7dc96f6a9d17 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:13.909428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4783a2-9c65-4c01-a007-7dc96f6a9d17 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:13.909707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4783a2-9c65-4c01-a007-7dc96f6a9d17 None admin] PATH_INFO: `/v3/users/d7c7a65e48834491a829f72b9785f1ff` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:13.910977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4783a2-9c65-4c01-a007-7dc96f6a9d17 None admin] RBAC: Authorizing `identity:get_user(user_id=d7c7a65e48834491a829f72b9785f1ff)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:13.912496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4783a2-9c65-4c01-a007-7dc96f6a9d17 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:13.918844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b779ce-0354-404f-ade8-1405c36f00bc None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:13.919018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 45/88] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:13 2022] GET /identity/v3/users/d7c7a65e48834491a829f72b9785f1ff => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:13.919018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4783a2-9c65-4c01-a007-7dc96f6a9d17 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:13.949265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07e593-0160-42f8-9738-780cfd32775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:13.949930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07e593-0160-42f8-9738-780cfd32775b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:13.950215 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07e593-0160-42f8-9738-780cfd32775b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:13.950492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07e593-0160-42f8-9738-780cfd32775b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:14.022783 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07e593-0160-42f8-9738-780cfd32775b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:14.024274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07e593-0160-42f8-9738-780cfd32775b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:14.028689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4783a2-9c65-4c01-a007-7dc96f6a9d17 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:14.063966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01524fcb-e43f-4815-8863-327bb977dec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:14.064832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01524fcb-e43f-4815-8863-327bb977dec5 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:14.065354 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01524fcb-e43f-4815-8863-327bb977dec5 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:14.065475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01524fcb-e43f-4815-8863-327bb977dec5 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:14.066567 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01524fcb-e43f-4815-8863-327bb977dec5 None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:14.068052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01524fcb-e43f-4815-8863-327bb977dec5 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:14.069933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 46/89] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:13 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:14.072130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01524fcb-e43f-4815-8863-327bb977dec5 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:14.125858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 44/90] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:14.127399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07e593-0160-42f8-9738-780cfd32775b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:14.179346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01524fcb-e43f-4815-8863-327bb977dec5 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:14.214174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94720bc7-7884-4d37-99ea-8eb3713da2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:14.214827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94720bc7-7884-4d37-99ea-8eb3713da2e5 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:14.215100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94720bc7-7884-4d37-99ea-8eb3713da2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:14.215410 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94720bc7-7884-4d37-99ea-8eb3713da2e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:14.216236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94720bc7-7884-4d37-99ea-8eb3713da2e5 None admin] RBAC: Adding query filter params (role.id=2f5b0d90f1814fe8a58210b5cd048bf7, scope.project.id=8f60414b09e148d391f54308214c18a7, user.id=d7c7a65e48834491a829f72b9785f1ff) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:14.216543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94720bc7-7884-4d37-99ea-8eb3713da2e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:14.218011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94720bc7-7884-4d37-99ea-8eb3713da2e5 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:14.224443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 47/91] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:14 2022] GET /identity/v3/role_assignments?user.id=d7c7a65e48834491a829f72b9785f1ff&scope.project.id=8f60414b09e148d391f54308214c18a7&role.id=2f5b0d90f1814fe8a58210b5cd048bf7 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:14.225261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94720bc7-7884-4d37-99ea-8eb3713da2e5 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:14.244825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07e593-0160-42f8-9738-780cfd32775b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:14.281620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f08213-f9a8-4eb2-a7fd-37dfdb2dfe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:14.282225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f08213-f9a8-4eb2-a7fd-37dfdb2dfe67 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:14.282508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f08213-f9a8-4eb2-a7fd-37dfdb2dfe67 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:14.282781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f08213-f9a8-4eb2-a7fd-37dfdb2dfe67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:14.356082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f08213-f9a8-4eb2-a7fd-37dfdb2dfe67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:14.357586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f08213-f9a8-4eb2-a7fd-37dfdb2dfe67 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:14.368366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94720bc7-7884-4d37-99ea-8eb3713da2e5 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:14.402666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ace57-88be-49b9-bfde-e0c0fbcb80e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:14.403383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ace57-88be-49b9-bfde-e0c0fbcb80e8 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:14.403670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ace57-88be-49b9-bfde-e0c0fbcb80e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:14.403948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ace57-88be-49b9-bfde-e0c0fbcb80e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:14.404832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ace57-88be-49b9-bfde-e0c0fbcb80e8 None admin] RBAC: Adding query filter params (role.id=142e36ee06a7422e8e8d32a1080ea89a, scope.project.id=8f60414b09e148d391f54308214c18a7, user.id=d7c7a65e48834491a829f72b9785f1ff) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:14.405143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ace57-88be-49b9-bfde-e0c0fbcb80e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:14.407220 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ace57-88be-49b9-bfde-e0c0fbcb80e8 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:14.413273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 48/92] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:14 2022] GET /identity/v3/role_assignments?user.id=d7c7a65e48834491a829f72b9785f1ff&scope.project.id=8f60414b09e148d391f54308214c18a7&role.id=142e36ee06a7422e8e8d32a1080ea89a => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:14.414129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ace57-88be-49b9-bfde-e0c0fbcb80e8 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:14.500426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 45/93] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:14.517318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f08213-f9a8-4eb2-a7fd-37dfdb2dfe67 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:14.525610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ace57-88be-49b9-bfde-e0c0fbcb80e8 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:14.561569 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467daf56-ee41-447b-8848-0ac07178b598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:14.563168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467daf56-ee41-447b-8848-0ac07178b598 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:14.563480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467daf56-ee41-447b-8848-0ac07178b598 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:14.563756 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467daf56-ee41-447b-8848-0ac07178b598 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:14.565049 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467daf56-ee41-447b-8848-0ac07178b598 None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:14.566740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467daf56-ee41-447b-8848-0ac07178b598 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:14.569241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 49/94] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:14 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:14.575664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467daf56-ee41-447b-8848-0ac07178b598 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:14.691129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467daf56-ee41-447b-8848-0ac07178b598 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:14.730046 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9369697-2805-4393-bfd3-670dbf4ccead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:14.730716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369697-2805-4393-bfd3-670dbf4ccead None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:14.730999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369697-2805-4393-bfd3-670dbf4ccead None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:14.731305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9369697-2805-4393-bfd3-670dbf4ccead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:14.732310 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9369697-2805-4393-bfd3-670dbf4ccead None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=8f60414b09e148d391f54308214c18a7, user.id=9672a6cf62bd46598e30f140bf9a1184) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:14.732621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9369697-2805-4393-bfd3-670dbf4ccead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:14.734913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9369697-2805-4393-bfd3-670dbf4ccead None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:14.741983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 50/95] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:14 2022] GET /identity/v3/role_assignments?user.id=9672a6cf62bd46598e30f140bf9a1184&scope.project.id=8f60414b09e148d391f54308214c18a7&role.id=70e67f35994843ae942d4f1703d5619e => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:14.750409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f08213-f9a8-4eb2-a7fd-37dfdb2dfe67 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:14.790696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a627a28-0367-4962-bd1c-1093bebff83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:14.791641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a627a28-0367-4962-bd1c-1093bebff83c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:14.791925 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a627a28-0367-4962-bd1c-1093bebff83c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:14.792203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a627a28-0367-4962-bd1c-1093bebff83c None admin] PATH_INFO: `/v3/projects/57b599073e1b41578401d3163aa2f6f5` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:14.793498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a627a28-0367-4962-bd1c-1093bebff83c None admin] RBAC: Authorizing `identity:get_project(project_id=57b599073e1b41578401d3163aa2f6f5)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:14.794985 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a627a28-0367-4962-bd1c-1093bebff83c None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:14.797042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 46/96] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:14 2022] GET /identity/v3/projects/57b599073e1b41578401d3163aa2f6f5 => generated 312 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:14.803346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9369697-2805-4393-bfd3-670dbf4ccead None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:14.943472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9369697-2805-4393-bfd3-670dbf4ccead None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:14.986706 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e70c0-79ed-4491-b610-e87f6d014f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:14.987391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e70c0-79ed-4491-b610-e87f6d014f1a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:14.987681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e70c0-79ed-4491-b610-e87f6d014f1a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:14.987953 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e70c0-79ed-4491-b610-e87f6d014f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:14.988792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e70c0-79ed-4491-b610-e87f6d014f1a None admin] RBAC: Adding query filter params (role.id=2f5b0d90f1814fe8a58210b5cd048bf7, scope.project.id=57b599073e1b41578401d3163aa2f6f5, user.id=d7c7a65e48834491a829f72b9785f1ff) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:14.989103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e70c0-79ed-4491-b610-e87f6d014f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:14.990543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e70c0-79ed-4491-b610-e87f6d014f1a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:14.996391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 51/97] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:14 2022] GET /identity/v3/role_assignments?user.id=d7c7a65e48834491a829f72b9785f1ff&scope.project.id=57b599073e1b41578401d3163aa2f6f5&role.id=2f5b0d90f1814fe8a58210b5cd048bf7 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:16.973849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69aad5-f888-41a4-a0f0-d4ed26418f1c None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:16.974366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69aad5-f888-41a4-a0f0-d4ed26418f1c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:16.974439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69aad5-f888-41a4-a0f0-d4ed26418f1c None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:16.975950 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 47/98] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:16.981043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc301bf-c6e8-491c-ac5d-92c8ceb20234 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:16.981452 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc301bf-c6e8-491c-ac5d-92c8ceb20234 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:16.981615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc301bf-c6e8-491c-ac5d-92c8ceb20234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:17.004939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-8bc301bf-c6e8-491c-ac5d-92c8ceb20234 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:17.006129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8bc301bf-c6e8-491c-ac5d-92c8ceb20234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:17.094247 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 52/99] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:17.109277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3153cc-b256-473c-87a5-3eb934e2c845 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:17.109589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3153cc-b256-473c-87a5-3eb934e2c845 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:17.109837 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3153cc-b256-473c-87a5-3eb934e2c845 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:17.111371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 48/100] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:17.116806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba73a01-3413-481f-bc61-22e78ddfb33d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:17.117325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba73a01-3413-481f-bc61-22e78ddfb33d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:17.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba73a01-3413-481f-bc61-22e78ddfb33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:17.135134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3153cc-b256-473c-87a5-3eb934e2c845 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:17.135363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-aba73a01-3413-481f-bc61-22e78ddfb33d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:17.136625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-aba73a01-3413-481f-bc61-22e78ddfb33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:17.229687 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 53/101] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:17.270413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba73a01-3413-481f-bc61-22e78ddfb33d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:17.300015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3153cc-b256-473c-87a5-3eb934e2c845 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:17.395464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06759d-7dec-456a-bb99-175c0734f8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:17.395836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba73a01-3413-481f-bc61-22e78ddfb33d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:17.396271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06759d-7dec-456a-bb99-175c0734f8db None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:17.396559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06759d-7dec-456a-bb99-175c0734f8db None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:17.396838 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06759d-7dec-456a-bb99-175c0734f8db None admin] PATH_INFO: `/v3/domains/default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:17.398007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06759d-7dec-456a-bb99-175c0734f8db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:17.399474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06759d-7dec-456a-bb99-175c0734f8db None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:17.401124 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 49/102] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:17.407007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06759d-7dec-456a-bb99-175c0734f8db None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:17.434818 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a7e9-9eec-4140-bf8e-ed706305cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:17.436040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a7e9-9eec-4140-bf8e-ed706305cc82 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:17.436331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a7e9-9eec-4140-bf8e-ed706305cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:17.436618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a7e9-9eec-4140-bf8e-ed706305cc82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:17.449329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74a7e9-9eec-4140-bf8e-ed706305cc82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-1c74a7e9-9eec-4140-bf8e-ed706305cc82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:17.457979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:17.458835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:17.459637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:17.459637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:17.459637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:17.459637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:17.459637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:17.459637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:17.459637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:17.459637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:17.459637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:17.459637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:17.459637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:17.459637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:17.460220 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 54/103] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:17.466198 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a7e9-9eec-4140-bf8e-ed706305cc82 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:17.578556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a7e9-9eec-4140-bf8e-ed706305cc82 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:17.617101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95c8ef-a589-4e3d-a9fa-923dcdf403e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:17.617844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95c8ef-a589-4e3d-a9fa-923dcdf403e8 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:17.618182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95c8ef-a589-4e3d-a9fa-923dcdf403e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:17.618510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95c8ef-a589-4e3d-a9fa-923dcdf403e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:17.619302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95c8ef-a589-4e3d-a9fa-923dcdf403e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:17.619622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95c8ef-a589-4e3d-a9fa-923dcdf403e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:17.621538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95c8ef-a589-4e3d-a9fa-923dcdf403e8 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:17.631032 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 55/104] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:17.636651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95c8ef-a589-4e3d-a9fa-923dcdf403e8 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:17.640850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06759d-7dec-456a-bb99-175c0734f8db None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:17.710654 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d06a6-c68b-4f82-a35c-566a607eb4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:17.711368 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d06a6-c68b-4f82-a35c-566a607eb4d8 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:17.711653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d06a6-c68b-4f82-a35c-566a607eb4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:17.711931 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d06a6-c68b-4f82-a35c-566a607eb4d8 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:17.712884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d06a6-c68b-4f82-a35c-566a607eb4d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:17.714837 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d06a6-c68b-4f82-a35c-566a607eb4d8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:17.773730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 50/105] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:34:17 2022] POST /identity/v3/projects => generated 302 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:34:17.775171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed3845-0ee9-4dca-8e9e-280a4fbdbe64 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:17.775521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed3845-0ee9-4dca-8e9e-280a4fbdbe64 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:17.775857 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed3845-0ee9-4dca-8e9e-280a4fbdbe64 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:17.777102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 51/106] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:17.785566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35558404-e9e4-4b29-80ff-22e1f76c7cde None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:17.785909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35558404-e9e4-4b29-80ff-22e1f76c7cde None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:17.786127 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35558404-e9e4-4b29-80ff-22e1f76c7cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:17.803614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95c8ef-a589-4e3d-a9fa-923dcdf403e8 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:17.822882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-35558404-e9e4-4b29-80ff-22e1f76c7cde None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:17.824530 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-35558404-e9e4-4b29-80ff-22e1f76c7cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:17.839537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a918-93b7-4ee2-96a4-540aa53a9d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:17.840340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a918-93b7-4ee2-96a4-540aa53a9d90 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:17.840626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a918-93b7-4ee2-96a4-540aa53a9d90 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:17.840906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a918-93b7-4ee2-96a4-540aa53a9d90 None admin] PATH_INFO: `/v3/users/7ea9f75d0a2c4542b66026d7c79fb660` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:17.860591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a918-93b7-4ee2-96a4-540aa53a9d90 None admin] RBAC: Authorizing `identity:get_user(user_id=7ea9f75d0a2c4542b66026d7c79fb660)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:17.862088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a918-93b7-4ee2-96a4-540aa53a9d90 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:17.863948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 56/107] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:17 2022] GET /identity/v3/users/7ea9f75d0a2c4542b66026d7c79fb660 => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:17.869948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a918-93b7-4ee2-96a4-540aa53a9d90 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:17.991348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 52/108] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:17.992978 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c66656-69da-43ba-a2d5-2aa2ec2d6f51 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:17.993271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c66656-69da-43ba-a2d5-2aa2ec2d6f51 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:17.993553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c66656-69da-43ba-a2d5-2aa2ec2d6f51 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:17.994943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 53/109] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:18.001110 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b722f1-12ab-427c-a2d0-031ee944c1d4 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:18.001415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b722f1-12ab-427c-a2d0-031ee944c1d4 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:18.001666 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b722f1-12ab-427c-a2d0-031ee944c1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:18.041727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b7b722f1-12ab-427c-a2d0-031ee944c1d4 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:18.042947 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b7b722f1-12ab-427c-a2d0-031ee944c1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:18.062279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a918-93b7-4ee2-96a4-540aa53a9d90 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:18.101013 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c43076-8829-414b-8f64-8554207c3e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:18.101867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c43076-8829-414b-8f64-8554207c3e43 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:18.102288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c43076-8829-414b-8f64-8554207c3e43 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:18.102690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c43076-8829-414b-8f64-8554207c3e43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:18.143362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 54/110] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:18.144636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b722f1-12ab-427c-a2d0-031ee944c1d4 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:18.203739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c43076-8829-414b-8f64-8554207c3e43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:18.206344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c43076-8829-414b-8f64-8554207c3e43 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:18.259119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b722f1-12ab-427c-a2d0-031ee944c1d4 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:18.313640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15be9d4-67d5-4a97-9195-ff2f3193116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:18.315336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15be9d4-67d5-4a97-9195-ff2f3193116c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:18.316064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15be9d4-67d5-4a97-9195-ff2f3193116c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:18.316497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15be9d4-67d5-4a97-9195-ff2f3193116c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:18.331174 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15be9d4-67d5-4a97-9195-ff2f3193116c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:18.338692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 57/111] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:34:18.339839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c43076-8829-414b-8f64-8554207c3e43 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-b15be9d4-67d5-4a97-9195-ff2f3193116c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:18.340926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:18.341787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:18.342553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 55/112] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:18.343699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd517b-7f5c-4ebc-aa77-0e95d0ed5591 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:18.344125 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd517b-7f5c-4ebc-aa77-0e95d0ed5591 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:18.344604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd517b-7f5c-4ebc-aa77-0e95d0ed5591 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:18.346257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 56/113] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:18.352344 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd517b-7f5c-4ebc-aa77-0e95d0ed5591 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:18.457090 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c43076-8829-414b-8f64-8554207c3e43 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:18.488706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd517b-7f5c-4ebc-aa77-0e95d0ed5591 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:18.492829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d977c-463b-46ca-9c78-493bf28eb6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:18.493829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d977c-463b-46ca-9c78-493bf28eb6b6 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:18.494226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d977c-463b-46ca-9c78-493bf28eb6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:18.494599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d977c-463b-46ca-9c78-493bf28eb6b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:18.505683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d977c-463b-46ca-9c78-493bf28eb6b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-f14d977c-463b-46ca-9c78-493bf28eb6b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:18.513617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:18.514664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:18.515695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:18.515695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:18.515695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:18.515695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:18.515695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:18.515695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:18.515695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:18.515695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:18.515695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:18.515695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:18.515695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:18.515695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:18.517737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 58/114] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:18.518372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d977c-463b-46ca-9c78-493bf28eb6b6 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:18.531363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be75db-df0d-4e35-958d-4c6c32c43427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:18.532700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be75db-df0d-4e35-958d-4c6c32c43427 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:18.533162 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be75db-df0d-4e35-958d-4c6c32c43427 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:18.533602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be75db-df0d-4e35-958d-4c6c32c43427 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:18.535472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be75db-df0d-4e35-958d-4c6c32c43427 None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:18.537491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be75db-df0d-4e35-958d-4c6c32c43427 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:18.539672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 57/115] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:18 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:18.540946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb71d92-87ec-4400-aee0-7b0e75e9efed None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:18.541801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb71d92-87ec-4400-aee0-7b0e75e9efed None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:18.542223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb71d92-87ec-4400-aee0-7b0e75e9efed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:18.561441 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-7eb71d92-87ec-4400-aee0-7b0e75e9efed None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:18.563446 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7eb71d92-87ec-4400-aee0-7b0e75e9efed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:18.631155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d977c-463b-46ca-9c78-493bf28eb6b6 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:18.637743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 58/116] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:18.644246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb71d92-87ec-4400-aee0-7b0e75e9efed None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:18.674619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ad3cc-af27-4eb2-9231-1453cc6c20ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:18.675322 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ad3cc-af27-4eb2-9231-1453cc6c20ef None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:18.675611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ad3cc-af27-4eb2-9231-1453cc6c20ef None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:18.675897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ad3cc-af27-4eb2-9231-1453cc6c20ef None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:18.676653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ad3cc-af27-4eb2-9231-1453cc6c20ef None admin] RBAC: Adding query filter params (name=member) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:18.676966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ad3cc-af27-4eb2-9231-1453cc6c20ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:18.678391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ad3cc-af27-4eb2-9231-1453cc6c20ef None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:18.687592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 59/117] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:18.688032 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ad3cc-af27-4eb2-9231-1453cc6c20ef None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:18.754336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb71d92-87ec-4400-aee0-7b0e75e9efed None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:18.784044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ad3cc-af27-4eb2-9231-1453cc6c20ef None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:18.787412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e99124-5e66-4fc8-a5b3-127ca228a4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:18.788085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99124-5e66-4fc8-a5b3-127ca228a4d3 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:18.788372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99124-5e66-4fc8-a5b3-127ca228a4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:18.788648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99124-5e66-4fc8-a5b3-127ca228a4d3 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:18.789392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e99124-5e66-4fc8-a5b3-127ca228a4d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:18.789697 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e99124-5e66-4fc8-a5b3-127ca228a4d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:18.791060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e99124-5e66-4fc8-a5b3-127ca228a4d3 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:18.807065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 59/118] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:18.807065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccc688-bac3-4579-a39f-228f087a066f None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:18.807065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccc688-bac3-4579-a39f-228f087a066f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:18.807065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccc688-bac3-4579-a39f-228f087a066f None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:18.807065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 60/119] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:18.807065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccc688-bac3-4579-a39f-228f087a066f None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:18.824640 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5a45-13f0-4a89-acb9-8ba7e33d1a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:18.825301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5a45-13f0-4a89-acb9-8ba7e33d1a7c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:18.825586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5a45-13f0-4a89-acb9-8ba7e33d1a7c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:18.825864 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f5a45-13f0-4a89-acb9-8ba7e33d1a7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:18.826693 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f5a45-13f0-4a89-acb9-8ba7e33d1a7c None admin] RBAC: Adding query filter params (role.id=dfdbef47aad347cb8de81878442e73f2, scope.project.id=8f60414b09e148d391f54308214c18a7, user.id=7ea9f75d0a2c4542b66026d7c79fb660) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:18.827005 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f5a45-13f0-4a89-acb9-8ba7e33d1a7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:18.829024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f5a45-13f0-4a89-acb9-8ba7e33d1a7c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:18.843703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 60/120] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:18 2022] GET /identity/v3/role_assignments?user.id=7ea9f75d0a2c4542b66026d7c79fb660&scope.project.id=8f60414b09e148d391f54308214c18a7&role.id=dfdbef47aad347cb8de81878442e73f2 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:18.843703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5a45-13f0-4a89-acb9-8ba7e33d1a7c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:18.924159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccc688-bac3-4579-a39f-228f087a066f None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:18.974623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c2aa8-9ef9-492e-bae5-369e2104160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:18.975822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c2aa8-9ef9-492e-bae5-369e2104160b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:18.976376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c2aa8-9ef9-492e-bae5-369e2104160b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:18.976659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c2aa8-9ef9-492e-bae5-369e2104160b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:18.978370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f5a45-13f0-4a89-acb9-8ba7e33d1a7c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:18.991039 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c2aa8-9ef9-492e-bae5-369e2104160b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-b81c2aa8-9ef9-492e-bae5-369e2104160b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:19.001370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:19.002918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 61/121] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:34:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:19.004194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c2aa8-9ef9-492e-bae5-369e2104160b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:19.018156 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e983f0-c0ac-4fdf-8507-7422cbe7d08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:19.019388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e983f0-c0ac-4fdf-8507-7422cbe7d08b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:19.019820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e983f0-c0ac-4fdf-8507-7422cbe7d08b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:19.020300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e983f0-c0ac-4fdf-8507-7422cbe7d08b None admin] PATH_INFO: `/v3/users/d7c7a65e48834491a829f72b9785f1ff` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:19.021830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e983f0-c0ac-4fdf-8507-7422cbe7d08b None admin] RBAC: Authorizing `identity:get_user(user_id=d7c7a65e48834491a829f72b9785f1ff)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:19.023538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e983f0-c0ac-4fdf-8507-7422cbe7d08b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:19.025771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 61/122] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:18 2022] GET /identity/v3/users/d7c7a65e48834491a829f72b9785f1ff => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:19.027311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595f785-ef90-4b3d-9fc0-08af469fc75d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:19.027830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595f785-ef90-4b3d-9fc0-08af469fc75d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:19.028411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595f785-ef90-4b3d-9fc0-08af469fc75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:19.046403 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f595f785-ef90-4b3d-9fc0-08af469fc75d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:19.047971 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f595f785-ef90-4b3d-9fc0-08af469fc75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:19.106838 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c2aa8-9ef9-492e-bae5-369e2104160b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:19.116285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 62/123] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:19.117767 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595f785-ef90-4b3d-9fc0-08af469fc75d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:19.141541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234a073-22ec-4d99-b3e0-c7c7453eca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:19.142652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234a073-22ec-4d99-b3e0-c7c7453eca6a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:19.143074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234a073-22ec-4d99-b3e0-c7c7453eca6a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:19.143590 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234a073-22ec-4d99-b3e0-c7c7453eca6a None admin] PATH_INFO: `/v3/users/d7c7a65e48834491a829f72b9785f1ff` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:19.145018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234a073-22ec-4d99-b3e0-c7c7453eca6a None admin] RBAC: Authorizing `identity:get_user(user_id=d7c7a65e48834491a829f72b9785f1ff)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:19.146643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234a073-22ec-4d99-b3e0-c7c7453eca6a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:19.148495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 62/124] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:19 2022] GET /identity/v3/users/d7c7a65e48834491a829f72b9785f1ff => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:19.149506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234a073-22ec-4d99-b3e0-c7c7453eca6a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:19.226557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595f785-ef90-4b3d-9fc0-08af469fc75d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:19.252238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234a073-22ec-4d99-b3e0-c7c7453eca6a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:19.261453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b13470-ddd3-493b-9a9c-1ca96d4af762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:19.262323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b13470-ddd3-493b-9a9c-1ca96d4af762 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:19.262754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b13470-ddd3-493b-9a9c-1ca96d4af762 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:19.263307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b13470-ddd3-493b-9a9c-1ca96d4af762 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:19.264260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b13470-ddd3-493b-9a9c-1ca96d4af762 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:19.264795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b13470-ddd3-493b-9a9c-1ca96d4af762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:19.266382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b13470-ddd3-493b-9a9c-1ca96d4af762 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:19.274704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 63/125] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:34:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:19.275809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b13470-ddd3-493b-9a9c-1ca96d4af762 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:19.285997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cd360-24e4-498e-bf7f-45110be907be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:19.287045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cd360-24e4-498e-bf7f-45110be907be None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:19.287507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cd360-24e4-498e-bf7f-45110be907be None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:19.287937 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cd360-24e4-498e-bf7f-45110be907be None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:19.289290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cd360-24e4-498e-bf7f-45110be907be None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:19.290900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cd360-24e4-498e-bf7f-45110be907be None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:19.292776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 63/126] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:19 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:19.293750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cd360-24e4-498e-bf7f-45110be907be None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:19.376004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b13470-ddd3-493b-9a9c-1ca96d4af762 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:19.393028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cd360-24e4-498e-bf7f-45110be907be None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:19.408877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb64edc-8119-4c7c-87bf-0881970a4a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:19.409849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64edc-8119-4c7c-87bf-0881970a4a87 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:19.410275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64edc-8119-4c7c-87bf-0881970a4a87 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:19.410718 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64edc-8119-4c7c-87bf-0881970a4a87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:19.420955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb64edc-8119-4c7c-87bf-0881970a4a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:19.426411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d404d5-de20-4d3f-ad73-d4014c929d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:19.427398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d404d5-de20-4d3f-ad73-d4014c929d48 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:19.427777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d404d5-de20-4d3f-ad73-d4014c929d48 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:19.428147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d404d5-de20-4d3f-ad73-d4014c929d48 None admin] PATH_INFO: `/v3/projects/57b599073e1b41578401d3163aa2f6f5` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:19.429412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d404d5-de20-4d3f-ad73-d4014c929d48 None admin] RBAC: Authorizing `identity:get_project(project_id=57b599073e1b41578401d3163aa2f6f5)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-6eb64edc-8119-4c7c-87bf-0881970a4a87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:19.430243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:19.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:19.431975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:19.431975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:19.431975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:19.431975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:19.431975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:19.431975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:19.431975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:19.431975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:19.431975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:19.431975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:19.431975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:19.431975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:19.432561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d404d5-de20-4d3f-ad73-d4014c929d48 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:19.433538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 64/127] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:19 2022] GET /identity/v3/projects/57b599073e1b41578401d3163aa2f6f5 => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:19.434557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d404d5-de20-4d3f-ad73-d4014c929d48 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:19.439865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 64/128] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:34:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:19.440657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb64edc-8119-4c7c-87bf-0881970a4a87 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:19.533038 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d404d5-de20-4d3f-ad73-d4014c929d48 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:19.539002 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb64edc-8119-4c7c-87bf-0881970a4a87 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:19.567408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb27b1-22f4-4f71-a61c-217ef1cef653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:19.568648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb27b1-22f4-4f71-a61c-217ef1cef653 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:19.569123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb27b1-22f4-4f71-a61c-217ef1cef653 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:19.569588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb27b1-22f4-4f71-a61c-217ef1cef653 None admin] PATH_INFO: `/v3/users/d7c7a65e48834491a829f72b9785f1ff` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:19.571258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb27b1-22f4-4f71-a61c-217ef1cef653 None admin] RBAC: Authorizing `identity:get_user(user_id=d7c7a65e48834491a829f72b9785f1ff)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:19.572888 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb27b1-22f4-4f71-a61c-217ef1cef653 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:19.573543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74df2b-ca27-40a7-829a-b71949bb0e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:19.574433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74df2b-ca27-40a7-829a-b71949bb0e67 None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:19.574718 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74df2b-ca27-40a7-829a-b71949bb0e67 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:19.574998 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74df2b-ca27-40a7-829a-b71949bb0e67 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7/users/d7c7a65e48834491a829f72b9785f1ff/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:19.575596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 65/129] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:19 2022] GET /identity/v3/users/d7c7a65e48834491a829f72b9785f1ff => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:19.576609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb27b1-22f4-4f71-a61c-217ef1cef653 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:19.577115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74df2b-ca27-40a7-829a-b71949bb0e67 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f60414b09e148d391f54308214c18a7, user_id=d7c7a65e48834491a829f72b9785f1ff, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:19.578605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74df2b-ca27-40a7-829a-b71949bb0e67 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:19.592922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 65/130] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:34:19 2022] PUT /identity/v3/projects/8f60414b09e148d391f54308214c18a7/users/d7c7a65e48834491a829f72b9785f1ff/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:34:19.594092 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74df2b-ca27-40a7-829a-b71949bb0e67 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:19.699805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74df2b-ca27-40a7-829a-b71949bb0e67 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:19.703513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb27b1-22f4-4f71-a61c-217ef1cef653 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:19.752614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef782582-9bc9-43fb-8457-4905dd4381dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:19.753527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef782582-9bc9-43fb-8457-4905dd4381dd None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:19.753816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef782582-9bc9-43fb-8457-4905dd4381dd None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:19.754098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef782582-9bc9-43fb-8457-4905dd4381dd None admin] PATH_INFO: `/v3/projects/57b599073e1b41578401d3163aa2f6f5/users/d7c7a65e48834491a829f72b9785f1ff/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:19.756905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af979b28-ff84-408d-a0ce-a935657b1b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:19.757818 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af979b28-ff84-408d-a0ce-a935657b1b9b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:19.758296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af979b28-ff84-408d-a0ce-a935657b1b9b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:19.758906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af979b28-ff84-408d-a0ce-a935657b1b9b None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:19.759976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af979b28-ff84-408d-a0ce-a935657b1b9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:19.760490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af979b28-ff84-408d-a0ce-a935657b1b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:19.762120 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af979b28-ff84-408d-a0ce-a935657b1b9b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:19.764177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef782582-9bc9-43fb-8457-4905dd4381dd None admin] RBAC: Authorizing `identity:create_grant(project_id=57b599073e1b41578401d3163aa2f6f5, user_id=d7c7a65e48834491a829f72b9785f1ff, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:19.765708 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef782582-9bc9-43fb-8457-4905dd4381dd None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:19.772317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 66/131] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:19.773704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af979b28-ff84-408d-a0ce-a935657b1b9b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:19.806974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 66/132] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:34:19 2022] PUT /identity/v3/projects/57b599073e1b41578401d3163aa2f6f5/users/d7c7a65e48834491a829f72b9785f1ff/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:34:19.807782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef782582-9bc9-43fb-8457-4905dd4381dd None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:19.888222 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af979b28-ff84-408d-a0ce-a935657b1b9b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:19.925339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2451f7a-3b28-498c-96ea-c8bd537fb653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:19.926584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2451f7a-3b28-498c-96ea-c8bd537fb653 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:19.927085 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2451f7a-3b28-498c-96ea-c8bd537fb653 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:19.927599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2451f7a-3b28-498c-96ea-c8bd537fb653 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:19.929112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2451f7a-3b28-498c-96ea-c8bd537fb653 None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:19.930889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2451f7a-3b28-498c-96ea-c8bd537fb653 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:19.933735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 67/133] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:19 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:19.940259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2451f7a-3b28-498c-96ea-c8bd537fb653 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:19.966397 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef782582-9bc9-43fb-8457-4905dd4381dd None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:20.006700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27e626-e3dc-41f2-9412-c86f6f2c363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:20.007633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27e626-e3dc-41f2-9412-c86f6f2c363c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:20.007976 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27e626-e3dc-41f2-9412-c86f6f2c363c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:20.008263 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27e626-e3dc-41f2-9412-c86f6f2c363c None admin] PATH_INFO: `/v3/users/9672a6cf62bd46598e30f140bf9a1184` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:20.009560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27e626-e3dc-41f2-9412-c86f6f2c363c None admin] RBAC: Authorizing `identity:get_user(user_id=9672a6cf62bd46598e30f140bf9a1184)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:20.011040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27e626-e3dc-41f2-9412-c86f6f2c363c None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:20.012987 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 67/134] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:19 2022] GET /identity/v3/users/9672a6cf62bd46598e30f140bf9a1184 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:20.018915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27e626-e3dc-41f2-9412-c86f6f2c363c None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:20.126546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27e626-e3dc-41f2-9412-c86f6f2c363c None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:20.163833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dad47-bda3-45ed-b324-1611b82d94dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:20.164715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dad47-bda3-45ed-b324-1611b82d94dc None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:20.165001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dad47-bda3-45ed-b324-1611b82d94dc None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:20.165282 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dad47-bda3-45ed-b324-1611b82d94dc None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:20.166508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dad47-bda3-45ed-b324-1611b82d94dc None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:20.168025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dad47-bda3-45ed-b324-1611b82d94dc None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:20.169871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 68/135] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:20 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:20.175701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dad47-bda3-45ed-b324-1611b82d94dc None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:20.197393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2451f7a-3b28-498c-96ea-c8bd537fb653 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:20.281231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dad47-bda3-45ed-b324-1611b82d94dc None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:20.288450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c10759-258b-49fb-b91a-5eabbd6b5385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:20.289366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c10759-258b-49fb-b91a-5eabbd6b5385 None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:20.289768 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c10759-258b-49fb-b91a-5eabbd6b5385 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:20.289934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c10759-258b-49fb-b91a-5eabbd6b5385 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7/users/d7c7a65e48834491a829f72b9785f1ff/roles/142e36ee06a7422e8e8d32a1080ea89a` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:20.300106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c10759-258b-49fb-b91a-5eabbd6b5385 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f60414b09e148d391f54308214c18a7, user_id=d7c7a65e48834491a829f72b9785f1ff, role_id=142e36ee06a7422e8e8d32a1080ea89a)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:20.301618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c10759-258b-49fb-b91a-5eabbd6b5385 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:20.321568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77853b3-5440-4082-bcb6-40cc0ca534ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:20.322484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77853b3-5440-4082-bcb6-40cc0ca534ba None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:20.322769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77853b3-5440-4082-bcb6-40cc0ca534ba None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:20.323047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77853b3-5440-4082-bcb6-40cc0ca534ba None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7/users/9672a6cf62bd46598e30f140bf9a1184/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:20.329294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77853b3-5440-4082-bcb6-40cc0ca534ba None admin] RBAC: Authorizing `identity:create_grant(project_id=8f60414b09e148d391f54308214c18a7, user_id=9672a6cf62bd46598e30f140bf9a1184, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:20.330878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77853b3-5440-4082-bcb6-40cc0ca534ba None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:20.341458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 68/136] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:34:19 2022] PUT /identity/v3/projects/8f60414b09e148d391f54308214c18a7/users/d7c7a65e48834491a829f72b9785f1ff/roles/142e36ee06a7422e8e8d32a1080ea89a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:34:20.347036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 69/137] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:34:20 2022] PUT /identity/v3/projects/8f60414b09e148d391f54308214c18a7/users/9672a6cf62bd46598e30f140bf9a1184/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:34:20.574765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f8fd-35ab-4518-bce7-24be52fd8a3c None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:20.575153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f8fd-35ab-4518-bce7-24be52fd8a3c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:20.575367 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385f8fd-35ab-4518-bce7-24be52fd8a3c None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:20.576757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 69/138] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:20.585896 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214df651-858a-4f72-b63e-2d6e4abe1264 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:20.586190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214df651-858a-4f72-b63e-2d6e4abe1264 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:20.586475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214df651-858a-4f72-b63e-2d6e4abe1264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:20.609852 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-214df651-858a-4f72-b63e-2d6e4abe1264 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:20.611412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-214df651-858a-4f72-b63e-2d6e4abe1264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:20.697017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 70/139] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:20.722705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f8fd-35ab-4518-bce7-24be52fd8a3c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:20.851181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385f8fd-35ab-4518-bce7-24be52fd8a3c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:20.889749 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fa177-8e4c-47c6-8a73-54c3f8755cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:20.890609 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fa177-8e4c-47c6-8a73-54c3f8755cc9 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:20.890894 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fa177-8e4c-47c6-8a73-54c3f8755cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:20.891229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fa177-8e4c-47c6-8a73-54c3f8755cc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:20.893683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fa177-8e4c-47c6-8a73-54c3f8755cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:20.895262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fa177-8e4c-47c6-8a73-54c3f8755cc9 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:20.896896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 70/140] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:20.902794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214df651-858a-4f72-b63e-2d6e4abe1264 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:21.034904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214df651-858a-4f72-b63e-2d6e4abe1264 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:21.078909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb28429-dd66-4f0e-929a-c04f5137dd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:21.079621 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb28429-dd66-4f0e-929a-c04f5137dd09 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:21.079907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb28429-dd66-4f0e-929a-c04f5137dd09 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:21.080186 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb28429-dd66-4f0e-929a-c04f5137dd09 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:21.080900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb28429-dd66-4f0e-929a-c04f5137dd09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:21.082352 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb28429-dd66-4f0e-929a-c04f5137dd09 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:21.118187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 71/141] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:34:20 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:34:22.132747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af7104-62c4-478c-aedd-9c4789cde8c7 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:22.133278 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af7104-62c4-478c-aedd-9c4789cde8c7 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:22.133361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af7104-62c4-478c-aedd-9c4789cde8c7 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:22.134987 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 71/142] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:22.141115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6281754-1ab7-45e2-9a06-6517d910efae None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:22.141952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6281754-1ab7-45e2-9a06-6517d910efae None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:22.142424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6281754-1ab7-45e2-9a06-6517d910efae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:22.160942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d6281754-1ab7-45e2-9a06-6517d910efae None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:22.162574 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d6281754-1ab7-45e2-9a06-6517d910efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:22.235547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 72/143] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:22.258869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af7104-62c4-478c-aedd-9c4789cde8c7 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:22.392964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af7104-62c4-478c-aedd-9c4789cde8c7 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:22.426516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcdd26-3384-4e65-a71e-03bdf4d0115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:22.427684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcdd26-3384-4e65-a71e-03bdf4d0115b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:22.428178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcdd26-3384-4e65-a71e-03bdf4d0115b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:22.428663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcdd26-3384-4e65-a71e-03bdf4d0115b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:22.445606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcdd26-3384-4e65-a71e-03bdf4d0115b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-bbdcdd26-3384-4e65-a71e-03bdf4d0115b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:22.453594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:22.454472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:22.455264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:22.455264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:22.455264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:22.455264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:22.455264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:22.455264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:22.455264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:22.455264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:22.455264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:22.455264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:22.455264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:22.455264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:22.457603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 72/144] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:22.463748 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6281754-1ab7-45e2-9a06-6517d910efae None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:22.571385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6281754-1ab7-45e2-9a06-6517d910efae None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:22.605696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15ce94-e5c9-4ceb-9357-c6d014c8a068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:22.606659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15ce94-e5c9-4ceb-9357-c6d014c8a068 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:22.607114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15ce94-e5c9-4ceb-9357-c6d014c8a068 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:22.607624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15ce94-e5c9-4ceb-9357-c6d014c8a068 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:22.609100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15ce94-e5c9-4ceb-9357-c6d014c8a068 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:22.609576 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15ce94-e5c9-4ceb-9357-c6d014c8a068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:22.611113 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15ce94-e5c9-4ceb-9357-c6d014c8a068 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:22.620366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 73/145] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:22.627763 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcdd26-3384-4e65-a71e-03bdf4d0115b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:22.731595 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcdd26-3384-4e65-a71e-03bdf4d0115b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:22.768393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1238f2-f71c-498c-a50d-fc8825e22b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:22.769574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1238f2-f71c-498c-a50d-fc8825e22b31 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:22.770040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1238f2-f71c-498c-a50d-fc8825e22b31 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:22.770507 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1238f2-f71c-498c-a50d-fc8825e22b31 None admin] PATH_INFO: `/v3/users/7ea9f75d0a2c4542b66026d7c79fb660` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:22.773428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1238f2-f71c-498c-a50d-fc8825e22b31 None admin] RBAC: Authorizing `identity:get_user(user_id=7ea9f75d0a2c4542b66026d7c79fb660)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:22.775126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1238f2-f71c-498c-a50d-fc8825e22b31 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:22.777014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 73/146] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:22 2022] GET /identity/v3/users/7ea9f75d0a2c4542b66026d7c79fb660 => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:22.783301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15ce94-e5c9-4ceb-9357-c6d014c8a068 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:22.894012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15ce94-e5c9-4ceb-9357-c6d014c8a068 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:22.934814 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b4629-0044-468d-bed8-ac8a3d725f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:22.936065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b4629-0044-468d-bed8-ac8a3d725f90 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:22.936586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b4629-0044-468d-bed8-ac8a3d725f90 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:22.937045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b4629-0044-468d-bed8-ac8a3d725f90 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:22.938689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b4629-0044-468d-bed8-ac8a3d725f90 None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:22.940413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b4629-0044-468d-bed8-ac8a3d725f90 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:22.943649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 74/147] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:22 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:22.948755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1238f2-f71c-498c-a50d-fc8825e22b31 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:23.051687 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1238f2-f71c-498c-a50d-fc8825e22b31 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:23.087834 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdadc56-eab3-4a80-b104-b008352afc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:23.089140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdadc56-eab3-4a80-b104-b008352afc2f None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:23.089596 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdadc56-eab3-4a80-b104-b008352afc2f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:23.090062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdadc56-eab3-4a80-b104-b008352afc2f None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7/users/7ea9f75d0a2c4542b66026d7c79fb660/roles/dfdbef47aad347cb8de81878442e73f2` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:23.096037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdadc56-eab3-4a80-b104-b008352afc2f None admin] RBAC: Authorizing `identity:create_grant(project_id=8f60414b09e148d391f54308214c18a7, user_id=7ea9f75d0a2c4542b66026d7c79fb660, role_id=dfdbef47aad347cb8de81878442e73f2)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:23.097780 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdadc56-eab3-4a80-b104-b008352afc2f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:23.122976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 74/148] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:34:22 2022] PUT /identity/v3/projects/8f60414b09e148d391f54308214c18a7/users/7ea9f75d0a2c4542b66026d7c79fb660/roles/dfdbef47aad347cb8de81878442e73f2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:34:23.337798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a305c81-df26-445f-9854-72a62f33d385 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:23.338779 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a305c81-df26-445f-9854-72a62f33d385 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:23.339306 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a305c81-df26-445f-9854-72a62f33d385 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:23.340886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 75/149] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:23.346839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d9193-1699-47eb-b028-381cbd60336a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:23.347731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d9193-1699-47eb-b028-381cbd60336a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:23.348264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d9193-1699-47eb-b028-381cbd60336a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:23.372466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-a96d9193-1699-47eb-b028-381cbd60336a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:23.374668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a96d9193-1699-47eb-b028-381cbd60336a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:23.458507 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 75/150] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:23.493178 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a305c81-df26-445f-9854-72a62f33d385 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:23.586918 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a60d5-6ccc-4fcd-87e0-d04f0ffee595 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:23.587272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a60d5-6ccc-4fcd-87e0-d04f0ffee595 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:23.587481 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a60d5-6ccc-4fcd-87e0-d04f0ffee595 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:23.589119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 76/151] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:23.596564 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e1795-8717-4f7c-a56e-71b7e95f7ae4 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:23.596854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e1795-8717-4f7c-a56e-71b7e95f7ae4 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:23.597143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e1795-8717-4f7c-a56e-71b7e95f7ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:23.615887 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a305c81-df26-445f-9854-72a62f33d385 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:23.630828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-140e1795-8717-4f7c-a56e-71b7e95f7ae4 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:23.632109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-140e1795-8717-4f7c-a56e-71b7e95f7ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:23.658287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93b938-79e6-4bc4-a931-f742a5136037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:23.659491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93b938-79e6-4bc4-a931-f742a5136037 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:23.659979 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93b938-79e6-4bc4-a931-f742a5136037 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:23.660492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93b938-79e6-4bc4-a931-f742a5136037 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:23.672086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93b938-79e6-4bc4-a931-f742a5136037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-bf93b938-79e6-4bc4-a931-f742a5136037 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:23.680633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:23.681503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:23.682309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:23.682309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:23.682309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:23.682309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:23.682309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:23.682309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:23.682309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:23.682309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:23.682309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:23.682309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:23.682309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:23.682309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:23.684760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 76/152] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:23.692094 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93b938-79e6-4bc4-a931-f742a5136037 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:23.773149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 77/153] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:23.774515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06769b2e-6a90-4165-a14f-3ae9e3261935 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:23.774813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06769b2e-6a90-4165-a14f-3ae9e3261935 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:23.775093 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06769b2e-6a90-4165-a14f-3ae9e3261935 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:23.776986 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 78/154] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:23.781560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f69b81-bd86-4462-b179-3f8115c7271b None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:23.781859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f69b81-bd86-4462-b179-3f8115c7271b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:23.782135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f69b81-bd86-4462-b179-3f8115c7271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:23.816257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-d9f69b81-bd86-4462-b179-3f8115c7271b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:23.817479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d9f69b81-bd86-4462-b179-3f8115c7271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:23.818649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93b938-79e6-4bc4-a931-f742a5136037 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:23.867168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be62a70-a5b7-4f7d-8f83-df543989c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:23.868363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be62a70-a5b7-4f7d-8f83-df543989c466 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:23.869597 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be62a70-a5b7-4f7d-8f83-df543989c466 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:23.870096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be62a70-a5b7-4f7d-8f83-df543989c466 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:23.871861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be62a70-a5b7-4f7d-8f83-df543989c466 None admin] RBAC: Adding query filter params (name=member) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:23.873895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be62a70-a5b7-4f7d-8f83-df543989c466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:23.877050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be62a70-a5b7-4f7d-8f83-df543989c466 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:23.894979 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 77/155] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:23.896442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be62a70-a5b7-4f7d-8f83-df543989c466 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:23.951837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 79/156] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:23.957020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f69b81-bd86-4462-b179-3f8115c7271b None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:24.117083 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be62a70-a5b7-4f7d-8f83-df543989c466 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:24.166069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f69b81-bd86-4462-b179-3f8115c7271b None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:24.194233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c81d9-b32c-46df-907e-7531990fbd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:24.195689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c81d9-b32c-46df-907e-7531990fbd6e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:24.196229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c81d9-b32c-46df-907e-7531990fbd6e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:24.197443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c81d9-b32c-46df-907e-7531990fbd6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:24.215122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c81d9-b32c-46df-907e-7531990fbd6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-1d3c81d9-b32c-46df-907e-7531990fbd6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:24.226233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:24.227106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:24.228383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:24.228383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:24.228383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:24.228383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:24.228383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:24.228383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:24.228383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:24.228383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:24.228383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:24.228383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:24.228383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:24.228383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:24.235907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 78/157] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:24.243134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c81d9-b32c-46df-907e-7531990fbd6e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:24.243996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978c040-076f-496c-aae3-8e7ccf6af2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:24.245122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978c040-076f-496c-aae3-8e7ccf6af2f4 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:24.245625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978c040-076f-496c-aae3-8e7ccf6af2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:24.246096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978c040-076f-496c-aae3-8e7ccf6af2f4 None admin] PATH_INFO: `/v3/users/d7c7a65e48834491a829f72b9785f1ff` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:24.247854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978c040-076f-496c-aae3-8e7ccf6af2f4 None admin] RBAC: Authorizing `identity:get_user(user_id=d7c7a65e48834491a829f72b9785f1ff)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:24.249574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978c040-076f-496c-aae3-8e7ccf6af2f4 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:24.251840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 80/158] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:23 2022] GET /identity/v3/users/d7c7a65e48834491a829f72b9785f1ff => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:24.256909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9018-6c63-422e-ac6c-c4b7900f1e8c None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:24.257455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9018-6c63-422e-ac6c-c4b7900f1e8c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:24.262223 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e9018-6c63-422e-ac6c-c4b7900f1e8c None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:24.263840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 81/159] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:24.264888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9018-6c63-422e-ac6c-c4b7900f1e8c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:24.442908 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e9018-6c63-422e-ac6c-c4b7900f1e8c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:24.497337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c81d9-b32c-46df-907e-7531990fbd6e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:24.506054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baca9b4-661b-498c-acd3-3bb7354dbe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:24.506715 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baca9b4-661b-498c-acd3-3bb7354dbe92 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:24.507004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baca9b4-661b-498c-acd3-3bb7354dbe92 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:24.507305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baca9b4-661b-498c-acd3-3bb7354dbe92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:24.588026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fea1bc-e49a-4135-b703-cc88efa8a9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:24.588848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fea1bc-e49a-4135-b703-cc88efa8a9d9 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:24.589132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fea1bc-e49a-4135-b703-cc88efa8a9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:24.589408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fea1bc-e49a-4135-b703-cc88efa8a9d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:24.612892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baca9b4-661b-498c-acd3-3bb7354dbe92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:24.619234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baca9b4-661b-498c-acd3-3bb7354dbe92 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:24.620138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fea1bc-e49a-4135-b703-cc88efa8a9d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-83fea1bc-e49a-4135-b703-cc88efa8a9d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:24.636360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:24.637257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 79/160] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:34:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:24.638784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fea1bc-e49a-4135-b703-cc88efa8a9d9 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:24.761339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 82/161] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:24.763269 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333918-783d-4138-85d0-f8e8a3891807 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:24.763794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333918-783d-4138-85d0-f8e8a3891807 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:24.764270 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333918-783d-4138-85d0-f8e8a3891807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:24.792381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-de333918-783d-4138-85d0-f8e8a3891807 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:24.793980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-de333918-783d-4138-85d0-f8e8a3891807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:24.860189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fea1bc-e49a-4135-b703-cc88efa8a9d9 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:24.888027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 83/162] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:24.889263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de333918-783d-4138-85d0-f8e8a3891807 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:24.912726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a5148-3d43-4d0b-a063-3ede6b1208b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:24.913303 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a5148-3d43-4d0b-a063-3ede6b1208b9 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:24.913595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a5148-3d43-4d0b-a063-3ede6b1208b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:24.913877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a5148-3d43-4d0b-a063-3ede6b1208b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:24.914649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a5148-3d43-4d0b-a063-3ede6b1208b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:24.914943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a5148-3d43-4d0b-a063-3ede6b1208b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:24.916383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a5148-3d43-4d0b-a063-3ede6b1208b9 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:24.930537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 80/163] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:24.931670 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a5148-3d43-4d0b-a063-3ede6b1208b9 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:25.031323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de333918-783d-4138-85d0-f8e8a3891807 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:25.031518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a5148-3d43-4d0b-a063-3ede6b1208b9 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:25.067253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16962002-48af-4da5-bf2d-161ce5b4099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:25.067253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16962002-48af-4da5-bf2d-161ce5b4099e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:25.067253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16962002-48af-4da5-bf2d-161ce5b4099e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:25.067253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16962002-48af-4da5-bf2d-161ce5b4099e None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:25.067832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16962002-48af-4da5-bf2d-161ce5b4099e None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:25.069154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16962002-48af-4da5-bf2d-161ce5b4099e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:25.071109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 81/164] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:24 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:25.072163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16962002-48af-4da5-bf2d-161ce5b4099e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:25.073453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccc6ae-3aec-416b-883c-5a1c6886963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:25.074121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccc6ae-3aec-416b-883c-5a1c6886963c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:25.074397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccc6ae-3aec-416b-883c-5a1c6886963c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:25.074666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccc6ae-3aec-416b-883c-5a1c6886963c None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:25.075450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccc6ae-3aec-416b-883c-5a1c6886963c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:25.075754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccc6ae-3aec-416b-883c-5a1c6886963c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:25.077169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccc6ae-3aec-416b-883c-5a1c6886963c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:25.100697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 84/165] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:25.101949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccc6ae-3aec-416b-883c-5a1c6886963c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:25.209137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16962002-48af-4da5-bf2d-161ce5b4099e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:25.247362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10cb07-4cc4-4dab-9ac3-c5de7b48195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:25.247362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10cb07-4cc4-4dab-9ac3-c5de7b48195a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:25.247362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10cb07-4cc4-4dab-9ac3-c5de7b48195a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:25.247362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10cb07-4cc4-4dab-9ac3-c5de7b48195a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:25.255024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10cb07-4cc4-4dab-9ac3-c5de7b48195a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-7c10cb07-4cc4-4dab-9ac3-c5de7b48195a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:25.263153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:25.264180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 82/166] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:34:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:25.265981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10cb07-4cc4-4dab-9ac3-c5de7b48195a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:25.286287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccc6ae-3aec-416b-883c-5a1c6886963c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:25.328102 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e092851-c53b-4967-8520-54e971f65ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:25.329341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e092851-c53b-4967-8520-54e971f65ba1 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:25.329849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e092851-c53b-4967-8520-54e971f65ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:25.330343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e092851-c53b-4967-8520-54e971f65ba1 None admin] PATH_INFO: `/v3/users/d7c7a65e48834491a829f72b9785f1ff` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:25.331907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e092851-c53b-4967-8520-54e971f65ba1 None admin] RBAC: Authorizing `identity:get_user(user_id=d7c7a65e48834491a829f72b9785f1ff)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:25.333664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e092851-c53b-4967-8520-54e971f65ba1 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:25.335634 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 85/167] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:25 2022] GET /identity/v3/users/d7c7a65e48834491a829f72b9785f1ff => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:25.340260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e092851-c53b-4967-8520-54e971f65ba1 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:25.372493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10cb07-4cc4-4dab-9ac3-c5de7b48195a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:25.407928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1da3-4e58-45c5-839a-0d5d66123f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:25.409164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1da3-4e58-45c5-839a-0d5d66123f30 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:25.409164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1da3-4e58-45c5-839a-0d5d66123f30 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:25.409164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1da3-4e58-45c5-839a-0d5d66123f30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:25.415415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb1da3-4e58-45c5-839a-0d5d66123f30 None admin] RBAC: Adding query filter params (role.id=2f5b0d90f1814fe8a58210b5cd048bf7, scope.project.id=8f60414b09e148d391f54308214c18a7, user.id=d7c7a65e48834491a829f72b9785f1ff) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:25.415415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb1da3-4e58-45c5-839a-0d5d66123f30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:25.415415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb1da3-4e58-45c5-839a-0d5d66123f30 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:25.420287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 83/168] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:25 2022] GET /identity/v3/role_assignments?user.id=d7c7a65e48834491a829f72b9785f1ff&scope.project.id=8f60414b09e148d391f54308214c18a7&role.id=2f5b0d90f1814fe8a58210b5cd048bf7 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:25.421170 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1da3-4e58-45c5-839a-0d5d66123f30 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:25.481837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e092851-c53b-4967-8520-54e971f65ba1 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:25.540075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf72a77-5f99-412c-b8bd-867512464046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:25.541334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf72a77-5f99-412c-b8bd-867512464046 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:25.541826 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf72a77-5f99-412c-b8bd-867512464046 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:25.542316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf72a77-5f99-412c-b8bd-867512464046 None admin] PATH_INFO: `/v3/users/9672a6cf62bd46598e30f140bf9a1184` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:25.542489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1da3-4e58-45c5-839a-0d5d66123f30 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:25.544517 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf72a77-5f99-412c-b8bd-867512464046 None admin] RBAC: Authorizing `identity:get_user(user_id=9672a6cf62bd46598e30f140bf9a1184)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:25.546373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf72a77-5f99-412c-b8bd-867512464046 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:25.548304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 86/169] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:25 2022] GET /identity/v3/users/9672a6cf62bd46598e30f140bf9a1184 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:25.551856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf72a77-5f99-412c-b8bd-867512464046 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:25.584141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a88fc-85f6-49a5-849c-0a9f5a3e4ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:25.584824 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a88fc-85f6-49a5-849c-0a9f5a3e4ca8 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:25.585107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a88fc-85f6-49a5-849c-0a9f5a3e4ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:25.585384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a88fc-85f6-49a5-849c-0a9f5a3e4ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:25.586472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a88fc-85f6-49a5-849c-0a9f5a3e4ca8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:25.586472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a88fc-85f6-49a5-849c-0a9f5a3e4ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:25.587931 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a88fc-85f6-49a5-849c-0a9f5a3e4ca8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:25.597201 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 84/170] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:34:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:25.597838 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a88fc-85f6-49a5-849c-0a9f5a3e4ca8 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:25.670020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf72a77-5f99-412c-b8bd-867512464046 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:25.706843 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20596f3-ef78-44da-8647-db6c10b5bf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:25.707907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20596f3-ef78-44da-8647-db6c10b5bf60 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:25.708394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20596f3-ef78-44da-8647-db6c10b5bf60 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:25.708902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20596f3-ef78-44da-8647-db6c10b5bf60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:25.710346 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a88fc-85f6-49a5-849c-0a9f5a3e4ca8 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:25.765412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6aa62d-c231-46f5-a401-0076a0972c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:25.766080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aa62d-c231-46f5-a401-0076a0972c75 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:25.766363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aa62d-c231-46f5-a401-0076a0972c75 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:25.766638 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aa62d-c231-46f5-a401-0076a0972c75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:25.782495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20596f3-ef78-44da-8647-db6c10b5bf60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:25.784385 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20596f3-ef78-44da-8647-db6c10b5bf60 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:25.866727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6aa62d-c231-46f5-a401-0076a0972c75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:25.869302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6aa62d-c231-46f5-a401-0076a0972c75 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:25.905779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 87/171] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:25.907660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20596f3-ef78-44da-8647-db6c10b5bf60 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:25.979197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 85/172] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:25.980067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6aa62d-c231-46f5-a401-0076a0972c75 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:26.011289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20596f3-ef78-44da-8647-db6c10b5bf60 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:26.047178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd547a0-560e-414f-b224-5af356e87fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:26.048442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd547a0-560e-414f-b224-5af356e87fb6 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:26.048942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd547a0-560e-414f-b224-5af356e87fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:26.049446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd547a0-560e-414f-b224-5af356e87fb6 None admin] PATH_INFO: `/v3/users/d7c7a65e48834491a829f72b9785f1ff` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:26.050868 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd547a0-560e-414f-b224-5af356e87fb6 None admin] RBAC: Authorizing `identity:get_user(user_id=d7c7a65e48834491a829f72b9785f1ff)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:26.052806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd547a0-560e-414f-b224-5af356e87fb6 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:26.054770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 88/173] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:25 2022] GET /identity/v3/users/d7c7a65e48834491a829f72b9785f1ff => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:26.055902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd547a0-560e-414f-b224-5af356e87fb6 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:26.085120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6aa62d-c231-46f5-a401-0076a0972c75 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:26.119588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb3a36-de55-441c-b619-47a44474d50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:26.120377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb3a36-de55-441c-b619-47a44474d50f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:26.120656 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb3a36-de55-441c-b619-47a44474d50f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:26.120930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb3a36-de55-441c-b619-47a44474d50f None admin] PATH_INFO: `/v3/projects/57b599073e1b41578401d3163aa2f6f5` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:26.122124 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb3a36-de55-441c-b619-47a44474d50f None admin] RBAC: Authorizing `identity:get_project(project_id=57b599073e1b41578401d3163aa2f6f5)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:26.123698 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb3a36-de55-441c-b619-47a44474d50f None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:26.125357 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 86/174] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:25 2022] GET /identity/v3/projects/57b599073e1b41578401d3163aa2f6f5 => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:26.126105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb3a36-de55-441c-b619-47a44474d50f None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:26.163037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd547a0-560e-414f-b224-5af356e87fb6 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:26.198997 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06654b-adf8-40af-b153-d13564346c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:26.200319 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06654b-adf8-40af-b153-d13564346c42 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:26.200827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06654b-adf8-40af-b153-d13564346c42 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:26.201326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06654b-adf8-40af-b153-d13564346c42 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:26.203342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06654b-adf8-40af-b153-d13564346c42 None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:26.205147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06654b-adf8-40af-b153-d13564346c42 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:26.207297 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 89/175] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:26 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:26.208469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06654b-adf8-40af-b153-d13564346c42 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:26.229547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb3a36-de55-441c-b619-47a44474d50f None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:26.264224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40149f71-7cae-4be0-b4ba-66f4868cc52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:26.265417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149f71-7cae-4be0-b4ba-66f4868cc52f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:26.265701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149f71-7cae-4be0-b4ba-66f4868cc52f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:26.265974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149f71-7cae-4be0-b4ba-66f4868cc52f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:26.334191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06654b-adf8-40af-b153-d13564346c42 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:26.347547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40149f71-7cae-4be0-b4ba-66f4868cc52f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:26.349407 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40149f71-7cae-4be0-b4ba-66f4868cc52f None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:26.407988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ee730-3d5c-4358-b96f-a01abbc5fc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:26.409014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee730-3d5c-4358-b96f-a01abbc5fc6b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:26.409531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee730-3d5c-4358-b96f-a01abbc5fc6b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:26.410007 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ee730-3d5c-4358-b96f-a01abbc5fc6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:26.411056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ee730-3d5c-4358-b96f-a01abbc5fc6b None admin] RBAC: Adding query filter params (role.id=2f5b0d90f1814fe8a58210b5cd048bf7, scope.project.id=57b599073e1b41578401d3163aa2f6f5, user.id=d7c7a65e48834491a829f72b9785f1ff) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:26.411617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ee730-3d5c-4358-b96f-a01abbc5fc6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:26.413292 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ee730-3d5c-4358-b96f-a01abbc5fc6b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:26.429383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 90/176] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:26 2022] GET /identity/v3/role_assignments?user.id=d7c7a65e48834491a829f72b9785f1ff&scope.project.id=57b599073e1b41578401d3163aa2f6f5&role.id=2f5b0d90f1814fe8a58210b5cd048bf7 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:26.430638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ee730-3d5c-4358-b96f-a01abbc5fc6b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:26.462963 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 87/177] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:26.469035 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40149f71-7cae-4be0-b4ba-66f4868cc52f None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:26.602568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40149f71-7cae-4be0-b4ba-66f4868cc52f None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:26.643064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefc89b-c2c0-4922-8f92-4faa16e404af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:26.644211 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefc89b-c2c0-4922-8f92-4faa16e404af None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:26.644495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefc89b-c2c0-4922-8f92-4faa16e404af None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:26.644771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefc89b-c2c0-4922-8f92-4faa16e404af None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:26.646238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefc89b-c2c0-4922-8f92-4faa16e404af None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:26.648153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefc89b-c2c0-4922-8f92-4faa16e404af None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:26.649993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 88/178] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:26 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:26.656137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefc89b-c2c0-4922-8f92-4faa16e404af None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:26.682967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ee730-3d5c-4358-b96f-a01abbc5fc6b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:26.763746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ec068-bf5f-4e04-87ed-ae2a10028165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:26.764785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ec068-bf5f-4e04-87ed-ae2a10028165 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:26.765317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ec068-bf5f-4e04-87ed-ae2a10028165 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:26.765769 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ec068-bf5f-4e04-87ed-ae2a10028165 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:26.766795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ec068-bf5f-4e04-87ed-ae2a10028165 None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=8f60414b09e148d391f54308214c18a7, user.id=9672a6cf62bd46598e30f140bf9a1184) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:26.768767 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ec068-bf5f-4e04-87ed-ae2a10028165 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:26.770425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ec068-bf5f-4e04-87ed-ae2a10028165 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:26.784040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 91/179] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:26 2022] GET /identity/v3/role_assignments?user.id=9672a6cf62bd46598e30f140bf9a1184&scope.project.id=8f60414b09e148d391f54308214c18a7&role.id=70e67f35994843ae942d4f1703d5619e => generated 608 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:26.840306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b372d-ae61-41f0-bd42-1eb6b9251e4a None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:26.840600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b372d-ae61-41f0-bd42-1eb6b9251e4a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:26.841033 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b372d-ae61-41f0-bd42-1eb6b9251e4a None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:26.842851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 92/180] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:34:26.849633 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38367f-fd0b-40c6-9598-4f67ecd6b9ea None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:26.850156 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38367f-fd0b-40c6-9598-4f67ecd6b9ea None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:26.850512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38367f-fd0b-40c6-9598-4f67ecd6b9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:26.869450 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefc89b-c2c0-4922-8f92-4faa16e404af None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:26.875235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-cd38367f-fd0b-40c6-9598-4f67ecd6b9ea None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:26.875235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cd38367f-fd0b-40c6-9598-4f67ecd6b9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:26.952733 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 93/181] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:26.956191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41c117-d5cb-4c8e-a5c9-80bafa3df304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:26.957109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41c117-d5cb-4c8e-a5c9-80bafa3df304 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:26.957543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41c117-d5cb-4c8e-a5c9-80bafa3df304 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:26.957964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41c117-d5cb-4c8e-a5c9-80bafa3df304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:26.958965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41c117-d5cb-4c8e-a5c9-80bafa3df304 None admin] RBAC: Adding query filter params (role.id=142e36ee06a7422e8e8d32a1080ea89a, scope.project.id=8f60414b09e148d391f54308214c18a7, user.id=d7c7a65e48834491a829f72b9785f1ff) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:26.959465 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41c117-d5cb-4c8e-a5c9-80bafa3df304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:26.961080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41c117-d5cb-4c8e-a5c9-80bafa3df304 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:26.973565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db18d6-6a8f-457a-b8c4-73eb83dd6afe None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:26.973761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db18d6-6a8f-457a-b8c4-73eb83dd6afe None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:26.973993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db18d6-6a8f-457a-b8c4-73eb83dd6afe None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:26.975388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 94/182] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:34:26.979569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 89/183] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:26 2022] GET /identity/v3/role_assignments?user.id=d7c7a65e48834491a829f72b9785f1ff&scope.project.id=8f60414b09e148d391f54308214c18a7&role.id=142e36ee06a7422e8e8d32a1080ea89a => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:27.009285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af50e98-9e92-45c0-b411-4a70281fc12e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:27.009631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af50e98-9e92-45c0-b411-4a70281fc12e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:27.009851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af50e98-9e92-45c0-b411-4a70281fc12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:27.012349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41c117-d5cb-4c8e-a5c9-80bafa3df304 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:27.057509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-1af50e98-9e92-45c0-b411-4a70281fc12e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:27.058716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1af50e98-9e92-45c0-b411-4a70281fc12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:27.197460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41c117-d5cb-4c8e-a5c9-80bafa3df304 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:27.218195 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 95/184] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:27.220165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4422cb3-a7b0-4cab-91a4-9b4c8fa8bdc5 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:27.220692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4422cb3-a7b0-4cab-91a4-9b4c8fa8bdc5 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:27.221180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4422cb3-a7b0-4cab-91a4-9b4c8fa8bdc5 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:27.222695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 96/185] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:27.228392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34937d81-58d3-4087-b6d9-27751cdfb681 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:27.228969 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34937d81-58d3-4087-b6d9-27751cdfb681 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:27.229474 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34937d81-58d3-4087-b6d9-27751cdfb681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:27.249744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-34937d81-58d3-4087-b6d9-27751cdfb681 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:27.254355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-34937d81-58d3-4087-b6d9-27751cdfb681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:27.262753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1f52c-a0b8-4c11-9e18-474d07c9f2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:27.263600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1f52c-a0b8-4c11-9e18-474d07c9f2e1 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:27.263884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1f52c-a0b8-4c11-9e18-474d07c9f2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:27.264159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1f52c-a0b8-4c11-9e18-474d07c9f2e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:27.265471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1f52c-a0b8-4c11-9e18-474d07c9f2e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:27.266964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1f52c-a0b8-4c11-9e18-474d07c9f2e1 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:27.273235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 90/186] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:27.273235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1f52c-a0b8-4c11-9e18-474d07c9f2e1 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:27.360576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 97/187] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:27.361717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34937d81-58d3-4087-b6d9-27751cdfb681 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:27.399197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1f52c-a0b8-4c11-9e18-474d07c9f2e1 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:27.432336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f18eee-0675-4969-84f9-cb39e5b6980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:27.433126 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f18eee-0675-4969-84f9-cb39e5b6980c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:27.433403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f18eee-0675-4969-84f9-cb39e5b6980c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:27.433670 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f18eee-0675-4969-84f9-cb39e5b6980c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:27.443817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f18eee-0675-4969-84f9-cb39e5b6980c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-d8f18eee-0675-4969-84f9-cb39e5b6980c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:27.451644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:27.452571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 91/188] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:34:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:27.455072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f18eee-0675-4969-84f9-cb39e5b6980c None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:27.471558 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34937d81-58d3-4087-b6d9-27751cdfb681 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:27.503527 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942eeb73-206b-4da2-8f7f-cc3de15ade90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:27.504189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942eeb73-206b-4da2-8f7f-cc3de15ade90 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:27.504471 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942eeb73-206b-4da2-8f7f-cc3de15ade90 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:27.504747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942eeb73-206b-4da2-8f7f-cc3de15ade90 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:27.505450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942eeb73-206b-4da2-8f7f-cc3de15ade90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:27.506905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942eeb73-206b-4da2-8f7f-cc3de15ade90 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:27.531801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 98/189] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:34:27 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:34:27.536785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe19a1b-6cde-4282-ab49-526af126a7b2 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:27.537081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe19a1b-6cde-4282-ab49-526af126a7b2 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:27.537372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe19a1b-6cde-4282-ab49-526af126a7b2 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:27.538937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 99/190] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:27.539556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe19a1b-6cde-4282-ab49-526af126a7b2 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:27.554700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f18eee-0675-4969-84f9-cb39e5b6980c None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:27.590091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c42392-9ddc-453b-851b-d90c5591c581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:27.590921 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c42392-9ddc-453b-851b-d90c5591c581 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:27.591233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c42392-9ddc-453b-851b-d90c5591c581 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:27.591499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c42392-9ddc-453b-851b-d90c5591c581 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:27.603381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c42392-9ddc-453b-851b-d90c5591c581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-23c42392-9ddc-453b-851b-d90c5591c581 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:27.611687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:27.612663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:27.613443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 92/191] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:34:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:27.614613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a23232-39f4-4114-b4d2-1a03929b7a73 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:27.614613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a23232-39f4-4114-b4d2-1a03929b7a73 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:27.614840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a23232-39f4-4114-b4d2-1a03929b7a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:27.631783 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-56a23232-39f4-4114-b4d2-1a03929b7a73 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:27.633004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-56a23232-39f4-4114-b4d2-1a03929b7a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:27.656479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe19a1b-6cde-4282-ab49-526af126a7b2 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:27.692371 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcacac2-53f0-4023-a3f1-283331fc33d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:27.693053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcacac2-53f0-4023-a3f1-283331fc33d2 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:27.693317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcacac2-53f0-4023-a3f1-283331fc33d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:27.693628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcacac2-53f0-4023-a3f1-283331fc33d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:27.694341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcacac2-53f0-4023-a3f1-283331fc33d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:27.694647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcacac2-53f0-4023-a3f1-283331fc33d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:27.696340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcacac2-53f0-4023-a3f1-283331fc33d2 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:27.703837 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 93/192] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:27.704700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a23232-39f4-4114-b4d2-1a03929b7a73 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:27.717243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 100/193] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:27.724580 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcacac2-53f0-4023-a3f1-283331fc33d2 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:27.817183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a23232-39f4-4114-b4d2-1a03929b7a73 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:27.854184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcacac2-53f0-4023-a3f1-283331fc33d2 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:27.864108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ccb14-66c1-4de7-8260-1e3f1d45dbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:27.865152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ccb14-66c1-4de7-8260-1e3f1d45dbd4 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:27.865438 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ccb14-66c1-4de7-8260-1e3f1d45dbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:27.866025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ccb14-66c1-4de7-8260-1e3f1d45dbd4 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:27.867073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ccb14-66c1-4de7-8260-1e3f1d45dbd4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:27.867436 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ccb14-66c1-4de7-8260-1e3f1d45dbd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:27.869332 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ccb14-66c1-4de7-8260-1e3f1d45dbd4 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:27.881561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 94/194] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:34:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:27.884816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ccb14-66c1-4de7-8260-1e3f1d45dbd4 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:27.893460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c76b72-ac75-45fc-8e3d-f3905c9b11cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:27.894444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76b72-ac75-45fc-8e3d-f3905c9b11cc None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:27.894722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76b72-ac75-45fc-8e3d-f3905c9b11cc None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:27.895004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76b72-ac75-45fc-8e3d-f3905c9b11cc None admin] PATH_INFO: `/v3/users/fb65877d975342278528e8527a10dcc5` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:27.910751 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c76b72-ac75-45fc-8e3d-f3905c9b11cc None admin] RBAC: Authorizing `identity:get_user(user_id=fb65877d975342278528e8527a10dcc5)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:27.912246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c76b72-ac75-45fc-8e3d-f3905c9b11cc None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:27.914162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 101/195] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:27 2022] GET /identity/v3/users/fb65877d975342278528e8527a10dcc5 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:27.914719 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c76b72-ac75-45fc-8e3d-f3905c9b11cc None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:28.006328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ccb14-66c1-4de7-8260-1e3f1d45dbd4 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:28.028605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c76b72-ac75-45fc-8e3d-f3905c9b11cc None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:28.040268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ea397-ae30-4966-b527-978e2001278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:28.041061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ea397-ae30-4966-b527-978e2001278f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:28.041341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ea397-ae30-4966-b527-978e2001278f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:28.041614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ea397-ae30-4966-b527-978e2001278f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:28.052883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ea397-ae30-4966-b527-978e2001278f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-a59ea397-ae30-4966-b527-978e2001278f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:28.060842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:28.061766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:28.063071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 95/196] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:28.063973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ea397-ae30-4966-b527-978e2001278f None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:28.068957 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7e0af-1471-48cf-85f0-2416fed44522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:28.069839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7e0af-1471-48cf-85f0-2416fed44522 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:28.070116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7e0af-1471-48cf-85f0-2416fed44522 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:28.070655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7e0af-1471-48cf-85f0-2416fed44522 None admin] PATH_INFO: `/v3/users/fb65877d975342278528e8527a10dcc5` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:28.071875 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7e0af-1471-48cf-85f0-2416fed44522 None admin] RBAC: Authorizing `identity:get_user(user_id=fb65877d975342278528e8527a10dcc5)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:28.073335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7e0af-1471-48cf-85f0-2416fed44522 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:28.075150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 102/197] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:27 2022] GET /identity/v3/users/fb65877d975342278528e8527a10dcc5 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:28.075757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7e0af-1471-48cf-85f0-2416fed44522 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:28.164373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ea397-ae30-4966-b527-978e2001278f None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:28.173989 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7e0af-1471-48cf-85f0-2416fed44522 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:28.200562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e44009-47c6-4857-98e1-1c5bbcd6e298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:28.201474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e44009-47c6-4857-98e1-1c5bbcd6e298 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:28.201754 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e44009-47c6-4857-98e1-1c5bbcd6e298 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:28.202042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e44009-47c6-4857-98e1-1c5bbcd6e298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:28.207585 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48cb0e-4759-440f-8b8a-6ad744e9ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:28.208237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48cb0e-4759-440f-8b8a-6ad744e9ed9c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:28.208512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48cb0e-4759-440f-8b8a-6ad744e9ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:28.208782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48cb0e-4759-440f-8b8a-6ad744e9ed9c None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:28.209515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48cb0e-4759-440f-8b8a-6ad744e9ed9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:28.209814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48cb0e-4759-440f-8b8a-6ad744e9ed9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:28.211190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48cb0e-4759-440f-8b8a-6ad744e9ed9c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:28.219569 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 103/198] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:28.220345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48cb0e-4759-440f-8b8a-6ad744e9ed9c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:28.284544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e44009-47c6-4857-98e1-1c5bbcd6e298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:28.286194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e44009-47c6-4857-98e1-1c5bbcd6e298 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:28.325851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48cb0e-4759-440f-8b8a-6ad744e9ed9c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:28.358933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc707245-f09a-4564-a966-3bbdd1eaab61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:28.359619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707245-f09a-4564-a966-3bbdd1eaab61 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:28.359899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707245-f09a-4564-a966-3bbdd1eaab61 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:28.360173 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707245-f09a-4564-a966-3bbdd1eaab61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:28.409752 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 96/199] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:28.410719 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e44009-47c6-4857-98e1-1c5bbcd6e298 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:28.427539 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc707245-f09a-4564-a966-3bbdd1eaab61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:28.429019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc707245-f09a-4564-a966-3bbdd1eaab61 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:28.516519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e44009-47c6-4857-98e1-1c5bbcd6e298 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:28.528700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 104/200] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:28.529557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc707245-f09a-4564-a966-3bbdd1eaab61 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:28.557127 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9bfa3-9832-4174-ab46-db1da3a4b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:28.557934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9bfa3-9832-4174-ab46-db1da3a4b4cb None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:28.558214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9bfa3-9832-4174-ab46-db1da3a4b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:28.558485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9bfa3-9832-4174-ab46-db1da3a4b4cb None admin] PATH_INFO: `/v3/users/7ea9f75d0a2c4542b66026d7c79fb660` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:28.559716 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9bfa3-9832-4174-ab46-db1da3a4b4cb None admin] RBAC: Authorizing `identity:get_user(user_id=7ea9f75d0a2c4542b66026d7c79fb660)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:28.561159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9bfa3-9832-4174-ab46-db1da3a4b4cb None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:28.563110 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 97/201] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:28 2022] GET /identity/v3/users/7ea9f75d0a2c4542b66026d7c79fb660 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:28.563908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9bfa3-9832-4174-ab46-db1da3a4b4cb None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:28.639421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc707245-f09a-4564-a966-3bbdd1eaab61 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:28.661115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9bfa3-9832-4174-ab46-db1da3a4b4cb None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:28.672974 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e05522-4289-4613-86c8-c5e32487a053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:28.673837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e05522-4289-4613-86c8-c5e32487a053 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:28.674110 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e05522-4289-4613-86c8-c5e32487a053 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:28.674381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e05522-4289-4613-86c8-c5e32487a053 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:28.675586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e05522-4289-4613-86c8-c5e32487a053 None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:28.677024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e05522-4289-4613-86c8-c5e32487a053 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:28.678869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 105/202] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:28 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:28.679659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e05522-4289-4613-86c8-c5e32487a053 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:28.703718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673aca7-2284-4f37-9a08-e6fcadba7ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:28.704588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673aca7-2284-4f37-9a08-e6fcadba7ab3 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:28.705009 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673aca7-2284-4f37-9a08-e6fcadba7ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:28.705288 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673aca7-2284-4f37-9a08-e6fcadba7ab3 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:28.707082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673aca7-2284-4f37-9a08-e6fcadba7ab3 None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:28.709022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673aca7-2284-4f37-9a08-e6fcadba7ab3 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:28.711271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 98/203] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:28 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:28.712041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673aca7-2284-4f37-9a08-e6fcadba7ab3 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:28.784285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e05522-4289-4613-86c8-c5e32487a053 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:28.820716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f9545-ca43-459c-bc6f-9a09cd7f1ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:28.821294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f9545-ca43-459c-bc6f-9a09cd7f1ba8 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:28.821577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f9545-ca43-459c-bc6f-9a09cd7f1ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:28.821852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f9545-ca43-459c-bc6f-9a09cd7f1ba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:28.844040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673aca7-2284-4f37-9a08-e6fcadba7ab3 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:28.877705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e5cbe-92cb-4c97-ab83-6e41a7f73340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:28.878373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e5cbe-92cb-4c97-ab83-6e41a7f73340 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:28.878654 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e5cbe-92cb-4c97-ab83-6e41a7f73340 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:28.878930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e5cbe-92cb-4c97-ab83-6e41a7f73340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:28.879797 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e5cbe-92cb-4c97-ab83-6e41a7f73340 None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=7679b9c9048648c08cf01ca7f0b58d36, user.id=fb65877d975342278528e8527a10dcc5) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:28.880109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e5cbe-92cb-4c97-ab83-6e41a7f73340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:28.881858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e5cbe-92cb-4c97-ab83-6e41a7f73340 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:28.886965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 99/204] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:28 2022] GET /identity/v3/role_assignments?user.id=fb65877d975342278528e8527a10dcc5&scope.project.id=7679b9c9048648c08cf01ca7f0b58d36&role.id=70e67f35994843ae942d4f1703d5619e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:28.887786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e5cbe-92cb-4c97-ab83-6e41a7f73340 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:28.906754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f9545-ca43-459c-bc6f-9a09cd7f1ba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:28.909179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f9545-ca43-459c-bc6f-9a09cd7f1ba8 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:28.995133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e5cbe-92cb-4c97-ab83-6e41a7f73340 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:29.034420 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 106/205] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:29.038487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddc422-5d4a-48e7-b03d-1138258c08cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:29.038487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddc422-5d4a-48e7-b03d-1138258c08cd None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:29.038487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddc422-5d4a-48e7-b03d-1138258c08cd None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:29.038487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddc422-5d4a-48e7-b03d-1138258c08cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:29.038954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddc422-5d4a-48e7-b03d-1138258c08cd None admin] RBAC: Adding query filter params (role.id=142e36ee06a7422e8e8d32a1080ea89a, scope.project.id=7679b9c9048648c08cf01ca7f0b58d36, user.id=fb65877d975342278528e8527a10dcc5) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:29.039384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddc422-5d4a-48e7-b03d-1138258c08cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:29.040886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddc422-5d4a-48e7-b03d-1138258c08cd None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:29.041224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f9545-ca43-459c-bc6f-9a09cd7f1ba8 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:29.047696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 100/206] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:28 2022] GET /identity/v3/role_assignments?user.id=fb65877d975342278528e8527a10dcc5&scope.project.id=7679b9c9048648c08cf01ca7f0b58d36&role.id=142e36ee06a7422e8e8d32a1080ea89a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:29.182912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f9545-ca43-459c-bc6f-9a09cd7f1ba8 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:29.226938 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198c57f-4323-40f8-aee1-d89096ed9b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:29.228187 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198c57f-4323-40f8-aee1-d89096ed9b0f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:29.228694 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198c57f-4323-40f8-aee1-d89096ed9b0f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:29.229152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198c57f-4323-40f8-aee1-d89096ed9b0f None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:29.230820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198c57f-4323-40f8-aee1-d89096ed9b0f None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:29.232577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198c57f-4323-40f8-aee1-d89096ed9b0f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:29.235077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 107/207] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:29 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:29.241502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddc422-5d4a-48e7-b03d-1138258c08cd None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:29.369969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddc422-5d4a-48e7-b03d-1138258c08cd None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:29.418351 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a10df-52c6-49c2-9f45-d89c08c4256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:29.419012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a10df-52c6-49c2-9f45-d89c08c4256c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:29.419317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a10df-52c6-49c2-9f45-d89c08c4256c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:29.419595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a10df-52c6-49c2-9f45-d89c08c4256c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:29.420446 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a10df-52c6-49c2-9f45-d89c08c4256c None admin] RBAC: Adding query filter params (role.id=dfdbef47aad347cb8de81878442e73f2, scope.project.id=8f60414b09e148d391f54308214c18a7, user.id=7ea9f75d0a2c4542b66026d7c79fb660) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:29.420785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a10df-52c6-49c2-9f45-d89c08c4256c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:29.422245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a10df-52c6-49c2-9f45-d89c08c4256c None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:29.428227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 101/208] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:29 2022] GET /identity/v3/role_assignments?user.id=7ea9f75d0a2c4542b66026d7c79fb660&scope.project.id=8f60414b09e148d391f54308214c18a7&role.id=dfdbef47aad347cb8de81878442e73f2 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:30.120981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a2abe-1650-4c0a-a361-ba518ed5a6aa None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:30.121496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a2abe-1650-4c0a-a361-ba518ed5a6aa None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:30.121572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a2abe-1650-4c0a-a361-ba518ed5a6aa None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:30.123152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 108/209] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:30.128988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d440d-429a-456f-a6a6-0d9de739f95d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:30.129421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d440d-429a-456f-a6a6-0d9de739f95d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:30.129595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d440d-429a-456f-a6a6-0d9de739f95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:30.146404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a82d440d-429a-456f-a6a6-0d9de739f95d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:30.147599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a82d440d-429a-456f-a6a6-0d9de739f95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:30.171809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b32c8-aa51-4a48-81fd-8309449dbe86 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:30.172092 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b32c8-aa51-4a48-81fd-8309449dbe86 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:30.172366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b32c8-aa51-4a48-81fd-8309449dbe86 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:30.173738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 109/210] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:34:30.179039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412aed-a276-41de-82cd-65909959093c None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:30.179397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412aed-a276-41de-82cd-65909959093c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:30.179835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18412aed-a276-41de-82cd-65909959093c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:30.204264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-18412aed-a276-41de-82cd-65909959093c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:30.205896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-18412aed-a276-41de-82cd-65909959093c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:30.220244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 102/211] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:30.244334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d440d-429a-456f-a6a6-0d9de739f95d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:30.291315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 110/212] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:30.317105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18412aed-a276-41de-82cd-65909959093c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:30.372427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d440d-429a-456f-a6a6-0d9de739f95d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:30.415930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18412aed-a276-41de-82cd-65909959093c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:30.420036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f72bc-6f75-4304-a432-5b176b494e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:30.421639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f72bc-6f75-4304-a432-5b176b494e29 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:30.422129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f72bc-6f75-4304-a432-5b176b494e29 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:30.422603 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f72bc-6f75-4304-a432-5b176b494e29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:30.424578 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f72bc-6f75-4304-a432-5b176b494e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:30.426688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f72bc-6f75-4304-a432-5b176b494e29 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:30.429372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 103/213] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:30.435442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f72bc-6f75-4304-a432-5b176b494e29 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:30.455032 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a10a4-3483-473d-8f38-b02214c438e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:30.456081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a10a4-3483-473d-8f38-b02214c438e7 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:30.456192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a10a4-3483-473d-8f38-b02214c438e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:30.456389 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a10a4-3483-473d-8f38-b02214c438e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:30.466578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a10a4-3483-473d-8f38-b02214c438e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-1b3a10a4-3483-473d-8f38-b02214c438e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:30.474743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:30.475679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:30.479888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 111/214] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:30.486276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a10a4-3483-473d-8f38-b02214c438e7 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:30.545332 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f72bc-6f75-4304-a432-5b176b494e29 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:30.580467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53745e-4a7a-4a5f-8e42-b8b4263ee97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:30.581678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53745e-4a7a-4a5f-8e42-b8b4263ee97a None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:30.582235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53745e-4a7a-4a5f-8e42-b8b4263ee97a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:30.582637 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53745e-4a7a-4a5f-8e42-b8b4263ee97a None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:30.583403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53745e-4a7a-4a5f-8e42-b8b4263ee97a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:30.584391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a10a4-3483-473d-8f38-b02214c438e7 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:30.584839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53745e-4a7a-4a5f-8e42-b8b4263ee97a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:30.609630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 104/215] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:34:30 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:34:30.623594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408ccda-e776-43cd-9797-0052b6a67a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:30.624243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408ccda-e776-43cd-9797-0052b6a67a19 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:30.624524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408ccda-e776-43cd-9797-0052b6a67a19 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:30.624859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408ccda-e776-43cd-9797-0052b6a67a19 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:30.625643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408ccda-e776-43cd-9797-0052b6a67a19 None admin] RBAC: Adding query filter params (name=member) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:30.626006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408ccda-e776-43cd-9797-0052b6a67a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:30.627535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408ccda-e776-43cd-9797-0052b6a67a19 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:30.638093 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 112/216] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:30.644386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53745e-4a7a-4a5f-8e42-b8b4263ee97a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:30.759198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53745e-4a7a-4a5f-8e42-b8b4263ee97a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:30.796779 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3be078-591f-405c-964d-9ecac38708c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:30.797680 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3be078-591f-405c-964d-9ecac38708c0 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:30.797962 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3be078-591f-405c-964d-9ecac38708c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:30.798237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3be078-591f-405c-964d-9ecac38708c0 None admin] PATH_INFO: `/v3/users/333fc054e1964bbf81dad82467de7a04` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:30.813227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3be078-591f-405c-964d-9ecac38708c0 None admin] RBAC: Authorizing `identity:get_user(user_id=333fc054e1964bbf81dad82467de7a04)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:30.814694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3be078-591f-405c-964d-9ecac38708c0 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:30.816822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 105/217] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:30 2022] GET /identity/v3/users/333fc054e1964bbf81dad82467de7a04 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:30.822219 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408ccda-e776-43cd-9797-0052b6a67a19 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:30.925403 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408ccda-e776-43cd-9797-0052b6a67a19 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:30.960780 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9477fd-e142-4c85-9fb2-028e478df0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:30.961438 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9477fd-e142-4c85-9fb2-028e478df0c2 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:30.961722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9477fd-e142-4c85-9fb2-028e478df0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:30.961997 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9477fd-e142-4c85-9fb2-028e478df0c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:31.038198 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9477fd-e142-4c85-9fb2-028e478df0c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:31.039727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9477fd-e142-4c85-9fb2-028e478df0c2 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:31.143749 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 113/218] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:34:31.149331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3be078-591f-405c-964d-9ecac38708c0 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:31.265850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3be078-591f-405c-964d-9ecac38708c0 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:31.322883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40222f76-1dea-437d-925f-11fbb4243386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:31.323792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40222f76-1dea-437d-925f-11fbb4243386 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:31.324071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40222f76-1dea-437d-925f-11fbb4243386 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:31.324343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40222f76-1dea-437d-925f-11fbb4243386 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:31.325533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40222f76-1dea-437d-925f-11fbb4243386 None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:31.327009 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40222f76-1dea-437d-925f-11fbb4243386 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:31.328982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 106/219] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:31 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:31.334542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9477fd-e142-4c85-9fb2-028e478df0c2 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:31.493077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9477fd-e142-4c85-9fb2-028e478df0c2 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:31.494548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513d2b-4d60-4b94-8dfd-27144d1c7ffd None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:31.494833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513d2b-4d60-4b94-8dfd-27144d1c7ffd None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:31.495108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513d2b-4d60-4b94-8dfd-27144d1c7ffd None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:31.496658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 107/220] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:34:31.502172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ae55-d78f-4632-9a0c-32428a620f0b None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:31.502458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ae55-d78f-4632-9a0c-32428a620f0b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:31.502734 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ae55-d78f-4632-9a0c-32428a620f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:31.528890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-f0c2ae55-d78f-4632-9a0c-32428a620f0b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:31.529999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f0c2ae55-d78f-4632-9a0c-32428a620f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:31.559895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab540c7-d9de-4421-951f-d2d96d0503ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:31.560554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab540c7-d9de-4421-951f-d2d96d0503ce None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:31.560831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab540c7-d9de-4421-951f-d2d96d0503ce None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:31.561103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab540c7-d9de-4421-951f-d2d96d0503ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:31.562489 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab540c7-d9de-4421-951f-d2d96d0503ce None admin] RBAC: Adding query filter params (role.id=2f5b0d90f1814fe8a58210b5cd048bf7, scope.project.id=7679b9c9048648c08cf01ca7f0b58d36, user.id=333fc054e1964bbf81dad82467de7a04) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:31.562800 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab540c7-d9de-4421-951f-d2d96d0503ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:31.564263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab540c7-d9de-4421-951f-d2d96d0503ce None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:31.575100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 114/221] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:31 2022] GET /identity/v3/role_assignments?user.id=333fc054e1964bbf81dad82467de7a04&scope.project.id=7679b9c9048648c08cf01ca7f0b58d36&role.id=2f5b0d90f1814fe8a58210b5cd048bf7 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:31.629132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 108/222] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:31.633592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6883-9bc1-45d2-9e9e-f5d2755b3b12 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:31.633883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6883-9bc1-45d2-9e9e-f5d2755b3b12 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:31.634164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d6883-9bc1-45d2-9e9e-f5d2755b3b12 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:31.635561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 115/223] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:31.643000 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ca91d-2be3-4e31-b803-96e240371a5f None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:31.643366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ca91d-2be3-4e31-b803-96e240371a5f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:31.643650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ca91d-2be3-4e31-b803-96e240371a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:31.661417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-841ca91d-2be3-4e31-b803-96e240371a5f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:31.662616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-841ca91d-2be3-4e31-b803-96e240371a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:31.667031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d6883-9bc1-45d2-9e9e-f5d2755b3b12 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:31.782120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 109/224] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:31.807410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ca91d-2be3-4e31-b803-96e240371a5f None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:31.841978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d6883-9bc1-45d2-9e9e-f5d2755b3b12 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:31.876858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06e1d4-8990-47aa-bacf-3866f0bb8f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:31.878214 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06e1d4-8990-47aa-bacf-3866f0bb8f93 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:31.878609 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06e1d4-8990-47aa-bacf-3866f0bb8f93 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:31.878886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06e1d4-8990-47aa-bacf-3866f0bb8f93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:31.891995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06e1d4-8990-47aa-bacf-3866f0bb8f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-4a06e1d4-8990-47aa-bacf-3866f0bb8f93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:31.900486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:31.901392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:31.902619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 116/225] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:34:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:31.908681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06e1d4-8990-47aa-bacf-3866f0bb8f93 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:31.962086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ca91d-2be3-4e31-b803-96e240371a5f None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:32.056382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06e1d4-8990-47aa-bacf-3866f0bb8f93 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:32.057323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131b188-dcae-46de-b67d-6789cd104ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:32.058363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131b188-dcae-46de-b67d-6789cd104ca2 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:32.058869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131b188-dcae-46de-b67d-6789cd104ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:32.059388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131b188-dcae-46de-b67d-6789cd104ca2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:32.078788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131b188-dcae-46de-b67d-6789cd104ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-a131b188-dcae-46de-b67d-6789cd104ca2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:32.088658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:32.089544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:32.090324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:32.090324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:32.090324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:32.090324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:32.090324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:32.090324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:32.090324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:32.090324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:32.090324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:32.090324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:32.090324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:32.090324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:32.093279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 110/226] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:34:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:32.100269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131b188-dcae-46de-b67d-6789cd104ca2 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:32.143933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522794a-c45f-4d1c-93d2-c76d829640db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:32.144623 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522794a-c45f-4d1c-93d2-c76d829640db None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:32.144891 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522794a-c45f-4d1c-93d2-c76d829640db None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:32.145171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522794a-c45f-4d1c-93d2-c76d829640db None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:32.145930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522794a-c45f-4d1c-93d2-c76d829640db None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:32.146237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522794a-c45f-4d1c-93d2-c76d829640db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:32.147655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522794a-c45f-4d1c-93d2-c76d829640db None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:32.164365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 117/227] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:32.171628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522794a-c45f-4d1c-93d2-c76d829640db None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:32.208778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131b188-dcae-46de-b67d-6789cd104ca2 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:32.258760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae0fa3-3934-44ea-965f-cb9dcd13cac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:32.259471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae0fa3-3934-44ea-965f-cb9dcd13cac3 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:32.259748 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae0fa3-3934-44ea-965f-cb9dcd13cac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:32.260019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae0fa3-3934-44ea-965f-cb9dcd13cac3 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:32.260787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae0fa3-3934-44ea-965f-cb9dcd13cac3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:32.261087 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae0fa3-3934-44ea-965f-cb9dcd13cac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:32.262519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae0fa3-3934-44ea-965f-cb9dcd13cac3 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:32.277357 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 111/228] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:34:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:32.285081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae0fa3-3934-44ea-965f-cb9dcd13cac3 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:32.353768 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522794a-c45f-4d1c-93d2-c76d829640db None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:32.422265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1085b-2055-40cc-bbd7-7aef80db28fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:32.423140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1085b-2055-40cc-bbd7-7aef80db28fd None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:32.423465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1085b-2055-40cc-bbd7-7aef80db28fd None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:32.423740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1085b-2055-40cc-bbd7-7aef80db28fd None admin] PATH_INFO: `/v3/users/fb65877d975342278528e8527a10dcc5` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:32.426255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1085b-2055-40cc-bbd7-7aef80db28fd None admin] RBAC: Authorizing `identity:get_user(user_id=fb65877d975342278528e8527a10dcc5)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:32.427743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1085b-2055-40cc-bbd7-7aef80db28fd None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:32.429358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 118/229] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:32 2022] GET /identity/v3/users/fb65877d975342278528e8527a10dcc5 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:32.440422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1085b-2055-40cc-bbd7-7aef80db28fd None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:32.498774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae0fa3-3934-44ea-965f-cb9dcd13cac3 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:32.546295 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1085b-2055-40cc-bbd7-7aef80db28fd None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:32.575955 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae672b2e-ccd9-40a9-823a-95133adf69be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:32.576759 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae672b2e-ccd9-40a9-823a-95133adf69be None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:32.577671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae672b2e-ccd9-40a9-823a-95133adf69be None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:32.577944 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae672b2e-ccd9-40a9-823a-95133adf69be None admin] PATH_INFO: `/v3/users/fb65877d975342278528e8527a10dcc5` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:32.579874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae672b2e-ccd9-40a9-823a-95133adf69be None admin] RBAC: Authorizing `identity:get_user(user_id=fb65877d975342278528e8527a10dcc5)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:32.581305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae672b2e-ccd9-40a9-823a-95133adf69be None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:32.582916 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 112/230] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:32 2022] GET /identity/v3/users/fb65877d975342278528e8527a10dcc5 => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:32.591964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae672b2e-ccd9-40a9-823a-95133adf69be None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:32.595949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce815db7-5578-4836-a6e7-c0397a020974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:32.596804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815db7-5578-4836-a6e7-c0397a020974 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:32.597078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815db7-5578-4836-a6e7-c0397a020974 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:32.597343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815db7-5578-4836-a6e7-c0397a020974 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:32.599528 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce815db7-5578-4836-a6e7-c0397a020974 None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:32.601866 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce815db7-5578-4836-a6e7-c0397a020974 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:32.603980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 119/231] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:32 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:32.612243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce815db7-5578-4836-a6e7-c0397a020974 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:32.713459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae672b2e-ccd9-40a9-823a-95133adf69be None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:32.760484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce815db7-5578-4836-a6e7-c0397a020974 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:32.760707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc360ecd-6f73-48b2-a6e5-0600dc58f8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:32.761383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc360ecd-6f73-48b2-a6e5-0600dc58f8fc None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:32.761661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc360ecd-6f73-48b2-a6e5-0600dc58f8fc None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:32.761932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc360ecd-6f73-48b2-a6e5-0600dc58f8fc None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:32.768124 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc360ecd-6f73-48b2-a6e5-0600dc58f8fc None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:32.769629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc360ecd-6f73-48b2-a6e5-0600dc58f8fc None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:32.771409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 113/232] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:32 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:32.777086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc360ecd-6f73-48b2-a6e5-0600dc58f8fc None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:32.802774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cab24c-4a54-4d46-9b92-5a549819ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:32.803764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cab24c-4a54-4d46-9b92-5a549819ff97 None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:32.804049 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cab24c-4a54-4d46-9b92-5a549819ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:32.804327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cab24c-4a54-4d46-9b92-5a549819ff97 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36/users/fb65877d975342278528e8527a10dcc5/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:32.813203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cab24c-4a54-4d46-9b92-5a549819ff97 None admin] RBAC: Authorizing `identity:create_grant(project_id=7679b9c9048648c08cf01ca7f0b58d36, user_id=fb65877d975342278528e8527a10dcc5, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:32.814742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cab24c-4a54-4d46-9b92-5a549819ff97 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:32.847991 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 120/233] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:34:32 2022] PUT /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36/users/fb65877d975342278528e8527a10dcc5/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:34:32.886864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc360ecd-6f73-48b2-a6e5-0600dc58f8fc None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:32.927963 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2522e-fb6a-451a-a094-61224e1b709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:32.928882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2522e-fb6a-451a-a094-61224e1b709c None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:32.929145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2522e-fb6a-451a-a094-61224e1b709c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:32.929413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2522e-fb6a-451a-a094-61224e1b709c None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36/users/fb65877d975342278528e8527a10dcc5/roles/142e36ee06a7422e8e8d32a1080ea89a` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:32.938329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2522e-fb6a-451a-a094-61224e1b709c None admin] RBAC: Authorizing `identity:create_grant(project_id=7679b9c9048648c08cf01ca7f0b58d36, user_id=fb65877d975342278528e8527a10dcc5, role_id=142e36ee06a7422e8e8d32a1080ea89a)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:32.939257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2522e-fb6a-451a-a094-61224e1b709c None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:32.970089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 114/234] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:34:32 2022] PUT /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36/users/fb65877d975342278528e8527a10dcc5/roles/142e36ee06a7422e8e8d32a1080ea89a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:34:33.584783 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e641f3-532b-44d7-90a7-106a1895e8cf None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:33.585782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e641f3-532b-44d7-90a7-106a1895e8cf None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:33.586273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e641f3-532b-44d7-90a7-106a1895e8cf None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:33.588126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 121/235] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:33.594318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be727d-3bbe-4417-896d-29b8a1155ee7 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:33.595171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be727d-3bbe-4417-896d-29b8a1155ee7 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:33.595676 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be727d-3bbe-4417-896d-29b8a1155ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:33.620155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-57be727d-3bbe-4417-896d-29b8a1155ee7 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:33.621739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-57be727d-3bbe-4417-896d-29b8a1155ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:33.712688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 115/236] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:33.727511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608c268-e327-41bb-a47a-b0d58d81aba4 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:33.728100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608c268-e327-41bb-a47a-b0d58d81aba4 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:33.728584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608c268-e327-41bb-a47a-b0d58d81aba4 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:33.730422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 122/237] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:33.735254 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7afa5-7a25-459f-9119-965ce7e4ef66 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:33.735545 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7afa5-7a25-459f-9119-965ce7e4ef66 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:33.736075 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7afa5-7a25-459f-9119-965ce7e4ef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:33.744497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608c268-e327-41bb-a47a-b0d58d81aba4 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:33.753301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-77b7afa5-7a25-459f-9119-965ce7e4ef66 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:33.754495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-77b7afa5-7a25-459f-9119-965ce7e4ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:33.826001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 116/238] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:33.862430 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7afa5-7a25-459f-9119-965ce7e4ef66 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:33.893981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608c268-e327-41bb-a47a-b0d58d81aba4 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:33.963903 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04e51f-9e04-4c23-8fba-7a5ca9902afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:33.964714 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04e51f-9e04-4c23-8fba-7a5ca9902afe None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:33.965000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04e51f-9e04-4c23-8fba-7a5ca9902afe None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:33.965277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04e51f-9e04-4c23-8fba-7a5ca9902afe None admin] PATH_INFO: `/v3/domains/default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:33.966482 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04e51f-9e04-4c23-8fba-7a5ca9902afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:33.968009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04e51f-9e04-4c23-8fba-7a5ca9902afe None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:33.969636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 123/239] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:33.975101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04e51f-9e04-4c23-8fba-7a5ca9902afe None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:34.017796 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7afa5-7a25-459f-9119-965ce7e4ef66 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:34.054727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af73f4c-9345-439c-9e77-275de5d7def7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:34.056228 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af73f4c-9345-439c-9e77-275de5d7def7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:34.056711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af73f4c-9345-439c-9e77-275de5d7def7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:34.057203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af73f4c-9345-439c-9e77-275de5d7def7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:34.069284 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af73f4c-9345-439c-9e77-275de5d7def7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-5af73f4c-9345-439c-9e77-275de5d7def7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:34.078902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:34.079834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:34.080618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:34.080618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:34.080618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:34.080618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:34.080618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:34.080618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:34.080618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:34.080618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:34.080618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:34.080618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:34.080618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:34.080618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:34.083483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 117/240] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:34.089389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af73f4c-9345-439c-9e77-275de5d7def7 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:34.150379 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04e51f-9e04-4c23-8fba-7a5ca9902afe None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:34.185125 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d8b62-9b9c-43ea-b366-4200dfa65789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:34.186147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d8b62-9b9c-43ea-b366-4200dfa65789 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:34.187169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d8b62-9b9c-43ea-b366-4200dfa65789 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:34.187698 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d8b62-9b9c-43ea-b366-4200dfa65789 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:34.188685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d8b62-9b9c-43ea-b366-4200dfa65789 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:34.190338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d8b62-9b9c-43ea-b366-4200dfa65789 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:34.218175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 124/241] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:34:33 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:34:34.262266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af73f4c-9345-439c-9e77-275de5d7def7 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:34.313470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34652dc3-137d-43e7-a958-f271d60eae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:34.315025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34652dc3-137d-43e7-a958-f271d60eae70 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:34.315025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34652dc3-137d-43e7-a958-f271d60eae70 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:34.315165 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34652dc3-137d-43e7-a958-f271d60eae70 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:34.319239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34652dc3-137d-43e7-a958-f271d60eae70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:34.319239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34652dc3-137d-43e7-a958-f271d60eae70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:34.319239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34652dc3-137d-43e7-a958-f271d60eae70 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:34.328317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 118/242] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:34.333542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d8b62-9b9c-43ea-b366-4200dfa65789 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:34.428047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e39e4b-ad43-493b-a7b5-91552424c04c None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:34.428898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e39e4b-ad43-493b-a7b5-91552424c04c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:34.429386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e39e4b-ad43-493b-a7b5-91552424c04c None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:34.431046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 119/243] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:34.437924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a77c22-94b8-4070-a646-f13f2c20ea40 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:34.438538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a77c22-94b8-4070-a646-f13f2c20ea40 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:34.439175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a77c22-94b8-4070-a646-f13f2c20ea40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:34.460000 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-06a77c22-94b8-4070-a646-f13f2c20ea40 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:34.461103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-06a77c22-94b8-4070-a646-f13f2c20ea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:34.472618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d8b62-9b9c-43ea-b366-4200dfa65789 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:34.515032 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9f4d1-6a64-4047-899e-46dee05f6d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:34.516877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9f4d1-6a64-4047-899e-46dee05f6d7b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:34.517311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9f4d1-6a64-4047-899e-46dee05f6d7b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:34.517731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9f4d1-6a64-4047-899e-46dee05f6d7b None admin] PATH_INFO: `/v3/users/e6af1d78368a49fca74f447e24ea9f3d` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:34.536217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9f4d1-6a64-4047-899e-46dee05f6d7b None admin] RBAC: Authorizing `identity:get_user(user_id=e6af1d78368a49fca74f447e24ea9f3d)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:34.538014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9f4d1-6a64-4047-899e-46dee05f6d7b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:34.539592 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 120/244] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:34.540053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 125/245] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:34 2022] GET /identity/v3/users/e6af1d78368a49fca74f447e24ea9f3d => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:34.546744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a77c22-94b8-4070-a646-f13f2c20ea40 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:34.569613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9f4d1-6a64-4047-899e-46dee05f6d7b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:34.657304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a77c22-94b8-4070-a646-f13f2c20ea40 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:34.694309 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9f4d1-6a64-4047-899e-46dee05f6d7b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:34.704886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ef2f4-6a7e-4f27-bc2f-4fe4896de93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:34.706030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef2f4-6a7e-4f27-bc2f-4fe4896de93e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:34.706030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef2f4-6a7e-4f27-bc2f-4fe4896de93e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:34.706419 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef2f4-6a7e-4f27-bc2f-4fe4896de93e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:34.747977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f025b-fd27-41d2-a0ac-e3357a90cf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:34.748985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f025b-fd27-41d2-a0ac-e3357a90cf2c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:34.749263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f025b-fd27-41d2-a0ac-e3357a90cf2c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:34.749583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f025b-fd27-41d2-a0ac-e3357a90cf2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:34.764142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f025b-fd27-41d2-a0ac-e3357a90cf2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-4e2f025b-fd27-41d2-a0ac-e3357a90cf2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:34.774858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:34.775856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:34.776663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 126/246] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:34.784276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f025b-fd27-41d2-a0ac-e3357a90cf2c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:34.802141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ef2f4-6a7e-4f27-bc2f-4fe4896de93e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:34.803939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ef2f4-6a7e-4f27-bc2f-4fe4896de93e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:34.913684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f025b-fd27-41d2-a0ac-e3357a90cf2c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:34.917695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 121/247] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:34.926835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ef2f4-6a7e-4f27-bc2f-4fe4896de93e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:34.958369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd31840-190a-438c-83e2-51ea4ec932d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:34.959372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd31840-190a-438c-83e2-51ea4ec932d1 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:34.959833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd31840-190a-438c-83e2-51ea4ec932d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:34.960284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd31840-190a-438c-83e2-51ea4ec932d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:34.961205 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd31840-190a-438c-83e2-51ea4ec932d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:34.961711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd31840-190a-438c-83e2-51ea4ec932d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:34.963301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd31840-190a-438c-83e2-51ea4ec932d1 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:34.972275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 127/248] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:34.978433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd31840-190a-438c-83e2-51ea4ec932d1 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:35.063034 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ef2f4-6a7e-4f27-bc2f-4fe4896de93e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:35.103340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd31840-190a-438c-83e2-51ea4ec932d1 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:35.107232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88615cf-4dc3-444f-a204-3161c15602e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:35.108871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88615cf-4dc3-444f-a204-3161c15602e3 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:35.109331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88615cf-4dc3-444f-a204-3161c15602e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:35.109773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88615cf-4dc3-444f-a204-3161c15602e3 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:35.111195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88615cf-4dc3-444f-a204-3161c15602e3 None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:35.113263 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88615cf-4dc3-444f-a204-3161c15602e3 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:35.116353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 122/249] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:34 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:35.121644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88615cf-4dc3-444f-a204-3161c15602e3 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:35.142784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9978917-6938-453d-b35c-a33bfa4521b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:35.143756 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9978917-6938-453d-b35c-a33bfa4521b1 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:35.144072 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9978917-6938-453d-b35c-a33bfa4521b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:35.144352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9978917-6938-453d-b35c-a33bfa4521b1 None admin] PATH_INFO: `/v3/users/333fc054e1964bbf81dad82467de7a04` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:35.145561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9978917-6938-453d-b35c-a33bfa4521b1 None admin] RBAC: Authorizing `identity:get_user(user_id=333fc054e1964bbf81dad82467de7a04)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:35.147079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9978917-6938-453d-b35c-a33bfa4521b1 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:35.148906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 128/250] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:34 2022] GET /identity/v3/users/333fc054e1964bbf81dad82467de7a04 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:35.154287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9978917-6938-453d-b35c-a33bfa4521b1 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:35.268140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9978917-6938-453d-b35c-a33bfa4521b1 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:35.269059 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88615cf-4dc3-444f-a204-3161c15602e3 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:35.311893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9b360-3a5d-4136-a304-08ed8d0d1474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:35.313101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9b360-3a5d-4136-a304-08ed8d0d1474 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:35.313576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9b360-3a5d-4136-a304-08ed8d0d1474 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:35.318773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9b360-3a5d-4136-a304-08ed8d0d1474 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:35.318773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9b360-3a5d-4136-a304-08ed8d0d1474 None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:35.318773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9b360-3a5d-4136-a304-08ed8d0d1474 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:35.319378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 129/251] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:35 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:35.326017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9b360-3a5d-4136-a304-08ed8d0d1474 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:35.345891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d082774-206d-4dea-ba05-a55de7a79437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:35.346568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d082774-206d-4dea-ba05-a55de7a79437 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:35.346848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d082774-206d-4dea-ba05-a55de7a79437 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:35.347122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d082774-206d-4dea-ba05-a55de7a79437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:35.347999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d082774-206d-4dea-ba05-a55de7a79437 None admin] RBAC: Adding query filter params (role.id=dfdbef47aad347cb8de81878442e73f2, scope.project.id=7679b9c9048648c08cf01ca7f0b58d36, user.id=e6af1d78368a49fca74f447e24ea9f3d) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:35.348325 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d082774-206d-4dea-ba05-a55de7a79437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:35.350022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d082774-206d-4dea-ba05-a55de7a79437 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:35.357196 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 123/252] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:35 2022] GET /identity/v3/role_assignments?user.id=e6af1d78368a49fca74f447e24ea9f3d&scope.project.id=7679b9c9048648c08cf01ca7f0b58d36&role.id=dfdbef47aad347cb8de81878442e73f2 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:35.452008 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9b360-3a5d-4136-a304-08ed8d0d1474 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:35.489379 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ff371-fbfd-4f8d-a3fd-f2d4d6243b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:35.490686 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff371-fbfd-4f8d-a3fd-f2d4d6243b6d None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:35.491245 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff371-fbfd-4f8d-a3fd-f2d4d6243b6d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:35.491723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff371-fbfd-4f8d-a3fd-f2d4d6243b6d None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36/users/333fc054e1964bbf81dad82467de7a04/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:35.493929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff371-fbfd-4f8d-a3fd-f2d4d6243b6d None admin] RBAC: Authorizing `identity:create_grant(project_id=7679b9c9048648c08cf01ca7f0b58d36, user_id=333fc054e1964bbf81dad82467de7a04, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:35.495656 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff371-fbfd-4f8d-a3fd-f2d4d6243b6d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:35.526462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 130/253] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:34:35 2022] PUT /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36/users/333fc054e1964bbf81dad82467de7a04/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:34:35.602354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef83ba-9446-4799-8adb-782ea18dfb4d None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:35.602706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef83ba-9446-4799-8adb-782ea18dfb4d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:35.602920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef83ba-9446-4799-8adb-782ea18dfb4d None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:35.604596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 124/254] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:35.610917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f1cb-886d-4c8a-96be-f88ad1e24af7 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:35.611639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f1cb-886d-4c8a-96be-f88ad1e24af7 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:35.612121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f1cb-886d-4c8a-96be-f88ad1e24af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:35.633754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-3880f1cb-886d-4c8a-96be-f88ad1e24af7 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:35.635288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3880f1cb-886d-4c8a-96be-f88ad1e24af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:35.719404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 131/255] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:35.759764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef83ba-9446-4799-8adb-782ea18dfb4d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:35.907339 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef83ba-9446-4799-8adb-782ea18dfb4d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:35.954445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2ea17-dfc7-47a3-881a-43c974fec864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:35.955277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2ea17-dfc7-47a3-881a-43c974fec864 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:35.955564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2ea17-dfc7-47a3-881a-43c974fec864 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:35.955839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2ea17-dfc7-47a3-881a-43c974fec864 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:35.972747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2ea17-dfc7-47a3-881a-43c974fec864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-b0b2ea17-dfc7-47a3-881a-43c974fec864 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:35.981302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:35.982269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:35.983062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 125/256] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:34:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:35.988358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880f1cb-886d-4c8a-96be-f88ad1e24af7 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:36.092327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880f1cb-886d-4c8a-96be-f88ad1e24af7 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:36.132680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f5c48-9536-472b-ba0d-a187c4621d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:36.133374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f5c48-9536-472b-ba0d-a187c4621d50 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:36.133655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f5c48-9536-472b-ba0d-a187c4621d50 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:36.133931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f5c48-9536-472b-ba0d-a187c4621d50 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:36.134699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f5c48-9536-472b-ba0d-a187c4621d50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:36.135073 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f5c48-9536-472b-ba0d-a187c4621d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:36.136580 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f5c48-9536-472b-ba0d-a187c4621d50 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:36.152221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 132/257] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:36.158396 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2ea17-dfc7-47a3-881a-43c974fec864 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:36.265660 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2ea17-dfc7-47a3-881a-43c974fec864 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:36.300540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d7ee7-378f-481d-9934-1d6caa158333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:36.307247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d7ee7-378f-481d-9934-1d6caa158333 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:36.307247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d7ee7-378f-481d-9934-1d6caa158333 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:36.307247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d7ee7-378f-481d-9934-1d6caa158333 None admin] PATH_INFO: `/v3/users/fb65877d975342278528e8527a10dcc5` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:36.307247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d7ee7-378f-481d-9934-1d6caa158333 None admin] RBAC: Authorizing `identity:get_user(user_id=fb65877d975342278528e8527a10dcc5)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:36.309033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d7ee7-378f-481d-9934-1d6caa158333 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:36.312293 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 126/258] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:36 2022] GET /identity/v3/users/fb65877d975342278528e8527a10dcc5 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:36.320934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f5c48-9536-472b-ba0d-a187c4621d50 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:36.434987 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f5c48-9536-472b-ba0d-a187c4621d50 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:36.478862 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78081c59-bd93-452e-8653-b2c8095fc736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:36.479580 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78081c59-bd93-452e-8653-b2c8095fc736 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:36.479863 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78081c59-bd93-452e-8653-b2c8095fc736 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:36.480139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78081c59-bd93-452e-8653-b2c8095fc736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:36.497547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d2ed-d1cd-4fa9-bec9-948d3cf73c7f None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:36.497836 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d2ed-d1cd-4fa9-bec9-948d3cf73c7f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:36.498115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d2ed-d1cd-4fa9-bec9-948d3cf73c7f None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:36.499902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 127/259] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:36.515133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160f767-1534-441b-ba8b-0acbb855e69e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:36.515442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160f767-1534-441b-ba8b-0acbb855e69e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:36.515719 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160f767-1534-441b-ba8b-0acbb855e69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:36.537059 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-5160f767-1534-441b-ba8b-0acbb855e69e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:36.538237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5160f767-1534-441b-ba8b-0acbb855e69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:36.616195 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78081c59-bd93-452e-8653-b2c8095fc736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:36.617676 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78081c59-bd93-452e-8653-b2c8095fc736 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:36.627761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 128/260] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:36.684529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160f767-1534-441b-ba8b-0acbb855e69e None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:36.791861 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 133/261] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:36.803428 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160f767-1534-441b-ba8b-0acbb855e69e None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:36.817035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78081c59-bd93-452e-8653-b2c8095fc736 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:36.846916 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b91e7-e586-46c5-a25c-71c828883788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:36.847764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b91e7-e586-46c5-a25c-71c828883788 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:36.848048 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b91e7-e586-46c5-a25c-71c828883788 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:36.848322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b91e7-e586-46c5-a25c-71c828883788 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:36.872712 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b91e7-e586-46c5-a25c-71c828883788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-591b91e7-e586-46c5-a25c-71c828883788 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:36.884713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:36.885628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:36.886410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:36.886410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:36.886410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:36.886410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:36.886410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:36.886410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:36.886410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:36.886410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:36.886410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:36.886410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:36.886410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:36.886410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:36.893118 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 129/262] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:34:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:36.898426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b91e7-e586-46c5-a25c-71c828883788 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:36.965452 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78081c59-bd93-452e-8653-b2c8095fc736 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:37.041990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b91e7-e586-46c5-a25c-71c828883788 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:37.051064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f0106-3875-471b-a89f-1e09dc8702e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:37.052055 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f0106-3875-471b-a89f-1e09dc8702e1 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:37.052347 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f0106-3875-471b-a89f-1e09dc8702e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:37.052839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f0106-3875-471b-a89f-1e09dc8702e1 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:37.053793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f0106-3875-471b-a89f-1e09dc8702e1 None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:37.063298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f0106-3875-471b-a89f-1e09dc8702e1 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:37.065428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 134/263] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:36 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:37.071179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f0106-3875-471b-a89f-1e09dc8702e1 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:37.080483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9738ec9-7996-487d-b199-1e643bb85aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:37.081442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9738ec9-7996-487d-b199-1e643bb85aca None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:37.081927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9738ec9-7996-487d-b199-1e643bb85aca None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:37.082421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9738ec9-7996-487d-b199-1e643bb85aca None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:37.084115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9738ec9-7996-487d-b199-1e643bb85aca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:37.084632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9738ec9-7996-487d-b199-1e643bb85aca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:37.086214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9738ec9-7996-487d-b199-1e643bb85aca None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:37.096608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 130/264] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:34:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:37.103965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9738ec9-7996-487d-b199-1e643bb85aca None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:37.294079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f0106-3875-471b-a89f-1e09dc8702e1 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:37.333377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9738ec9-7996-487d-b199-1e643bb85aca None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:37.379827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaf71d-789b-4a76-8147-eb800e76dcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:37.380488 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaf71d-789b-4a76-8147-eb800e76dcdf None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:37.380764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaf71d-789b-4a76-8147-eb800e76dcdf None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:37.381032 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaf71d-789b-4a76-8147-eb800e76dcdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:37.381859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eaf71d-789b-4a76-8147-eb800e76dcdf None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=7679b9c9048648c08cf01ca7f0b58d36, user.id=fb65877d975342278528e8527a10dcc5) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:37.382168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eaf71d-789b-4a76-8147-eb800e76dcdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:37.383625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eaf71d-789b-4a76-8147-eb800e76dcdf None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:37.395994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 135/265] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:37 2022] GET /identity/v3/role_assignments?user.id=fb65877d975342278528e8527a10dcc5&scope.project.id=7679b9c9048648c08cf01ca7f0b58d36&role.id=70e67f35994843ae942d4f1703d5619e => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:37.404874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd465b-b543-4c9a-a138-455f03995ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:37.406383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd465b-b543-4c9a-a138-455f03995ce7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:37.406668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd465b-b543-4c9a-a138-455f03995ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:37.406949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd465b-b543-4c9a-a138-455f03995ce7 None admin] PATH_INFO: `/v3/users/fb65877d975342278528e8527a10dcc5` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:37.408475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd465b-b543-4c9a-a138-455f03995ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=fb65877d975342278528e8527a10dcc5)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:37.410002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd465b-b543-4c9a-a138-455f03995ce7 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:37.412240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 131/266] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:37 2022] GET /identity/v3/users/fb65877d975342278528e8527a10dcc5 => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:37.417844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaf71d-789b-4a76-8147-eb800e76dcdf None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:37.568170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaf71d-789b-4a76-8147-eb800e76dcdf None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:37.610962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b01a5-7fd8-4ff7-bfbf-5d32a735aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:37.612060 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b01a5-7fd8-4ff7-bfbf-5d32a735aa3a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:37.612544 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b01a5-7fd8-4ff7-bfbf-5d32a735aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:37.613014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b01a5-7fd8-4ff7-bfbf-5d32a735aa3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:37.688372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b01a5-7fd8-4ff7-bfbf-5d32a735aa3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:37.690633 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b01a5-7fd8-4ff7-bfbf-5d32a735aa3a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:37.796761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 136/267] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:37.801938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd465b-b543-4c9a-a138-455f03995ce7 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:37.927484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c7aa1-9408-4450-b7a3-6fe6f00d745b None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:37.928092 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c7aa1-9408-4450-b7a3-6fe6f00d745b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:37.928591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c7aa1-9408-4450-b7a3-6fe6f00d745b None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:37.930449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 137/268] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:37.936924 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c8068-3c55-46b5-98b6-96ba1abdb85e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:37.937460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c8068-3c55-46b5-98b6-96ba1abdb85e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:37.937936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c8068-3c55-46b5-98b6-96ba1abdb85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:37.955274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd465b-b543-4c9a-a138-455f03995ce7 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:37.973284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b78c8068-3c55-46b5-98b6-96ba1abdb85e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:37.974810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b78c8068-3c55-46b5-98b6-96ba1abdb85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:37.999324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda6f6a-2776-4368-9e2b-ae862bf57063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:38.000209 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6f6a-2776-4368-9e2b-ae862bf57063 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:38.000493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6f6a-2776-4368-9e2b-ae862bf57063 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:38.000768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6f6a-2776-4368-9e2b-ae862bf57063 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:38.002087 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda6f6a-2776-4368-9e2b-ae862bf57063 None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:38.003770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda6f6a-2776-4368-9e2b-ae862bf57063 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:38.011563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 132/269] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:37 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:38.012441 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda6f6a-2776-4368-9e2b-ae862bf57063 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:38.054912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 138/270] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:38.090379 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c8068-3c55-46b5-98b6-96ba1abdb85e None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:38.121404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda6f6a-2776-4368-9e2b-ae862bf57063 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:38.162261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0269a-4818-4b6d-8088-b13d44dd58c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:38.162931 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0269a-4818-4b6d-8088-b13d44dd58c9 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:38.163230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0269a-4818-4b6d-8088-b13d44dd58c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:38.163502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0269a-4818-4b6d-8088-b13d44dd58c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:38.171563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0269a-4818-4b6d-8088-b13d44dd58c9 None admin] RBAC: Adding query filter params (role.id=142e36ee06a7422e8e8d32a1080ea89a, scope.project.id=7679b9c9048648c08cf01ca7f0b58d36, user.id=fb65877d975342278528e8527a10dcc5) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:38.171904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0269a-4818-4b6d-8088-b13d44dd58c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:38.173382 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0269a-4818-4b6d-8088-b13d44dd58c9 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:38.185222 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 133/271] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:38 2022] GET /identity/v3/role_assignments?user.id=fb65877d975342278528e8527a10dcc5&scope.project.id=7679b9c9048648c08cf01ca7f0b58d36&role.id=142e36ee06a7422e8e8d32a1080ea89a => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:38.241091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c8068-3c55-46b5-98b6-96ba1abdb85e None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:38.290067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b5f40-517e-4329-8291-aaa2a8697e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:38.290926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b5f40-517e-4329-8291-aaa2a8697e8d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:38.291225 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b5f40-517e-4329-8291-aaa2a8697e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:38.291499 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b5f40-517e-4329-8291-aaa2a8697e8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:38.292787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b5f40-517e-4329-8291-aaa2a8697e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:38.294251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b5f40-517e-4329-8291-aaa2a8697e8d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:38.300454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 139/272] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:38.314733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0269a-4818-4b6d-8088-b13d44dd58c9 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:38.455045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261e275-d5f4-4ea6-8693-7805967f57b4 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:38.455365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261e275-d5f4-4ea6-8693-7805967f57b4 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:38.455542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261e275-d5f4-4ea6-8693-7805967f57b4 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:38.457372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 140/273] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:34:38.462723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b872d0-c97d-4f78-8f78-a1bba3c67e3d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:38.463012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b872d0-c97d-4f78-8f78-a1bba3c67e3d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:38.463317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b872d0-c97d-4f78-8f78-a1bba3c67e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:38.488238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0269a-4818-4b6d-8088-b13d44dd58c9 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:38.492359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-d2b872d0-c97d-4f78-8f78-a1bba3c67e3d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:38.493562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d2b872d0-c97d-4f78-8f78-a1bba3c67e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:38.543169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d848a-bdae-434a-b4f9-ff356d7f79b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:38.543924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d848a-bdae-434a-b4f9-ff356d7f79b4 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:38.544203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d848a-bdae-434a-b4f9-ff356d7f79b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:38.544477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d848a-bdae-434a-b4f9-ff356d7f79b4 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:38.545194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d848a-bdae-434a-b4f9-ff356d7f79b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:38.547721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d848a-bdae-434a-b4f9-ff356d7f79b4 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:38.578885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 134/274] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:34:38 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:34:38.579068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 141/275] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:38.603019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d848a-bdae-434a-b4f9-ff356d7f79b4 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:38.727699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d848a-bdae-434a-b4f9-ff356d7f79b4 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:38.769002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaa13c-0867-4198-ae5f-48e96cc0ac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:38.769825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaa13c-0867-4198-ae5f-48e96cc0ac81 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:38.770109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaa13c-0867-4198-ae5f-48e96cc0ac81 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:38.770384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaa13c-0867-4198-ae5f-48e96cc0ac81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:38.785205 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eaa13c-0867-4198-ae5f-48e96cc0ac81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-f7eaa13c-0867-4198-ae5f-48e96cc0ac81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:38.793187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:38.794141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:38.794915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 135/276] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:38.804377 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b872d0-c97d-4f78-8f78-a1bba3c67e3d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:38.909351 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332a385-c5e8-4552-8f8f-a22e92b49e8b None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:38.909868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332a385-c5e8-4552-8f8f-a22e92b49e8b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:38.910030 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b872d0-c97d-4f78-8f78-a1bba3c67e3d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:38.910482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332a385-c5e8-4552-8f8f-a22e92b49e8b None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:38.912319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 136/277] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:38.917874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfeb24-c121-4e00-93b3-203fa6871cce None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:38.918163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfeb24-c121-4e00-93b3-203fa6871cce None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:38.918673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfeb24-c121-4e00-93b3-203fa6871cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:38.937189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-45cfeb24-c121-4e00-93b3-203fa6871cce None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:38.938362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-45cfeb24-c121-4e00-93b3-203fa6871cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:38.944846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bccc8-04fc-4a61-ae4b-89d25c7b053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:38.945777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bccc8-04fc-4a61-ae4b-89d25c7b053c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:38.946496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bccc8-04fc-4a61-ae4b-89d25c7b053c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:38.946778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bccc8-04fc-4a61-ae4b-89d25c7b053c None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:38.947560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bccc8-04fc-4a61-ae4b-89d25c7b053c None admin] RBAC: Adding query filter params (name=member) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:38.947866 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bccc8-04fc-4a61-ae4b-89d25c7b053c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:38.949640 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bccc8-04fc-4a61-ae4b-89d25c7b053c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:38.960912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 142/278] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:38.963128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5c187-83d6-4224-ab13-eb5a94cb2193 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:38.963452 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5c187-83d6-4224-ab13-eb5a94cb2193 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:38.963727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5c187-83d6-4224-ab13-eb5a94cb2193 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:38.964961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 143/279] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:38.968686 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5c187-83d6-4224-ab13-eb5a94cb2193 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:39.029639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 137/280] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:39.032857 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ad9d-eced-4172-978e-5c9b96aac8c3 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:39.033656 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ad9d-eced-4172-978e-5c9b96aac8c3 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:39.034137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001ad9d-eced-4172-978e-5c9b96aac8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:39.059251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-9001ad9d-eced-4172-978e-5c9b96aac8c3 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:39.061395 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-9001ad9d-eced-4172-978e-5c9b96aac8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:39.085996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5c187-83d6-4224-ab13-eb5a94cb2193 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:39.136117 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f3804-e50b-4db7-b06d-67dd56a626ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:39.136990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f3804-e50b-4db7-b06d-67dd56a626ce None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:39.137485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f3804-e50b-4db7-b06d-67dd56a626ce None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:39.137735 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 138/281] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:39.137900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f3804-e50b-4db7-b06d-67dd56a626ce None admin] PATH_INFO: `/v3/users/c7360a4fcbb94f0dbb241c38f4217310` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:39.138861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001ad9d-eced-4172-978e-5c9b96aac8c3 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:39.155711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f3804-e50b-4db7-b06d-67dd56a626ce None admin] RBAC: Authorizing `identity:get_user(user_id=c7360a4fcbb94f0dbb241c38f4217310)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:39.158182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f3804-e50b-4db7-b06d-67dd56a626ce None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:39.160091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 144/282] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:38 2022] GET /identity/v3/users/c7360a4fcbb94f0dbb241c38f4217310 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:39.167463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f3804-e50b-4db7-b06d-67dd56a626ce None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:39.263522 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001ad9d-eced-4172-978e-5c9b96aac8c3 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:39.293497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f3804-e50b-4db7-b06d-67dd56a626ce None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:39.315996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c67d8-99a9-4c78-af71-b98163864e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:39.317003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c67d8-99a9-4c78-af71-b98163864e03 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:39.317426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c67d8-99a9-4c78-af71-b98163864e03 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:39.317840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c67d8-99a9-4c78-af71-b98163864e03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:39.329467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c67d8-99a9-4c78-af71-b98163864e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:39.330590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a0115-a461-4bc8-bbbf-bbb4975e4941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:39.331246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a0115-a461-4bc8-bbbf-bbb4975e4941 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:39.331535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a0115-a461-4bc8-bbbf-bbb4975e4941 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:39.331807 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a0115-a461-4bc8-bbbf-bbb4975e4941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:39.332629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a0115-a461-4bc8-bbbf-bbb4975e4941 None admin] RBAC: Adding query filter params (role.id=2f5b0d90f1814fe8a58210b5cd048bf7, user.id=c7360a4fcbb94f0dbb241c38f4217310, scope.system=all) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:39.332935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a0115-a461-4bc8-bbbf-bbb4975e4941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:39.334350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a0115-a461-4bc8-bbbf-bbb4975e4941 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-4b7c67d8-99a9-4c78-af71-b98163864e03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:39.338633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:39.339740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:39.340672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:39.340672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:39.340672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:39.340672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:39.340672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:39.340672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:39.340672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:39.340672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:39.340672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:39.340672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:39.340672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:39.340672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:39.341315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 145/283] 10.222.0.73 () {56 vars in 1308 bytes} [Wed May 4 13:34:39 2022] GET /identity/v3/role_assignments?user.id=c7360a4fcbb94f0dbb241c38f4217310&scope.system=all&role.id=2f5b0d90f1814fe8a58210b5cd048bf7 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:39.341315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a0115-a461-4bc8-bbbf-bbb4975e4941 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:39.348757 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 139/284] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:39.354775 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c67d8-99a9-4c78-af71-b98163864e03 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:39.444191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a0115-a461-4bc8-bbbf-bbb4975e4941 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:39.481553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d354a24-b7b7-411d-b577-46050d69bfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:39.482159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d354a24-b7b7-411d-b577-46050d69bfbc None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:39.482438 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d354a24-b7b7-411d-b577-46050d69bfbc None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:39.482709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d354a24-b7b7-411d-b577-46050d69bfbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:39.497664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d354a24-b7b7-411d-b577-46050d69bfbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-7d354a24-b7b7-411d-b577-46050d69bfbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:39.502448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:39.503612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:39.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 146/285] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:39.511496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d354a24-b7b7-411d-b577-46050d69bfbc None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:39.542002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c67d8-99a9-4c78-af71-b98163864e03 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:39.581145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88adc5-3e69-4c77-81ae-b7e3b705f71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:39.582145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88adc5-3e69-4c77-81ae-b7e3b705f71e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:39.582643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88adc5-3e69-4c77-81ae-b7e3b705f71e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:39.583129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88adc5-3e69-4c77-81ae-b7e3b705f71e None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:39.584107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88adc5-3e69-4c77-81ae-b7e3b705f71e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:39.584607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88adc5-3e69-4c77-81ae-b7e3b705f71e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:39.586246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88adc5-3e69-4c77-81ae-b7e3b705f71e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:39.595672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 140/286] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:39.601675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88adc5-3e69-4c77-81ae-b7e3b705f71e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:39.617422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d354a24-b7b7-411d-b577-46050d69bfbc None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:39.651730 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5778ad-af2c-4f47-8a41-cbf68361f729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:39.652634 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5778ad-af2c-4f47-8a41-cbf68361f729 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:39.653110 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5778ad-af2c-4f47-8a41-cbf68361f729 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:39.653533 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5778ad-af2c-4f47-8a41-cbf68361f729 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:39.654410 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5778ad-af2c-4f47-8a41-cbf68361f729 None admin] RBAC: Adding query filter params (name=member) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:39.654851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5778ad-af2c-4f47-8a41-cbf68361f729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:39.656410 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5778ad-af2c-4f47-8a41-cbf68361f729 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:39.665479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 147/287] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:39.671997 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5778ad-af2c-4f47-8a41-cbf68361f729 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:39.728699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88adc5-3e69-4c77-81ae-b7e3b705f71e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:39.764574 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c95c49-e558-4a66-8109-30f4759f927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:39.765848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c95c49-e558-4a66-8109-30f4759f927b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:39.766352 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c95c49-e558-4a66-8109-30f4759f927b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:39.766817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c95c49-e558-4a66-8109-30f4759f927b None admin] PATH_INFO: `/v3/users/e6af1d78368a49fca74f447e24ea9f3d` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:39.768246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c95c49-e558-4a66-8109-30f4759f927b None admin] RBAC: Authorizing `identity:get_user(user_id=e6af1d78368a49fca74f447e24ea9f3d)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:39.769888 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c95c49-e558-4a66-8109-30f4759f927b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:39.771772 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 141/288] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:39 2022] GET /identity/v3/users/e6af1d78368a49fca74f447e24ea9f3d => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:39.783248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c95c49-e558-4a66-8109-30f4759f927b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:39.821753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5778ad-af2c-4f47-8a41-cbf68361f729 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:39.879583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f70a09-8a3c-4973-9b54-b6ce360cf235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:39.880382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70a09-8a3c-4973-9b54-b6ce360cf235 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:39.880662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70a09-8a3c-4973-9b54-b6ce360cf235 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:39.880937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70a09-8a3c-4973-9b54-b6ce360cf235 None admin] PATH_INFO: `/v3/users/333fc054e1964bbf81dad82467de7a04` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:39.882294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f70a09-8a3c-4973-9b54-b6ce360cf235 None admin] RBAC: Authorizing `identity:get_user(user_id=333fc054e1964bbf81dad82467de7a04)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:39.883776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f70a09-8a3c-4973-9b54-b6ce360cf235 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:39.885394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 148/289] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:39 2022] GET /identity/v3/users/333fc054e1964bbf81dad82467de7a04 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:39.891419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f70a09-8a3c-4973-9b54-b6ce360cf235 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:39.953788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c95c49-e558-4a66-8109-30f4759f927b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:40.004789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f70a09-8a3c-4973-9b54-b6ce360cf235 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:40.011139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1dc0b-d4e3-433d-a8b1-25087183b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:40.012294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1dc0b-d4e3-433d-a8b1-25087183b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:40.012572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1dc0b-d4e3-433d-a8b1-25087183b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:40.012845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1dc0b-d4e3-433d-a8b1-25087183b6c0 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:40.019016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1dc0b-d4e3-433d-a8b1-25087183b6c0 None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:40.020514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1dc0b-d4e3-433d-a8b1-25087183b6c0 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:40.022677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 142/290] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:39 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:40.028851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1dc0b-d4e3-433d-a8b1-25087183b6c0 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:40.055066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3657f2d-4383-4f56-a6e5-94f7465401ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:40.056799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657f2d-4383-4f56-a6e5-94f7465401ad None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:40.059005 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657f2d-4383-4f56-a6e5-94f7465401ad None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:40.059520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657f2d-4383-4f56-a6e5-94f7465401ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:40.150244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1dc0b-d4e3-433d-a8b1-25087183b6c0 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:40.185005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e659-a49e-4655-adc3-6af5b85da1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:40.186786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e659-a49e-4655-adc3-6af5b85da1fa None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:40.187319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e659-a49e-4655-adc3-6af5b85da1fa None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:40.187578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3657f2d-4383-4f56-a6e5-94f7465401ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:40.188024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e659-a49e-4655-adc3-6af5b85da1fa None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36/users/e6af1d78368a49fca74f447e24ea9f3d/roles/dfdbef47aad347cb8de81878442e73f2` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:40.189075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3657f2d-4383-4f56-a6e5-94f7465401ad None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:40.190579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7e659-a49e-4655-adc3-6af5b85da1fa None admin] RBAC: Authorizing `identity:create_grant(project_id=7679b9c9048648c08cf01ca7f0b58d36, user_id=e6af1d78368a49fca74f447e24ea9f3d, role_id=dfdbef47aad347cb8de81878442e73f2)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:40.192308 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7e659-a49e-4655-adc3-6af5b85da1fa None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:40.209058 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 143/291] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:34:40 2022] PUT /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36/users/e6af1d78368a49fca74f447e24ea9f3d/roles/dfdbef47aad347cb8de81878442e73f2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:34:40.370984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 149/292] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:40.377390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e659-a49e-4655-adc3-6af5b85da1fa None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:40.520789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e659-a49e-4655-adc3-6af5b85da1fa None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:40.556459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca7b25-4017-4281-b05d-c34e8f0ebc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:40.557384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7b25-4017-4281-b05d-c34e8f0ebc0c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:40.557660 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7b25-4017-4281-b05d-c34e8f0ebc0c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:40.557929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7b25-4017-4281-b05d-c34e8f0ebc0c None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:40.559149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca7b25-4017-4281-b05d-c34e8f0ebc0c None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:40.560599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca7b25-4017-4281-b05d-c34e8f0ebc0c None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:40.563302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 144/293] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:40 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:40.570088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3657f2d-4383-4f56-a6e5-94f7465401ad None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:40.713856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3657f2d-4383-4f56-a6e5-94f7465401ad None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:40.760865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e47fd1-b517-482a-a221-420b21082006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:40.761956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e47fd1-b517-482a-a221-420b21082006 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:40.762436 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e47fd1-b517-482a-a221-420b21082006 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:40.762906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e47fd1-b517-482a-a221-420b21082006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:40.763966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e47fd1-b517-482a-a221-420b21082006 None admin] RBAC: Adding query filter params (role.id=2f5b0d90f1814fe8a58210b5cd048bf7, scope.project.id=7679b9c9048648c08cf01ca7f0b58d36, user.id=333fc054e1964bbf81dad82467de7a04) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:40.764512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e47fd1-b517-482a-a221-420b21082006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:40.766164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e47fd1-b517-482a-a221-420b21082006 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:40.776179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 150/294] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:40 2022] GET /identity/v3/role_assignments?user.id=333fc054e1964bbf81dad82467de7a04&scope.project.id=7679b9c9048648c08cf01ca7f0b58d36&role.id=2f5b0d90f1814fe8a58210b5cd048bf7 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:41.418936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab42edf-9b63-464c-a745-b2ca9b45c49b None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:41.419477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab42edf-9b63-464c-a745-b2ca9b45c49b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:41.419550 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab42edf-9b63-464c-a745-b2ca9b45c49b None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:41.421582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 145/295] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:41.426954 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8786-526b-40b3-8182-bdd25bce3f76 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:41.427804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8786-526b-40b3-8182-bdd25bce3f76 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:41.428286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8786-526b-40b3-8182-bdd25bce3f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:41.444982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3d17b-a448-4ccd-a384-e2e6ac75e53f None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:41.445859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3d17b-a448-4ccd-a384-e2e6ac75e53f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:41.446358 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3d17b-a448-4ccd-a384-e2e6ac75e53f None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:41.447637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-d76b8786-526b-40b3-8182-bdd25bce3f76 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:41.448288 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 146/296] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:41.449086 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d76b8786-526b-40b3-8182-bdd25bce3f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:41.454321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556ab45-274e-4cb5-a29c-399785f72fa9 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:41.454837 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556ab45-274e-4cb5-a29c-399785f72fa9 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:41.455350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556ab45-274e-4cb5-a29c-399785f72fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:41.473169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d556ab45-274e-4cb5-a29c-399785f72fa9 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:41.474675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d556ab45-274e-4cb5-a29c-399785f72fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:41.540778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 151/297] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:41.553870 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 147/298] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:41.572941 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b8786-526b-40b3-8182-bdd25bce3f76 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:41.580052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556ab45-274e-4cb5-a29c-399785f72fa9 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:41.679362 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b8786-526b-40b3-8182-bdd25bce3f76 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:41.718817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556ab45-274e-4cb5-a29c-399785f72fa9 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:41.720536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035f495-ccd1-4540-946f-53bfceb1ffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:41.722352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035f495-ccd1-4540-946f-53bfceb1ffeb None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:41.722837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035f495-ccd1-4540-946f-53bfceb1ffeb None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:41.723367 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035f495-ccd1-4540-946f-53bfceb1ffeb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:41.724761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035f495-ccd1-4540-946f-53bfceb1ffeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:41.726829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035f495-ccd1-4540-946f-53bfceb1ffeb None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:41.729628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 152/299] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:41.735194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035f495-ccd1-4540-946f-53bfceb1ffeb None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:41.759458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9766d-87db-45eb-9144-8dee9f6b910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:41.760530 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9766d-87db-45eb-9144-8dee9f6b910f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:41.760819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9766d-87db-45eb-9144-8dee9f6b910f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:41.761096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9766d-87db-45eb-9144-8dee9f6b910f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:41.774561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9766d-87db-45eb-9144-8dee9f6b910f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-0fd9766d-87db-45eb-9144-8dee9f6b910f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:41.784934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:41.785821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:41.786609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:41.786609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:41.786609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:41.786609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:41.786609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:41.786609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:41.786609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:41.786609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:41.786609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:41.786609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:41.786609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:41.786609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:41.791139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 148/300] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:41.792016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9766d-87db-45eb-9144-8dee9f6b910f None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:41.841245 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035f495-ccd1-4540-946f-53bfceb1ffeb None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:41.877059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e0f9d-8c2a-48b5-b952-6cf6ea61f414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:41.878127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e0f9d-8c2a-48b5-b952-6cf6ea61f414 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:41.878604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e0f9d-8c2a-48b5-b952-6cf6ea61f414 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:41.879069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e0f9d-8c2a-48b5-b952-6cf6ea61f414 None admin] PATH_INFO: `/v3/groups` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:41.879983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e0f9d-8c2a-48b5-b952-6cf6ea61f414 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:41.881619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e0f9d-8c2a-48b5-b952-6cf6ea61f414 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:41.908113 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 153/301] 10.222.0.73 () {60 vars in 1134 bytes} [Wed May 4 13:34:41 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:34:41.921967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9766d-87db-45eb-9144-8dee9f6b910f None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:41.968121 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40bf3c-b792-43b9-a4f9-4c9f2acfcc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:41.968822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40bf3c-b792-43b9-a4f9-4c9f2acfcc81 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:41.969106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40bf3c-b792-43b9-a4f9-4c9f2acfcc81 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:41.969433 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40bf3c-b792-43b9-a4f9-4c9f2acfcc81 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:41.970272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40bf3c-b792-43b9-a4f9-4c9f2acfcc81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:41.970581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40bf3c-b792-43b9-a4f9-4c9f2acfcc81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:41.972193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40bf3c-b792-43b9-a4f9-4c9f2acfcc81 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:41.984559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 149/302] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:41.990357 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e0f9d-8c2a-48b5-b952-6cf6ea61f414 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:42.095220 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e0f9d-8c2a-48b5-b952-6cf6ea61f414 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:42.131543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39139a-f554-4f45-9a01-146147cef3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:42.131543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39139a-f554-4f45-9a01-146147cef3f7 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:42.131833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39139a-f554-4f45-9a01-146147cef3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:42.132080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39139a-f554-4f45-9a01-146147cef3f7 None admin] PATH_INFO: `/v3/users/a738061cafbb491bb65ace49ec9c5e0b` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:42.149579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39139a-f554-4f45-9a01-146147cef3f7 None admin] RBAC: Authorizing `identity:get_user(user_id=a738061cafbb491bb65ace49ec9c5e0b)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:42.151403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a11afa-ae80-46e9-9e0d-a705a4a1817f None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:42.151743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a11afa-ae80-46e9-9e0d-a705a4a1817f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:42.152017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a11afa-ae80-46e9-9e0d-a705a4a1817f None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:42.152137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39139a-f554-4f45-9a01-146147cef3f7 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:42.153549 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 150/303] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:42.155391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 154/304] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:41 2022] GET /identity/v3/users/a738061cafbb491bb65ace49ec9c5e0b => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:42.159971 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd748d-278e-4374-9370-5aebbecc858d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:42.160477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd748d-278e-4374-9370-5aebbecc858d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:42.160697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39139a-f554-4f45-9a01-146147cef3f7 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:42.161170 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd748d-278e-4374-9370-5aebbecc858d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:42.181031 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-eebd748d-278e-4374-9370-5aebbecc858d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:42.182495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-eebd748d-278e-4374-9370-5aebbecc858d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:42.273435 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39139a-f554-4f45-9a01-146147cef3f7 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:42.275242 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 151/305] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:42.304559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd748d-278e-4374-9370-5aebbecc858d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:42.332496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70c727-70e2-4a20-80c1-969a10bcc029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:42.333906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70c727-70e2-4a20-80c1-969a10bcc029 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:42.334696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70c727-70e2-4a20-80c1-969a10bcc029 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:42.335168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70c727-70e2-4a20-80c1-969a10bcc029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:42.336723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70c727-70e2-4a20-80c1-969a10bcc029 None admin] RBAC: Adding query filter params (role.id=dfdbef47aad347cb8de81878442e73f2, user.id=a738061cafbb491bb65ace49ec9c5e0b, scope.system=all) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:42.337496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70c727-70e2-4a20-80c1-969a10bcc029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:42.339308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70c727-70e2-4a20-80c1-969a10bcc029 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:42.346559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 155/306] 10.222.0.73 () {56 vars in 1308 bytes} [Wed May 4 13:34:42 2022] GET /identity/v3/role_assignments?user.id=a738061cafbb491bb65ace49ec9c5e0b&scope.system=all&role.id=dfdbef47aad347cb8de81878442e73f2 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:42.419623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd748d-278e-4374-9370-5aebbecc858d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:42.458045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da59ce-52d9-4ad7-87bc-475b19da1c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:42.458862 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da59ce-52d9-4ad7-87bc-475b19da1c6c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:42.459144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da59ce-52d9-4ad7-87bc-475b19da1c6c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:42.459451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da59ce-52d9-4ad7-87bc-475b19da1c6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:42.471552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da59ce-52d9-4ad7-87bc-475b19da1c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-c2da59ce-52d9-4ad7-87bc-475b19da1c6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:42.479770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:42.480714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:42.481924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 152/307] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:42.489463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70c727-70e2-4a20-80c1-969a10bcc029 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:42.590158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70c727-70e2-4a20-80c1-969a10bcc029 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:42.625770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5d37b-5f68-4e86-88b5-1c6928470ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:42.626843 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5d37b-5f68-4e86-88b5-1c6928470ff5 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:42.627362 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5d37b-5f68-4e86-88b5-1c6928470ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:42.627851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5d37b-5f68-4e86-88b5-1c6928470ff5 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:42.628821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5d37b-5f68-4e86-88b5-1c6928470ff5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:42.629337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5d37b-5f68-4e86-88b5-1c6928470ff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:42.630952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5d37b-5f68-4e86-88b5-1c6928470ff5 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:42.645829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 156/308] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:42.647610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da59ce-52d9-4ad7-87bc-475b19da1c6c None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:42.747165 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da59ce-52d9-4ad7-87bc-475b19da1c6c None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:42.780676 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d964d-3b71-4f2a-91cf-a1241278c88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:42.781922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d964d-3b71-4f2a-91cf-a1241278c88c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:42.782395 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d964d-3b71-4f2a-91cf-a1241278c88c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:42.782883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d964d-3b71-4f2a-91cf-a1241278c88c None admin] PATH_INFO: `/v3/users/c7360a4fcbb94f0dbb241c38f4217310` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:42.784311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d964d-3b71-4f2a-91cf-a1241278c88c None admin] RBAC: Authorizing `identity:get_user(user_id=c7360a4fcbb94f0dbb241c38f4217310)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:42.786022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d964d-3b71-4f2a-91cf-a1241278c88c None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:42.787873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 153/309] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:42 2022] GET /identity/v3/users/c7360a4fcbb94f0dbb241c38f4217310 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:42.794161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5d37b-5f68-4e86-88b5-1c6928470ff5 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:42.808383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d44678-327e-42cc-89f8-06ad0d4e47e4 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:42.808662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d44678-327e-42cc-89f8-06ad0d4e47e4 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:42.808941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d44678-327e-42cc-89f8-06ad0d4e47e4 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:42.810516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 154/310] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:42.815276 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4d53c-1a70-4eb9-a9cf-07117616ce65 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:42.815731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4d53c-1a70-4eb9-a9cf-07117616ce65 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:42.815835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4d53c-1a70-4eb9-a9cf-07117616ce65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:42.833709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-55d4d53c-1a70-4eb9-a9cf-07117616ce65 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:42.835179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-55d4d53c-1a70-4eb9-a9cf-07117616ce65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:42.914437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 155/311] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:42.918819 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5d37b-5f68-4e86-88b5-1c6928470ff5 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:42.932906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4d53c-1a70-4eb9-a9cf-07117616ce65 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:42.958407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3feae9-1dbf-46cc-8797-481aaba95f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:42.959743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3feae9-1dbf-46cc-8797-481aaba95f47 None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:42.960473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3feae9-1dbf-46cc-8797-481aaba95f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:42.961214 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3feae9-1dbf-46cc-8797-481aaba95f47 None admin] PATH_INFO: `/v3/system/users/c7360a4fcbb94f0dbb241c38f4217310/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:42.963337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3feae9-1dbf-46cc-8797-481aaba95f47 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c7360a4fcbb94f0dbb241c38f4217310, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:42.965128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3feae9-1dbf-46cc-8797-481aaba95f47 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:42.983706 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 157/312] 10.222.0.73 () {58 vars in 1334 bytes} [Wed May 4 13:34:42 2022] PUT /identity/v3/system/users/c7360a4fcbb94f0dbb241c38f4217310/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:34:43.044529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4d53c-1a70-4eb9-a9cf-07117616ce65 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:43.084090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800215d-1035-42af-9138-4e65c109f677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:43.084947 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800215d-1035-42af-9138-4e65c109f677 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:43.085227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800215d-1035-42af-9138-4e65c109f677 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:43.085496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800215d-1035-42af-9138-4e65c109f677 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:43.097403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800215d-1035-42af-9138-4e65c109f677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-5800215d-1035-42af-9138-4e65c109f677 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:43.105643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:43.106588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:43.107986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 156/313] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:43.113293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3feae9-1dbf-46cc-8797-481aaba95f47 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:43.225957 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3feae9-1dbf-46cc-8797-481aaba95f47 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:43.259567 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91305d72-7d4b-41c1-81b5-78beb6642b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:43.260227 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91305d72-7d4b-41c1-81b5-78beb6642b32 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:43.260505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91305d72-7d4b-41c1-81b5-78beb6642b32 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:43.260775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91305d72-7d4b-41c1-81b5-78beb6642b32 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:43.261513 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91305d72-7d4b-41c1-81b5-78beb6642b32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:43.261815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91305d72-7d4b-41c1-81b5-78beb6642b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:43.263172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91305d72-7d4b-41c1-81b5-78beb6642b32 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:43.275587 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 158/314] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:43.277109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800215d-1035-42af-9138-4e65c109f677 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:43.384409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800215d-1035-42af-9138-4e65c109f677 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:43.417647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b1e1-61b4-4a1a-81bf-c31056c1de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:43.418861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b1e1-61b4-4a1a-81bf-c31056c1de78 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:43.419380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b1e1-61b4-4a1a-81bf-c31056c1de78 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:43.419869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1b1e1-61b4-4a1a-81bf-c31056c1de78 None admin] PATH_INFO: `/v3/users/e6af1d78368a49fca74f447e24ea9f3d` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:43.422244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1b1e1-61b4-4a1a-81bf-c31056c1de78 None admin] RBAC: Authorizing `identity:get_user(user_id=e6af1d78368a49fca74f447e24ea9f3d)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:43.423886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1b1e1-61b4-4a1a-81bf-c31056c1de78 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:43.425691 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 157/315] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:43 2022] GET /identity/v3/users/e6af1d78368a49fca74f447e24ea9f3d => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:43.432564 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91305d72-7d4b-41c1-81b5-78beb6642b32 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:43.528879 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91305d72-7d4b-41c1-81b5-78beb6642b32 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:43.565585 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569d84a-b7a1-4344-9912-d06b0c765110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:43.566226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569d84a-b7a1-4344-9912-d06b0c765110 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:43.566504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569d84a-b7a1-4344-9912-d06b0c765110 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:43.566779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569d84a-b7a1-4344-9912-d06b0c765110 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:43.631936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569d84a-b7a1-4344-9912-d06b0c765110 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:43.633404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569d84a-b7a1-4344-9912-d06b0c765110 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:43.727367 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 159/316] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:43.732923 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b1e1-61b4-4a1a-81bf-c31056c1de78 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:43.830126 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1b1e1-61b4-4a1a-81bf-c31056c1de78 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:43.862749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4040fdb-528c-48e0-a1b5-5c4108e8c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:43.863635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4040fdb-528c-48e0-a1b5-5c4108e8c52d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:43.863961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4040fdb-528c-48e0-a1b5-5c4108e8c52d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:43.864245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4040fdb-528c-48e0-a1b5-5c4108e8c52d None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:43.865411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4040fdb-528c-48e0-a1b5-5c4108e8c52d None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:43.866835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4040fdb-528c-48e0-a1b5-5c4108e8c52d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:43.868875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 158/317] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:43 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:43.874678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569d84a-b7a1-4344-9912-d06b0c765110 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:43.981439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569d84a-b7a1-4344-9912-d06b0c765110 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:44.015537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dd673-47a5-4fab-b5c8-b13b53e80609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:44.016194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dd673-47a5-4fab-b5c8-b13b53e80609 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:44.016476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dd673-47a5-4fab-b5c8-b13b53e80609 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:44.016750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dd673-47a5-4fab-b5c8-b13b53e80609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:44.017585 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dd673-47a5-4fab-b5c8-b13b53e80609 None admin] RBAC: Adding query filter params (role.id=dfdbef47aad347cb8de81878442e73f2, scope.project.id=7679b9c9048648c08cf01ca7f0b58d36, user.id=e6af1d78368a49fca74f447e24ea9f3d) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:44.017895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dd673-47a5-4fab-b5c8-b13b53e80609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:44.019367 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dd673-47a5-4fab-b5c8-b13b53e80609 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:44.025371 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 160/318] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:34:43 2022] GET /identity/v3/role_assignments?user.id=e6af1d78368a49fca74f447e24ea9f3d&scope.project.id=7679b9c9048648c08cf01ca7f0b58d36&role.id=dfdbef47aad347cb8de81878442e73f2 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:44.327963 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47961e-607e-49e7-a437-93fad6cfadda None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:44.328256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47961e-607e-49e7-a437-93fad6cfadda None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:44.328532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47961e-607e-49e7-a437-93fad6cfadda None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:44.330036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 159/319] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:44.334853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e4ec2-d9cc-434e-8467-f08aff2b59ee None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:44.335142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e4ec2-d9cc-434e-8467-f08aff2b59ee None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:44.335455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e4ec2-d9cc-434e-8467-f08aff2b59ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:44.352044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-119e4ec2-d9cc-434e-8467-f08aff2b59ee None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:44.353208 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-119e4ec2-d9cc-434e-8467-f08aff2b59ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:44.415579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 161/320] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:44.437977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47961e-607e-49e7-a437-93fad6cfadda None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:44.537239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47961e-607e-49e7-a437-93fad6cfadda None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:44.573622 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9587f-16ce-492c-9b72-c99dc12c934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:44.574337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9587f-16ce-492c-9b72-c99dc12c934e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:44.574618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9587f-16ce-492c-9b72-c99dc12c934e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:44.574894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9587f-16ce-492c-9b72-c99dc12c934e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:44.576073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9587f-16ce-492c-9b72-c99dc12c934e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:44.578126 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9587f-16ce-492c-9b72-c99dc12c934e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:44.579930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 160/321] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:34:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:44.585179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e4ec2-d9cc-434e-8467-f08aff2b59ee None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:44.682390 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e4ec2-d9cc-434e-8467-f08aff2b59ee None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:44.715558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081458dc-c85f-41c2-8584-f9f741a10dbf None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:44.715852 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081458dc-c85f-41c2-8584-f9f741a10dbf None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:44.716136 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081458dc-c85f-41c2-8584-f9f741a10dbf None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:44.717513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 161/322] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:34:44.720447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad59bf9-f9e9-4eee-8f25-5e2108b1336a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:44.721110 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59bf9-f9e9-4eee-8f25-5e2108b1336a None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:44.721462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59bf9-f9e9-4eee-8f25-5e2108b1336a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:44.721738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59bf9-f9e9-4eee-8f25-5e2108b1336a None admin] PATH_INFO: `/v3/groups` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:44.722434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad59bf9-f9e9-4eee-8f25-5e2108b1336a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:44.723032 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c5618-579e-4903-93fd-22ead971896f None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:44.723521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c5618-579e-4903-93fd-22ead971896f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:44.723901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad59bf9-f9e9-4eee-8f25-5e2108b1336a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:44.724172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c5618-579e-4903-93fd-22ead971896f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:44.738374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 162/323] 10.222.0.73 () {60 vars in 1134 bytes} [Wed May 4 13:34:44 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:34:44.742959 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-104c5618-579e-4903-93fd-22ead971896f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:44.744430 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-104c5618-579e-4903-93fd-22ead971896f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:44.817746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 162/324] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:44.840341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad59bf9-f9e9-4eee-8f25-5e2108b1336a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:44.947705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad59bf9-f9e9-4eee-8f25-5e2108b1336a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:44.980333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03767942-c180-40b3-9b01-32f420689782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:44.981486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03767942-c180-40b3-9b01-32f420689782 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:44.981914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03767942-c180-40b3-9b01-32f420689782 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:44.982318 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03767942-c180-40b3-9b01-32f420689782 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:44.992856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03767942-c180-40b3-9b01-32f420689782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-03767942-c180-40b3-9b01-32f420689782 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:45.001307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:45.002381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:45.003386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:45.003386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:45.003386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:45.003386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:45.003386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:45.003386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:45.003386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:45.003386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:45.003386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:45.003386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:45.003386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:45.003386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:45.005690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 163/325] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:45.012443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c5618-579e-4903-93fd-22ead971896f None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:45.125956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c5618-579e-4903-93fd-22ead971896f None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:45.161880 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99ca97-31be-4d11-adb2-d94eaf5adec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:45.162561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99ca97-31be-4d11-adb2-d94eaf5adec8 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:45.162843 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99ca97-31be-4d11-adb2-d94eaf5adec8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:45.163121 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99ca97-31be-4d11-adb2-d94eaf5adec8 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:45.163902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99ca97-31be-4d11-adb2-d94eaf5adec8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:45.164209 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99ca97-31be-4d11-adb2-d94eaf5adec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:45.165572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99ca97-31be-4d11-adb2-d94eaf5adec8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:45.175524 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 163/326] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:45.181038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03767942-c180-40b3-9b01-32f420689782 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:45.304889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03767942-c180-40b3-9b01-32f420689782 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:45.341885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3a7a6-fc88-498a-b048-43be2020ef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:45.343061 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3a7a6-fc88-498a-b048-43be2020ef90 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:45.343508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3a7a6-fc88-498a-b048-43be2020ef90 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:45.343921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3a7a6-fc88-498a-b048-43be2020ef90 None admin] PATH_INFO: `/v3/users/a738061cafbb491bb65ace49ec9c5e0b` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:45.345276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3a7a6-fc88-498a-b048-43be2020ef90 None admin] RBAC: Authorizing `identity:get_user(user_id=a738061cafbb491bb65ace49ec9c5e0b)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:45.346955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3a7a6-fc88-498a-b048-43be2020ef90 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:45.353532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 164/327] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:45 2022] GET /identity/v3/users/a738061cafbb491bb65ace49ec9c5e0b => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:45.355073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99ca97-31be-4d11-adb2-d94eaf5adec8 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:45.383885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50955e75-e237-4b3a-84b7-6c4893a09c13 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:45.384375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50955e75-e237-4b3a-84b7-6c4893a09c13 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:45.384793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50955e75-e237-4b3a-84b7-6c4893a09c13 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:45.386575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 165/328] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:34:45.392479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352cf9-512e-46dd-8fcc-163e81eada21 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:45.393094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352cf9-512e-46dd-8fcc-163e81eada21 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:45.393515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f352cf9-512e-46dd-8fcc-163e81eada21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:45.415799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6f352cf9-512e-46dd-8fcc-163e81eada21 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:45.419469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6f352cf9-512e-46dd-8fcc-163e81eada21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:45.474639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99ca97-31be-4d11-adb2-d94eaf5adec8 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:45.508408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 166/329] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:45.526627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12220c6b-b2d9-41e7-a292-67ce04e07948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:45.527960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12220c6b-b2d9-41e7-a292-67ce04e07948 None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:45.528469 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12220c6b-b2d9-41e7-a292-67ce04e07948 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:45.528939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12220c6b-b2d9-41e7-a292-67ce04e07948 None admin] PATH_INFO: `/v3/system/users/a738061cafbb491bb65ace49ec9c5e0b/roles/dfdbef47aad347cb8de81878442e73f2` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:45.531265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12220c6b-b2d9-41e7-a292-67ce04e07948 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a738061cafbb491bb65ace49ec9c5e0b, role_id=dfdbef47aad347cb8de81878442e73f2)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:45.532826 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12220c6b-b2d9-41e7-a292-67ce04e07948 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:45.534983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352cf9-512e-46dd-8fcc-163e81eada21 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:45.557844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 164/330] 10.222.0.73 () {58 vars in 1334 bytes} [Wed May 4 13:34:45 2022] PUT /identity/v3/system/users/a738061cafbb491bb65ace49ec9c5e0b/roles/dfdbef47aad347cb8de81878442e73f2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:34:45.648716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f352cf9-512e-46dd-8fcc-163e81eada21 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:45.686318 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06888599-4d9b-4de7-a343-5e1b48ec4c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:45.687130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06888599-4d9b-4de7-a343-5e1b48ec4c49 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:45.687441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06888599-4d9b-4de7-a343-5e1b48ec4c49 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:45.687711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06888599-4d9b-4de7-a343-5e1b48ec4c49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:45.699827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06888599-4d9b-4de7-a343-5e1b48ec4c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-06888599-4d9b-4de7-a343-5e1b48ec4c49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:45.708238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:45.709248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:45.710636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 167/331] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:45.715289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12220c6b-b2d9-41e7-a292-67ce04e07948 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:45.820929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12220c6b-b2d9-41e7-a292-67ce04e07948 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:45.854217 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2afdc-8120-4a01-a9c6-8c5a3b25dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:45.854878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2afdc-8120-4a01-a9c6-8c5a3b25dc7a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:45.855158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2afdc-8120-4a01-a9c6-8c5a3b25dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:45.855454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2afdc-8120-4a01-a9c6-8c5a3b25dc7a None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:45.856200 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2afdc-8120-4a01-a9c6-8c5a3b25dc7a None admin] RBAC: Adding query filter params (name=member) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:45.856500 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2afdc-8120-4a01-a9c6-8c5a3b25dc7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:45.858394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2afdc-8120-4a01-a9c6-8c5a3b25dc7a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:45.867022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 165/332] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:45.872411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06888599-4d9b-4de7-a343-5e1b48ec4c49 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:45.973475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06888599-4d9b-4de7-a343-5e1b48ec4c49 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:46.012944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72ea75-c7d1-4017-8479-e77d5b0996ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:46.013812 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72ea75-c7d1-4017-8479-e77d5b0996ac None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:46.014089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72ea75-c7d1-4017-8479-e77d5b0996ac None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:46.014394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72ea75-c7d1-4017-8479-e77d5b0996ac None admin] PATH_INFO: `/v3/users/c7360a4fcbb94f0dbb241c38f4217310` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:46.019893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72ea75-c7d1-4017-8479-e77d5b0996ac None admin] RBAC: Authorizing `identity:get_user(user_id=c7360a4fcbb94f0dbb241c38f4217310)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:46.021407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72ea75-c7d1-4017-8479-e77d5b0996ac None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:46.023322 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 168/333] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:45 2022] GET /identity/v3/users/c7360a4fcbb94f0dbb241c38f4217310 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:46.028705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2afdc-8120-4a01-a9c6-8c5a3b25dc7a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:46.134990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2afdc-8120-4a01-a9c6-8c5a3b25dc7a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:46.168461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1b22c-15de-4765-a714-e4b63b866acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:46.169110 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1b22c-15de-4765-a714-e4b63b866acb None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:46.169388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1b22c-15de-4765-a714-e4b63b866acb None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:46.169660 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1b22c-15de-4765-a714-e4b63b866acb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:46.170520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1b22c-15de-4765-a714-e4b63b866acb None admin] RBAC: Adding query filter params (role.id=2f5b0d90f1814fe8a58210b5cd048bf7, user.id=c7360a4fcbb94f0dbb241c38f4217310, scope.system=all) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:46.170828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1b22c-15de-4765-a714-e4b63b866acb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:46.172281 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1b22c-15de-4765-a714-e4b63b866acb None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:46.184494 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 166/334] 10.222.0.73 () {56 vars in 1308 bytes} [Wed May 4 13:34:46 2022] GET /identity/v3/role_assignments?user.id=c7360a4fcbb94f0dbb241c38f4217310&scope.system=all&role.id=2f5b0d90f1814fe8a58210b5cd048bf7 => generated 510 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:47.803035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf4d4d-a256-4a9a-b4ad-9df65986eda8 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:47.804075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf4d4d-a256-4a9a-b4ad-9df65986eda8 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:47.804558 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf4d4d-a256-4a9a-b4ad-9df65986eda8 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:47.806380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 169/335] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:47.816630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7606d3-d98b-4d39-846e-1ff1be18fdf4 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:47.817526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7606d3-d98b-4d39-846e-1ff1be18fdf4 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:47.817996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7606d3-d98b-4d39-846e-1ff1be18fdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:47.844212 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ef7606d3-d98b-4d39-846e-1ff1be18fdf4 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:47.845411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ef7606d3-d98b-4d39-846e-1ff1be18fdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:47.933710 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 167/336] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:47.977562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf4d4d-a256-4a9a-b4ad-9df65986eda8 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:48.097042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf4d4d-a256-4a9a-b4ad-9df65986eda8 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:48.137362 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d66579-8358-45dc-8e69-ad7f23e8eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:48.138529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d66579-8358-45dc-8e69-ad7f23e8eaaf None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:48.139030 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d66579-8358-45dc-8e69-ad7f23e8eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:48.140165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d66579-8358-45dc-8e69-ad7f23e8eaaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:48.151766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d66579-8358-45dc-8e69-ad7f23e8eaaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-d8d66579-8358-45dc-8e69-ad7f23e8eaaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:48.159775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:48.160665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:48.161455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:48.161455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:48.161455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:48.161455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:48.161455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:48.161455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:48.161455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:48.161455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:48.161455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:48.161455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:48.161455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:48.161455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:48.164294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 170/337] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:48.169661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7606d3-d98b-4d39-846e-1ff1be18fdf4 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:48.336427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7606d3-d98b-4d39-846e-1ff1be18fdf4 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:48.383242 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c3ae4-9b31-4a35-9691-e03abb0ab9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:48.383775 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c3ae4-9b31-4a35-9691-e03abb0ab9da None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:48.384058 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c3ae4-9b31-4a35-9691-e03abb0ab9da None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:48.384336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c3ae4-9b31-4a35-9691-e03abb0ab9da None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:48.385090 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed845b-26bd-4756-a918-e05e237542d6 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:48.385220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c3ae4-9b31-4a35-9691-e03abb0ab9da None admin] RBAC: Adding query filter params (name=member) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:48.385409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c3ae4-9b31-4a35-9691-e03abb0ab9da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:48.385890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed845b-26bd-4756-a918-e05e237542d6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:48.386366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed845b-26bd-4756-a918-e05e237542d6 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:48.386759 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c3ae4-9b31-4a35-9691-e03abb0ab9da None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:48.390122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 171/338] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:48.394745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a54fc2-9f44-41e2-8f67-ef193a5f23a6 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:48.395358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a54fc2-9f44-41e2-8f67-ef193a5f23a6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:48.395832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a54fc2-9f44-41e2-8f67-ef193a5f23a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:48.396598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 168/339] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:48.402064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c3ae4-9b31-4a35-9691-e03abb0ab9da None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:48.416439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-03a54fc2-9f44-41e2-8f67-ef193a5f23a6 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:48.417988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-03a54fc2-9f44-41e2-8f67-ef193a5f23a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:48.517966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c3ae4-9b31-4a35-9691-e03abb0ab9da None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:48.526012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 172/340] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:48.558643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d85e7e-6bd9-4605-9f59-afa24e3a6aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:48.559569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d85e7e-6bd9-4605-9f59-afa24e3a6aa3 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:48.560017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d85e7e-6bd9-4605-9f59-afa24e3a6aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:48.560437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d85e7e-6bd9-4605-9f59-afa24e3a6aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:48.562215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a54fc2-9f44-41e2-8f67-ef193a5f23a6 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:48.662155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d85e7e-6bd9-4605-9f59-afa24e3a6aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:48.667765 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d85e7e-6bd9-4605-9f59-afa24e3a6aa3 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:48.754895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a54fc2-9f44-41e2-8f67-ef193a5f23a6 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:48.781579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 169/341] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:34:48.787186 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d85e7e-6bd9-4605-9f59-afa24e3a6aa3 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:48.827925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c02fd-8593-4b15-a8f5-463c5b0e1a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:48.829418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c02fd-8593-4b15-a8f5-463c5b0e1a50 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:48.829928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c02fd-8593-4b15-a8f5-463c5b0e1a50 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:48.830411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c02fd-8593-4b15-a8f5-463c5b0e1a50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:48.848100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c02fd-8593-4b15-a8f5-463c5b0e1a50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-051c02fd-8593-4b15-a8f5-463c5b0e1a50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:48.860674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:48.861600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:48.862369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:48.862369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:48.862369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:48.862369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:48.862369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:48.862369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:48.862369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:48.862369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:48.862369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:48.862369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:48.862369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:48.862369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:48.866086 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 173/342] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:34:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:48.870967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c02fd-8593-4b15-a8f5-463c5b0e1a50 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:48.969732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d85e7e-6bd9-4605-9f59-afa24e3a6aa3 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:49.002296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c02fd-8593-4b15-a8f5-463c5b0e1a50 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:49.004812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc7e85-6f4b-4d0e-be41-c69267dfc39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:49.005728 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc7e85-6f4b-4d0e-be41-c69267dfc39d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.006018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc7e85-6f4b-4d0e-be41-c69267dfc39d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.006291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc7e85-6f4b-4d0e-be41-c69267dfc39d None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.007506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc7e85-6f4b-4d0e-be41-c69267dfc39d None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:49.008934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc7e85-6f4b-4d0e-be41-c69267dfc39d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:49.010933 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 170/343] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:48 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:49.012161 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79695b58-dc58-4e40-b028-800f18eddd4d None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.012445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79695b58-dc58-4e40-b028-800f18eddd4d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.012721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79695b58-dc58-4e40-b028-800f18eddd4d None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.014005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 171/344] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:49.015675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc42f8-bd2f-4c5d-94e3-fb011ab9c07c None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.015944 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc42f8-bd2f-4c5d-94e3-fb011ab9c07c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.016371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc42f8-bd2f-4c5d-94e3-fb011ab9c07c None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.018000 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 172/345] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:49.018855 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc42f8-bd2f-4c5d-94e3-fb011ab9c07c None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:49.041529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16656ce9-a914-4d0e-8518-3f4c4406ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:49.042210 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656ce9-a914-4d0e-8518-3f4c4406ed59 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.042701 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656ce9-a914-4d0e-8518-3f4c4406ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.043160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16656ce9-a914-4d0e-8518-3f4c4406ed59 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.044149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16656ce9-a914-4d0e-8518-3f4c4406ed59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:49.044683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16656ce9-a914-4d0e-8518-3f4c4406ed59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:49.046341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16656ce9-a914-4d0e-8518-3f4c4406ed59 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:49.060809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 174/346] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:34:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:49.062952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04341-7f87-41de-9791-f830f7e2cf74 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.063445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04341-7f87-41de-9791-f830f7e2cf74 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.063924 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04341-7f87-41de-9791-f830f7e2cf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.082128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-67b04341-7f87-41de-9791-f830f7e2cf74 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:49.083634 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-67b04341-7f87-41de-9791-f830f7e2cf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:49.130027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc42f8-bd2f-4c5d-94e3-fb011ab9c07c None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:49.157980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 175/347] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:49.159601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc8039-0c1a-459a-8857-4cade711d54f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.160071 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc8039-0c1a-459a-8857-4cade711d54f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.160523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc8039-0c1a-459a-8857-4cade711d54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.169807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40c892-c14e-4a3f-be87-5b6a3d81e446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:49.170950 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40c892-c14e-4a3f-be87-5b6a3d81e446 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.171426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40c892-c14e-4a3f-be87-5b6a3d81e446 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.171845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40c892-c14e-4a3f-be87-5b6a3d81e446 None admin] PATH_INFO: `/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.178870 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40c892-c14e-4a3f-be87-5b6a3d81e446 None admin] RBAC: Authorizing `identity:get_group(group_id=fd1b13ec40364c0d8725b3e3c55f7439)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:49.180556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40c892-c14e-4a3f-be87-5b6a3d81e446 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:49.182389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 173/348] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:49 2022] GET /identity/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:49.183359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40c892-c14e-4a3f-be87-5b6a3d81e446 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:49.183553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-78dc8039-0c1a-459a-8857-4cade711d54f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:49.185132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-78dc8039-0c1a-459a-8857-4cade711d54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:49.256149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 176/349] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:49.257093 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc8039-0c1a-459a-8857-4cade711d54f None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:49.288644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40c892-c14e-4a3f-be87-5b6a3d81e446 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:49.330595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf1e3e-6936-4fa5-9fef-99776357d93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:49.331562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf1e3e-6936-4fa5-9fef-99776357d93b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.332038 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf1e3e-6936-4fa5-9fef-99776357d93b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.332477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf1e3e-6936-4fa5-9fef-99776357d93b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.384316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc8039-0c1a-459a-8857-4cade711d54f None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:49.407523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf1e3e-6936-4fa5-9fef-99776357d93b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:49.409204 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf1e3e-6936-4fa5-9fef-99776357d93b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:49.419355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296274e4-bb38-41b2-bd7d-3a18939c0caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:49.420400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296274e4-bb38-41b2-bd7d-3a18939c0caf None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.420915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296274e4-bb38-41b2-bd7d-3a18939c0caf None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.421434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296274e4-bb38-41b2-bd7d-3a18939c0caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.422516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296274e4-bb38-41b2-bd7d-3a18939c0caf None admin] RBAC: Adding query filter params (group.id=fd1b13ec40364c0d8725b3e3c55f7439, role.id=2f5b0d90f1814fe8a58210b5cd048bf7, scope.project.id=8f60414b09e148d391f54308214c18a7) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:49.423028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296274e4-bb38-41b2-bd7d-3a18939c0caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:49.424721 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296274e4-bb38-41b2-bd7d-3a18939c0caf None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:49.430956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 177/350] 10.222.0.73 () {56 vars in 1376 bytes} [Wed May 4 13:34:49 2022] GET /identity/v3/role_assignments?group.id=fd1b13ec40364c0d8725b3e3c55f7439&scope.project.id=8f60414b09e148d391f54308214c18a7&role.id=2f5b0d90f1814fe8a58210b5cd048bf7 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:49.432059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296274e4-bb38-41b2-bd7d-3a18939c0caf None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:49.565847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 174/351] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:49.566653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf1e3e-6936-4fa5-9fef-99776357d93b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:49.577521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296274e4-bb38-41b2-bd7d-3a18939c0caf None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:49.645385 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54451cfe-029d-4813-b930-0eb6b3751ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:49.646208 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54451cfe-029d-4813-b930-0eb6b3751ec0 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.646482 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54451cfe-029d-4813-b930-0eb6b3751ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.646758 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54451cfe-029d-4813-b930-0eb6b3751ec0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.667715 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54451cfe-029d-4813-b930-0eb6b3751ec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-54451cfe-029d-4813-b930-0eb6b3751ec0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:49.678052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:49.679674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:49.681053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:49.681053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:49.681053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:49.681053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:49.681053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:49.681053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:49.681053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:49.681053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:49.681053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:49.681053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:49.681053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 13:34:49.681053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:49.687200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 178/352] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:49.687200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54451cfe-029d-4813-b930-0eb6b3751ec0 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:49.742895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf1e3e-6936-4fa5-9fef-99776357d93b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:49.781050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfa6e7-c16e-4730-998d-b6a98e3fbea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:49.781857 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfa6e7-c16e-4730-998d-b6a98e3fbea6 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.782133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfa6e7-c16e-4730-998d-b6a98e3fbea6 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.782405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfa6e7-c16e-4730-998d-b6a98e3fbea6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.794052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfa6e7-c16e-4730-998d-b6a98e3fbea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-c9bfa6e7-c16e-4730-998d-b6a98e3fbea6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:49.801822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:49.803996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:49.806089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 175/353] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:49.807752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54451cfe-029d-4813-b930-0eb6b3751ec0 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:49.807899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfa6e7-c16e-4730-998d-b6a98e3fbea6 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:49.842441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727794a-be5d-4f02-8771-6dc5f896b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:49.843305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727794a-be5d-4f02-8771-6dc5f896b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.843583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727794a-be5d-4f02-8771-6dc5f896b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.843848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727794a-be5d-4f02-8771-6dc5f896b0e5 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.846338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727794a-be5d-4f02-8771-6dc5f896b0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:49.848246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727794a-be5d-4f02-8771-6dc5f896b0e5 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:49.850036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 179/354] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:49 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:49.851854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727794a-be5d-4f02-8771-6dc5f896b0e5 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:49.907176 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfa6e7-c16e-4730-998d-b6a98e3fbea6 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:49.941366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586900ef-e9d1-433f-a9f6-bc2876adeda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:49.942038 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586900ef-e9d1-433f-a9f6-bc2876adeda3 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.942316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586900ef-e9d1-433f-a9f6-bc2876adeda3 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.942590 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586900ef-e9d1-433f-a9f6-bc2876adeda3 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.943386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586900ef-e9d1-433f-a9f6-bc2876adeda3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:49.943694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586900ef-e9d1-433f-a9f6-bc2876adeda3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:49.945068 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586900ef-e9d1-433f-a9f6-bc2876adeda3 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:49.954609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 176/355] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:49.955996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc6f6-6051-46ec-bf53-8f42f40f2864 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.956292 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc6f6-6051-46ec-bf53-8f42f40f2864 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.956571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fc6f6-6051-46ec-bf53-8f42f40f2864 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.957258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727794a-be5d-4f02-8771-6dc5f896b0e5 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:49.957807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 177/356] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:49.958497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fc6f6-6051-46ec-bf53-8f42f40f2864 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:49.995016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a59e1b-cca6-4cc2-9733-8a340caacc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:49.995716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59e1b-cca6-4cc2-9733-8a340caacc98 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:49.995995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59e1b-cca6-4cc2-9733-8a340caacc98 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:49.996271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59e1b-cca6-4cc2-9733-8a340caacc98 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:49.997014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a59e1b-cca6-4cc2-9733-8a340caacc98 None admin] RBAC: Adding query filter params (name=member) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:49.997315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a59e1b-cca6-4cc2-9733-8a340caacc98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:49.999379 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a59e1b-cca6-4cc2-9733-8a340caacc98 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:50.008607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 180/357] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:50.010262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28756dc-7eed-43f2-a760-992ccf275abc None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.010556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28756dc-7eed-43f2-a760-992ccf275abc None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.010833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28756dc-7eed-43f2-a760-992ccf275abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:50.029825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-c28756dc-7eed-43f2-a760-992ccf275abc None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:50.031134 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c28756dc-7eed-43f2-a760-992ccf275abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:50.068677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fc6f6-6051-46ec-bf53-8f42f40f2864 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:50.102106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 181/358] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:50.102947 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28756dc-7eed-43f2-a760-992ccf275abc None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:50.103724 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e079105-5373-45d2-af38-d0b9d60df731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:50.104587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e079105-5373-45d2-af38-d0b9d60df731 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.104919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e079105-5373-45d2-af38-d0b9d60df731 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.105195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e079105-5373-45d2-af38-d0b9d60df731 None admin] PATH_INFO: `/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:50.106359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e079105-5373-45d2-af38-d0b9d60df731 None admin] RBAC: Authorizing `identity:get_group(group_id=fd1b13ec40364c0d8725b3e3c55f7439)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:50.108364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e079105-5373-45d2-af38-d0b9d60df731 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:50.110222 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 178/359] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:49 2022] GET /identity/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:50.110986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e079105-5373-45d2-af38-d0b9d60df731 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:50.207404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28756dc-7eed-43f2-a760-992ccf275abc None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:50.212788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e079105-5373-45d2-af38-d0b9d60df731 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:50.241184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bdc1e-f07b-45a0-87be-580847c49e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:50.242112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bdc1e-f07b-45a0-87be-580847c49e2b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.242387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bdc1e-f07b-45a0-87be-580847c49e2b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.242652 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bdc1e-f07b-45a0-87be-580847c49e2b None admin] PATH_INFO: `/v3/users/a738061cafbb491bb65ace49ec9c5e0b` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:50.243982 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bdc1e-f07b-45a0-87be-580847c49e2b None admin] RBAC: Authorizing `identity:get_user(user_id=a738061cafbb491bb65ace49ec9c5e0b)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:50.245366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bdc1e-f07b-45a0-87be-580847c49e2b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:50.246812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b76b4-fe1c-46ec-b5bf-4a8e6a337039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:50.247436 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 182/360] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:34:50 2022] GET /identity/v3/users/a738061cafbb491bb65ace49ec9c5e0b => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:50.247599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b76b4-fe1c-46ec-b5bf-4a8e6a337039 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.247783 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b76b4-fe1c-46ec-b5bf-4a8e6a337039 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.248114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b76b4-fe1c-46ec-b5bf-4a8e6a337039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:50.248289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bdc1e-f07b-45a0-87be-580847c49e2b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:50.321197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b76b4-fe1c-46ec-b5bf-4a8e6a337039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:50.322110 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b76b4-fe1c-46ec-b5bf-4a8e6a337039 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:50.364535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bdc1e-f07b-45a0-87be-580847c49e2b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:50.398447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74219e3a-6c28-4ab9-8c5d-47ddd05d1fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:50.399155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74219e3a-6c28-4ab9-8c5d-47ddd05d1fbc None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.399475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74219e3a-6c28-4ab9-8c5d-47ddd05d1fbc None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.399745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74219e3a-6c28-4ab9-8c5d-47ddd05d1fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:50.400616 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74219e3a-6c28-4ab9-8c5d-47ddd05d1fbc None admin] RBAC: Adding query filter params (group.id=fd1b13ec40364c0d8725b3e3c55f7439, role.id=142e36ee06a7422e8e8d32a1080ea89a, scope.project.id=8f60414b09e148d391f54308214c18a7) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:50.400924 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74219e3a-6c28-4ab9-8c5d-47ddd05d1fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:50.402335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74219e3a-6c28-4ab9-8c5d-47ddd05d1fbc None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:50.408495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 183/361] 10.222.0.73 () {56 vars in 1376 bytes} [Wed May 4 13:34:50 2022] GET /identity/v3/role_assignments?group.id=fd1b13ec40364c0d8725b3e3c55f7439&scope.project.id=8f60414b09e148d391f54308214c18a7&role.id=142e36ee06a7422e8e8d32a1080ea89a => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:50.409395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74219e3a-6c28-4ab9-8c5d-47ddd05d1fbc None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:50.426812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 179/362] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:50.427700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b76b4-fe1c-46ec-b5bf-4a8e6a337039 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:50.514955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74219e3a-6c28-4ab9-8c5d-47ddd05d1fbc None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:50.535673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b76b4-fe1c-46ec-b5bf-4a8e6a337039 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:50.554570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571ab20-89ba-49b5-9591-54323322202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:50.555381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ab20-89ba-49b5-9591-54323322202a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.555656 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ab20-89ba-49b5-9591-54323322202a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.555987 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571ab20-89ba-49b5-9591-54323322202a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:50.568618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571ab20-89ba-49b5-9591-54323322202a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:50.573414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9bbd6-1c83-4622-8b3d-c4e7d233d0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:50.574073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9bbd6-1c83-4622-8b3d-c4e7d233d0a7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.574426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9bbd6-1c83-4622-8b3d-c4e7d233d0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.574708 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9bbd6-1c83-4622-8b3d-c4e7d233d0a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:50.575594 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9bbd6-1c83-4622-8b3d-c4e7d233d0a7 None admin] RBAC: Adding query filter params (role.id=dfdbef47aad347cb8de81878442e73f2, user.id=a738061cafbb491bb65ace49ec9c5e0b, scope.system=all) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:50.575906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9bbd6-1c83-4622-8b3d-c4e7d233d0a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:50.577408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9bbd6-1c83-4622-8b3d-c4e7d233d0a7 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-d571ab20-89ba-49b5-9591-54323322202a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:50.577614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:50.579668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 184/363] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:34:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:50.581801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571ab20-89ba-49b5-9591-54323322202a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:50.591071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 180/364] 10.222.0.73 () {56 vars in 1308 bytes} [Wed May 4 13:34:50 2022] GET /identity/v3/role_assignments?user.id=a738061cafbb491bb65ace49ec9c5e0b&scope.system=all&role.id=dfdbef47aad347cb8de81878442e73f2 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:50.592995 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85ae62-442d-408c-bcd0-faf0b63507df None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.593286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85ae62-442d-408c-bcd0-faf0b63507df None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.593563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85ae62-442d-408c-bcd0-faf0b63507df None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:50.594863 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 181/365] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:50.595663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85ae62-442d-408c-bcd0-faf0b63507df None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:50.689993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571ab20-89ba-49b5-9591-54323322202a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:50.704697 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85ae62-442d-408c-bcd0-faf0b63507df None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:50.727906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473c4a2-87c2-4d35-8327-645af2866851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:50.728795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473c4a2-87c2-4d35-8327-645af2866851 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.729074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473c4a2-87c2-4d35-8327-645af2866851 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.729345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473c4a2-87c2-4d35-8327-645af2866851 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:50.730747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473c4a2-87c2-4d35-8327-645af2866851 None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:50.732383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473c4a2-87c2-4d35-8327-645af2866851 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:50.735273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 185/366] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:50 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:50.736630 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a105ad-15be-4880-815e-8d7e946e6e69 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.736915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a105ad-15be-4880-815e-8d7e946e6e69 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.737243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a105ad-15be-4880-815e-8d7e946e6e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:50.743219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded2c04-816b-46e0-b5d7-8c774e38f6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:50.743909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded2c04-816b-46e0-b5d7-8c774e38f6aa None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.744183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded2c04-816b-46e0-b5d7-8c774e38f6aa None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.744458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded2c04-816b-46e0-b5d7-8c774e38f6aa None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:50.745224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded2c04-816b-46e0-b5d7-8c774e38f6aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:50.745528 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded2c04-816b-46e0-b5d7-8c774e38f6aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:50.746914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded2c04-816b-46e0-b5d7-8c774e38f6aa None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:50.756880 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 182/367] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:34:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:50.757668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded2c04-816b-46e0-b5d7-8c774e38f6aa None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:50.758359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-85a105ad-15be-4880-815e-8d7e946e6e69 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:50.759624 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-85a105ad-15be-4880-815e-8d7e946e6e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:50.834378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 186/368] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:50.835290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a105ad-15be-4880-815e-8d7e946e6e69 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:50.869077 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded2c04-816b-46e0-b5d7-8c774e38f6aa None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:50.905421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1350aa-a9f3-4183-88df-ae9f07d4fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:50.906291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1350aa-a9f3-4183-88df-ae9f07d4fadf None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.906572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1350aa-a9f3-4183-88df-ae9f07d4fadf None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.906848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1350aa-a9f3-4183-88df-ae9f07d4fadf None admin] PATH_INFO: `/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:50.908255 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1350aa-a9f3-4183-88df-ae9f07d4fadf None admin] RBAC: Authorizing `identity:get_group(group_id=fd1b13ec40364c0d8725b3e3c55f7439)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:50.909692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1350aa-a9f3-4183-88df-ae9f07d4fadf None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:50.911642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 183/369] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:50 2022] GET /identity/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:50.912427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1350aa-a9f3-4183-88df-ae9f07d4fadf None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:50.938510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a105ad-15be-4880-815e-8d7e946e6e69 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:50.973473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e415cf-9cc4-4a64-af57-e8ca8f51d06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:50.974103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e415cf-9cc4-4a64-af57-e8ca8f51d06a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:50.974377 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e415cf-9cc4-4a64-af57-e8ca8f51d06a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:50.974682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e415cf-9cc4-4a64-af57-e8ca8f51d06a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:51.014822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1350aa-a9f3-4183-88df-ae9f07d4fadf None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:51.044196 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e415cf-9cc4-4a64-af57-e8ca8f51d06a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:51.046470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e415cf-9cc4-4a64-af57-e8ca8f51d06a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:51.050057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb7de8-4add-443b-a972-53ccd9467b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:51.050864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb7de8-4add-443b-a972-53ccd9467b15 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:51.051148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb7de8-4add-443b-a972-53ccd9467b15 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:51.051457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb7de8-4add-443b-a972-53ccd9467b15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:51.063431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb7de8-4add-443b-a972-53ccd9467b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-c9cb7de8-4add-443b-a972-53ccd9467b15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:51.071496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:51.074496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 184/370] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:34:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:51.076653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb7de8-4add-443b-a972-53ccd9467b15 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:51.177856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 187/371] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:51.179079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e415cf-9cc4-4a64-af57-e8ca8f51d06a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:51.205675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb7de8-4add-443b-a972-53ccd9467b15 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:51.245245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55469e-13c9-453e-94fe-cc5dee8c39fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:51.245903 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55469e-13c9-453e-94fe-cc5dee8c39fd None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:51.246186 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55469e-13c9-453e-94fe-cc5dee8c39fd None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:51.246459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55469e-13c9-453e-94fe-cc5dee8c39fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:51.247334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55469e-13c9-453e-94fe-cc5dee8c39fd None admin] RBAC: Adding query filter params (group.id=fd1b13ec40364c0d8725b3e3c55f7439, role.id=2f5b0d90f1814fe8a58210b5cd048bf7, scope.project.id=7679b9c9048648c08cf01ca7f0b58d36) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:51.247647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55469e-13c9-453e-94fe-cc5dee8c39fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:51.249403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55469e-13c9-453e-94fe-cc5dee8c39fd None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:51.255650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 185/372] 10.222.0.73 () {56 vars in 1376 bytes} [Wed May 4 13:34:51 2022] GET /identity/v3/role_assignments?group.id=fd1b13ec40364c0d8725b3e3c55f7439&scope.project.id=7679b9c9048648c08cf01ca7f0b58d36&role.id=2f5b0d90f1814fe8a58210b5cd048bf7 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:51.256289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55469e-13c9-453e-94fe-cc5dee8c39fd None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:51.277899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e415cf-9cc4-4a64-af57-e8ca8f51d06a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:51.330438 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2a8c0-79f6-43a1-9bf9-597f8fdca8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:51.331117 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2a8c0-79f6-43a1-9bf9-597f8fdca8f4 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:51.331438 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2a8c0-79f6-43a1-9bf9-597f8fdca8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:51.331708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2a8c0-79f6-43a1-9bf9-597f8fdca8f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:51.332471 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2a8c0-79f6-43a1-9bf9-597f8fdca8f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:51.332771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2a8c0-79f6-43a1-9bf9-597f8fdca8f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:51.334368 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2a8c0-79f6-43a1-9bf9-597f8fdca8f4 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:51.347173 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 188/373] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:51.352727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2a8c0-79f6-43a1-9bf9-597f8fdca8f4 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:51.372386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55469e-13c9-453e-94fe-cc5dee8c39fd None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:51.409350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033058ba-17d8-4a70-9ee9-db1a3d649bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:51.410557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033058ba-17d8-4a70-9ee9-db1a3d649bfc None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:51.411029 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033058ba-17d8-4a70-9ee9-db1a3d649bfc None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:51.411536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033058ba-17d8-4a70-9ee9-db1a3d649bfc None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:51.413644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033058ba-17d8-4a70-9ee9-db1a3d649bfc None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:51.415322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033058ba-17d8-4a70-9ee9-db1a3d649bfc None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:51.417243 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 186/374] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:51 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:51.423677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033058ba-17d8-4a70-9ee9-db1a3d649bfc None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:51.480703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2a8c0-79f6-43a1-9bf9-597f8fdca8f4 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:51.525609 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700c2e-ecb0-4a0b-b27d-96a9eefeb317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:51.525862 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700c2e-ecb0-4a0b-b27d-96a9eefeb317 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:51.526100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700c2e-ecb0-4a0b-b27d-96a9eefeb317 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:51.526383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700c2e-ecb0-4a0b-b27d-96a9eefeb317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:51.563076 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033058ba-17d8-4a70-9ee9-db1a3d649bfc None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:51.609022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d4500-afee-4e16-817b-620b3d0bcfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:51.609022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d4500-afee-4e16-817b-620b3d0bcfd7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:51.609299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d4500-afee-4e16-817b-620b3d0bcfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:51.609549 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d4500-afee-4e16-817b-620b3d0bcfd7 None admin] PATH_INFO: `/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:51.613037 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d4500-afee-4e16-817b-620b3d0bcfd7 None admin] RBAC: Authorizing `identity:get_group(group_id=fd1b13ec40364c0d8725b3e3c55f7439)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:51.613160 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d4500-afee-4e16-817b-620b3d0bcfd7 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:51.616169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 187/375] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:51 2022] GET /identity/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:51.625020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d4500-afee-4e16-817b-620b3d0bcfd7 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:51.637017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6700c2e-ecb0-4a0b-b27d-96a9eefeb317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:51.638898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6700c2e-ecb0-4a0b-b27d-96a9eefeb317 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:51.761258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 189/376] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:51.767386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700c2e-ecb0-4a0b-b27d-96a9eefeb317 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:51.778217 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d4500-afee-4e16-817b-620b3d0bcfd7 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:51.838973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56f699-5a91-4588-bbfe-5708322be450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:51.839657 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f699-5a91-4588-bbfe-5708322be450 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:51.839938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f699-5a91-4588-bbfe-5708322be450 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:51.840208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f699-5a91-4588-bbfe-5708322be450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:51.841115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56f699-5a91-4588-bbfe-5708322be450 None admin] RBAC: Adding query filter params (group.id=fd1b13ec40364c0d8725b3e3c55f7439, role.id=142e36ee06a7422e8e8d32a1080ea89a, scope.project.id=7679b9c9048648c08cf01ca7f0b58d36) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:51.841423 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56f699-5a91-4588-bbfe-5708322be450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:51.844964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56f699-5a91-4588-bbfe-5708322be450 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:51.854928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 188/377] 10.222.0.73 () {56 vars in 1376 bytes} [Wed May 4 13:34:51 2022] GET /identity/v3/role_assignments?group.id=fd1b13ec40364c0d8725b3e3c55f7439&scope.project.id=7679b9c9048648c08cf01ca7f0b58d36&role.id=142e36ee06a7422e8e8d32a1080ea89a => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:51.915931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700c2e-ecb0-4a0b-b27d-96a9eefeb317 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:51.963346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5123117-d899-45fb-aab0-04bdede5882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:51.965065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5123117-d899-45fb-aab0-04bdede5882f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:51.965587 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5123117-d899-45fb-aab0-04bdede5882f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:51.966068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5123117-d899-45fb-aab0-04bdede5882f None admin] PATH_INFO: `/v3/projects/f25742121cef4f95a3f20f4e6e3a0601` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:51.967661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5123117-d899-45fb-aab0-04bdede5882f None admin] RBAC: Authorizing `identity:get_project(project_id=f25742121cef4f95a3f20f4e6e3a0601)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:51.969353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5123117-d899-45fb-aab0-04bdede5882f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:51.971692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 190/378] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:51 2022] GET /identity/v3/projects/f25742121cef4f95a3f20f4e6e3a0601 => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:51.977048 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56f699-5a91-4588-bbfe-5708322be450 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:52.115982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56f699-5a91-4588-bbfe-5708322be450 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:52.153244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ce695-1e89-4881-8e85-79434bb89642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:52.154167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce695-1e89-4881-8e85-79434bb89642 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:52.154445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce695-1e89-4881-8e85-79434bb89642 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:52.154792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce695-1e89-4881-8e85-79434bb89642 None admin] PATH_INFO: `/v3/groups/9320be0da03640779c9bf0ede2b99b21` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:52.159743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ce695-1e89-4881-8e85-79434bb89642 None admin] RBAC: Authorizing `identity:get_group(group_id=9320be0da03640779c9bf0ede2b99b21)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:52.161169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ce695-1e89-4881-8e85-79434bb89642 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:52.163862 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 189/379] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:51 2022] GET /identity/v3/groups/9320be0da03640779c9bf0ede2b99b21 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:52.168535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5123117-d899-45fb-aab0-04bdede5882f None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:52.318501 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5123117-d899-45fb-aab0-04bdede5882f None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:52.362940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782aec5a-d39c-4590-be5e-4bba17dd7f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:52.363627 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782aec5a-d39c-4590-be5e-4bba17dd7f3b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:52.363908 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782aec5a-d39c-4590-be5e-4bba17dd7f3b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:52.364184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782aec5a-d39c-4590-be5e-4bba17dd7f3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:52.365012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782aec5a-d39c-4590-be5e-4bba17dd7f3b None admin] RBAC: Adding query filter params (group.id=9320be0da03640779c9bf0ede2b99b21, role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=f25742121cef4f95a3f20f4e6e3a0601) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:52.365324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782aec5a-d39c-4590-be5e-4bba17dd7f3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:52.366796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782aec5a-d39c-4590-be5e-4bba17dd7f3b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:52.376081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 191/380] 10.222.0.73 () {56 vars in 1376 bytes} [Wed May 4 13:34:52 2022] GET /identity/v3/role_assignments?group.id=9320be0da03640779c9bf0ede2b99b21&scope.project.id=f25742121cef4f95a3f20f4e6e3a0601&role.id=70e67f35994843ae942d4f1703d5619e => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:52.699634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd52f7-8ba2-45dc-ba2d-f9838cf6a26d None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:52.699971 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd52f7-8ba2-45dc-ba2d-f9838cf6a26d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:52.700175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd52f7-8ba2-45dc-ba2d-f9838cf6a26d None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:52.701614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 190/381] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:52.708087 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d07ff4-961d-42c0-8718-84dfba1a45e8 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:52.708372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d07ff4-961d-42c0-8718-84dfba1a45e8 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:52.708644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d07ff4-961d-42c0-8718-84dfba1a45e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:52.729450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-67d07ff4-961d-42c0-8718-84dfba1a45e8 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:52.730619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-67d07ff4-961d-42c0-8718-84dfba1a45e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:52.813273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 192/382] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:52.844310 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd52f7-8ba2-45dc-ba2d-f9838cf6a26d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:52.988929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd52f7-8ba2-45dc-ba2d-f9838cf6a26d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:53.028106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37adf8a-1a95-4610-809f-2d355576046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:53.028909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37adf8a-1a95-4610-809f-2d355576046d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:53.029195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37adf8a-1a95-4610-809f-2d355576046d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:53.029473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37adf8a-1a95-4610-809f-2d355576046d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:53.046232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37adf8a-1a95-4610-809f-2d355576046d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-f37adf8a-1a95-4610-809f-2d355576046d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:53.054413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:53.055329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:53.056131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 191/383] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:53.062409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d07ff4-961d-42c0-8718-84dfba1a45e8 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:53.169418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d07ff4-961d-42c0-8718-84dfba1a45e8 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:53.210672 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8037f20-5634-4939-abf6-43b0bfea34cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:53.211406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8037f20-5634-4939-abf6-43b0bfea34cc None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:53.211692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8037f20-5634-4939-abf6-43b0bfea34cc None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:53.211965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8037f20-5634-4939-abf6-43b0bfea34cc None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:53.212704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8037f20-5634-4939-abf6-43b0bfea34cc None admin] RBAC: Adding query filter params (name=member) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:53.213005 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8037f20-5634-4939-abf6-43b0bfea34cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:53.214360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8037f20-5634-4939-abf6-43b0bfea34cc None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:53.227341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 193/384] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:53.229583 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37adf8a-1a95-4610-809f-2d355576046d None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:53.385567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37adf8a-1a95-4610-809f-2d355576046d None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:53.431968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e4250-a49c-42c7-b7b1-c42c8fbf2593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:53.432854 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e4250-a49c-42c7-b7b1-c42c8fbf2593 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:53.433135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e4250-a49c-42c7-b7b1-c42c8fbf2593 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:53.433410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e4250-a49c-42c7-b7b1-c42c8fbf2593 None admin] PATH_INFO: `/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:53.434723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e4250-a49c-42c7-b7b1-c42c8fbf2593 None admin] RBAC: Authorizing `identity:get_group(group_id=fd1b13ec40364c0d8725b3e3c55f7439)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:53.436277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e4250-a49c-42c7-b7b1-c42c8fbf2593 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:53.438208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 192/385] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:53 2022] GET /identity/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:53.443439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8037f20-5634-4939-abf6-43b0bfea34cc None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:53.589997 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8037f20-5634-4939-abf6-43b0bfea34cc None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:53.638704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffe574-4e92-4f09-94e9-0ed34072fa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:53.640424 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe574-4e92-4f09-94e9-0ed34072fa42 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:53.640860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe574-4e92-4f09-94e9-0ed34072fa42 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:53.641289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffe574-4e92-4f09-94e9-0ed34072fa42 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:53.642635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffe574-4e92-4f09-94e9-0ed34072fa42 None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:53.644223 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffe574-4e92-4f09-94e9-0ed34072fa42 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:53.646382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 194/386] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:53 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:53.651934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e4250-a49c-42c7-b7b1-c42c8fbf2593 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:53.732374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54103d7c-369a-4dc3-abce-7e24329e84c5 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:53.733573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54103d7c-369a-4dc3-abce-7e24329e84c5 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:53.734043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54103d7c-369a-4dc3-abce-7e24329e84c5 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:53.735685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 195/387] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:53.741041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5de64-1a55-4253-a705-4f6ace3f1eae None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:53.741582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5de64-1a55-4253-a705-4f6ace3f1eae None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:53.742044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5de64-1a55-4253-a705-4f6ace3f1eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:53.770978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-aaf5de64-1a55-4253-a705-4f6ace3f1eae None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:53.772595 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-aaf5de64-1a55-4253-a705-4f6ace3f1eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:53.796271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e4250-a49c-42c7-b7b1-c42c8fbf2593 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:53.845824 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c28e9-6fb5-4e0f-a57e-c47bd8c08798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:53.846640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c28e9-6fb5-4e0f-a57e-c47bd8c08798 None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:53.846921 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c28e9-6fb5-4e0f-a57e-c47bd8c08798 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:53.847194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c28e9-6fb5-4e0f-a57e-c47bd8c08798 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7/groups/fd1b13ec40364c0d8725b3e3c55f7439/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:53.851473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c28e9-6fb5-4e0f-a57e-c47bd8c08798 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f60414b09e148d391f54308214c18a7, group_id=fd1b13ec40364c0d8725b3e3c55f7439, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:53.852910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c28e9-6fb5-4e0f-a57e-c47bd8c08798 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:53.868043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 196/388] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:53.878089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 193/389] 10.222.0.73 () {58 vars in 1442 bytes} [Wed May 4 13:34:53 2022] PUT /identity/v3/projects/8f60414b09e148d391f54308214c18a7/groups/fd1b13ec40364c0d8725b3e3c55f7439/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:34:53.907958 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5de64-1a55-4253-a705-4f6ace3f1eae None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:54.022689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5de64-1a55-4253-a705-4f6ace3f1eae None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:54.066588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83967c4-137b-4f5d-a596-c47679244d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:54.067433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83967c4-137b-4f5d-a596-c47679244d1b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:54.067715 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83967c4-137b-4f5d-a596-c47679244d1b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:54.067987 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83967c4-137b-4f5d-a596-c47679244d1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:54.084244 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83967c4-137b-4f5d-a596-c47679244d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-b83967c4-137b-4f5d-a596-c47679244d1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:54.092612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:54.093547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:54.094979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 197/390] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:34:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:54.099974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c28e9-6fb5-4e0f-a57e-c47bd8c08798 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:54.230370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c28e9-6fb5-4e0f-a57e-c47bd8c08798 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:54.273266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86745-3634-4630-9b74-c16d47247207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:54.273953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86745-3634-4630-9b74-c16d47247207 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:54.274233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86745-3634-4630-9b74-c16d47247207 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:54.274566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86745-3634-4630-9b74-c16d47247207 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:54.275377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d86745-3634-4630-9b74-c16d47247207 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:54.275683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d86745-3634-4630-9b74-c16d47247207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:54.277047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d86745-3634-4630-9b74-c16d47247207 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:54.290762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 194/391] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:34:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:54.301308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83967c4-137b-4f5d-a596-c47679244d1b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:54.432835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83967c4-137b-4f5d-a596-c47679244d1b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:54.433177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab452b3b-2397-4d07-82ef-500572d219dd None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:54.433361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab452b3b-2397-4d07-82ef-500572d219dd None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:54.433617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab452b3b-2397-4d07-82ef-500572d219dd None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:54.434985 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 195/392] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:34:54.440593 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff79279-2798-43ba-829e-a85cb89b2b8b None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:54.441146 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff79279-2798-43ba-829e-a85cb89b2b8b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:54.441624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff79279-2798-43ba-829e-a85cb89b2b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:54.472173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-bff79279-2798-43ba-829e-a85cb89b2b8b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:54.473341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-bff79279-2798-43ba-829e-a85cb89b2b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:54.476365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598018e-726a-4431-9406-9e405d3c7142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:54.477224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598018e-726a-4431-9406-9e405d3c7142 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:54.477501 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598018e-726a-4431-9406-9e405d3c7142 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:54.477787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598018e-726a-4431-9406-9e405d3c7142 None admin] PATH_INFO: `/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:54.478947 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598018e-726a-4431-9406-9e405d3c7142 None admin] RBAC: Authorizing `identity:get_group(group_id=fd1b13ec40364c0d8725b3e3c55f7439)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:54.480494 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598018e-726a-4431-9406-9e405d3c7142 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:54.482111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 198/393] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:54 2022] GET /identity/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:54.488525 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598018e-726a-4431-9406-9e405d3c7142 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:54.605639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 196/394] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:54.612939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598018e-726a-4431-9406-9e405d3c7142 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:54.636726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff79279-2798-43ba-829e-a85cb89b2b8b None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:54.667651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0f35c-2186-4244-a552-bff3bb858eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:54.668536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0f35c-2186-4244-a552-bff3bb858eae None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:54.668813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0f35c-2186-4244-a552-bff3bb858eae None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:54.672328 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0f35c-2186-4244-a552-bff3bb858eae None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:54.675943 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0f35c-2186-4244-a552-bff3bb858eae None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:54.677188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0f35c-2186-4244-a552-bff3bb858eae None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:54.678335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 199/395] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:54 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:54.690004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0f35c-2186-4244-a552-bff3bb858eae None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:54.810477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0f35c-2186-4244-a552-bff3bb858eae None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:54.827413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff79279-2798-43ba-829e-a85cb89b2b8b None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:54.855941 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2375095-582e-4856-a90e-5c83d8489731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:54.857216 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375095-582e-4856-a90e-5c83d8489731 None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:54.857760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375095-582e-4856-a90e-5c83d8489731 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:54.858250 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375095-582e-4856-a90e-5c83d8489731 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7/groups/fd1b13ec40364c0d8725b3e3c55f7439/roles/142e36ee06a7422e8e8d32a1080ea89a` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:54.862315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2375095-582e-4856-a90e-5c83d8489731 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f60414b09e148d391f54308214c18a7, group_id=fd1b13ec40364c0d8725b3e3c55f7439, role_id=142e36ee06a7422e8e8d32a1080ea89a)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:54.864025 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2375095-582e-4856-a90e-5c83d8489731 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:54.872586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab04f56-f8c5-4a53-b023-7d59394b4e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:54.874553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab04f56-f8c5-4a53-b023-7d59394b4e02 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:54.874837 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab04f56-f8c5-4a53-b023-7d59394b4e02 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:54.875258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab04f56-f8c5-4a53-b023-7d59394b4e02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:54.885514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 200/396] 10.222.0.73 () {58 vars in 1442 bytes} [Wed May 4 13:34:54 2022] PUT /identity/v3/projects/8f60414b09e148d391f54308214c18a7/groups/fd1b13ec40364c0d8725b3e3c55f7439/roles/142e36ee06a7422e8e8d32a1080ea89a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:34:54.887069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571152e-fa6a-44f5-bffc-732d49fa1d30 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:54.887069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571152e-fa6a-44f5-bffc-732d49fa1d30 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:54.887424 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571152e-fa6a-44f5-bffc-732d49fa1d30 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:54.888667 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 201/397] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:54.895481 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e413-2cea-4cb8-b10d-fe89d9c282d1 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:54.895872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab04f56-f8c5-4a53-b023-7d59394b4e02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:54.896279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e413-2cea-4cb8-b10d-fe89d9c282d1 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:54.896802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e413-2cea-4cb8-b10d-fe89d9c282d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-3ab04f56-f8c5-4a53-b023-7d59394b4e02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:54.904823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:54.905769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:54.906600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 197/398] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:54.913251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab04f56-f8c5-4a53-b023-7d59394b4e02 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:54.935368 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-8168e413-2cea-4cb8-b10d-fe89d9c282d1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:54.937510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8168e413-2cea-4cb8-b10d-fe89d9c282d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:55.038424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab04f56-f8c5-4a53-b023-7d59394b4e02 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:55.085847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397a4e-b2d3-4f50-aec5-ea038cc4bb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:55.086538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397a4e-b2d3-4f50-aec5-ea038cc4bb31 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:55.086820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397a4e-b2d3-4f50-aec5-ea038cc4bb31 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:55.087098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57397a4e-b2d3-4f50-aec5-ea038cc4bb31 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:55.088350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397a4e-b2d3-4f50-aec5-ea038cc4bb31 None admin] RBAC: Adding query filter params (name=member) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:55.088741 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397a4e-b2d3-4f50-aec5-ea038cc4bb31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:55.090439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57397a4e-b2d3-4f50-aec5-ea038cc4bb31 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:55.100926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 198/399] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:55.107238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397a4e-b2d3-4f50-aec5-ea038cc4bb31 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:55.115040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 202/400] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:55.201529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e413-2cea-4cb8-b10d-fe89d9c282d1 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:55.245734 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57397a4e-b2d3-4f50-aec5-ea038cc4bb31 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:55.281033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c462bc0-6f8e-460e-b798-74a0d5c3725e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:55.281947 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c462bc0-6f8e-460e-b798-74a0d5c3725e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:55.282233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c462bc0-6f8e-460e-b798-74a0d5c3725e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:55.282510 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c462bc0-6f8e-460e-b798-74a0d5c3725e None admin] PATH_INFO: `/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:55.283730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c462bc0-6f8e-460e-b798-74a0d5c3725e None admin] RBAC: Authorizing `identity:get_group(group_id=fd1b13ec40364c0d8725b3e3c55f7439)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:55.285167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c462bc0-6f8e-460e-b798-74a0d5c3725e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:55.286791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 199/401] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:55 2022] GET /identity/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:55.293159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c462bc0-6f8e-460e-b798-74a0d5c3725e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:55.400697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e413-2cea-4cb8-b10d-fe89d9c282d1 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:55.405673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c462bc0-6f8e-460e-b798-74a0d5c3725e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:55.447732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20c24f-8b76-40f6-a7d4-e608d53c5eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:55.448631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20c24f-8b76-40f6-a7d4-e608d53c5eff None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:55.448912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20c24f-8b76-40f6-a7d4-e608d53c5eff None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:55.449189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20c24f-8b76-40f6-a7d4-e608d53c5eff None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:55.450519 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f754c1a-6dec-4c51-a35f-a8d3e01e495c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:55.451384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f754c1a-6dec-4c51-a35f-a8d3e01e495c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:55.451695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f754c1a-6dec-4c51-a35f-a8d3e01e495c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:55.451961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f754c1a-6dec-4c51-a35f-a8d3e01e495c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:55.453359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20c24f-8b76-40f6-a7d4-e608d53c5eff None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:55.454861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20c24f-8b76-40f6-a7d4-e608d53c5eff None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:55.459354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 200/402] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:55 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:55.464563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20c24f-8b76-40f6-a7d4-e608d53c5eff None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:55.474022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f754c1a-6dec-4c51-a35f-a8d3e01e495c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-0f754c1a-6dec-4c51-a35f-a8d3e01e495c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:55.482329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:55.483890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:55.484682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:55.484682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:55.484682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:55.484682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:55.484682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:55.484682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:55.484682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:55.484682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:55.484682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:55.484682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:55.484682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:55.484682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:55.489016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 203/403] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:34:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:55.494787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f754c1a-6dec-4c51-a35f-a8d3e01e495c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:55.628394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20c24f-8b76-40f6-a7d4-e608d53c5eff None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:55.668075 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44f964-45e3-42dc-8197-7c31f068bb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:55.671172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44f964-45e3-42dc-8197-7c31f068bb65 None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:55.671716 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44f964-45e3-42dc-8197-7c31f068bb65 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:55.672188 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44f964-45e3-42dc-8197-7c31f068bb65 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36/groups/fd1b13ec40364c0d8725b3e3c55f7439/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:55.677845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44f964-45e3-42dc-8197-7c31f068bb65 None admin] RBAC: Authorizing `identity:create_grant(project_id=7679b9c9048648c08cf01ca7f0b58d36, group_id=fd1b13ec40364c0d8725b3e3c55f7439, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:55.679528 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44f964-45e3-42dc-8197-7c31f068bb65 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:55.701852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f754c1a-6dec-4c51-a35f-a8d3e01e495c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:55.702525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 201/404] 10.222.0.73 () {58 vars in 1442 bytes} [Wed May 4 13:34:55 2022] PUT /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36/groups/fd1b13ec40364c0d8725b3e3c55f7439/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:34:55.704071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12797d-3710-4fc2-be56-2653609a797f None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:55.704620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12797d-3710-4fc2-be56-2653609a797f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:55.705144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12797d-3710-4fc2-be56-2653609a797f None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:55.707013 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 202/405] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:55.713158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e54c1f-6406-4db6-9438-d29db9cdc77e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:55.714124 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e54c1f-6406-4db6-9438-d29db9cdc77e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:55.714383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e54c1f-6406-4db6-9438-d29db9cdc77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:55.752512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec3017-6393-4e51-b9b8-9c73463974a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:55.753745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec3017-6393-4e51-b9b8-9c73463974a5 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:55.755158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-87e54c1f-6406-4db6-9438-d29db9cdc77e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:55.755727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec3017-6393-4e51-b9b8-9c73463974a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:55.756227 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec3017-6393-4e51-b9b8-9c73463974a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:55.758270 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec3017-6393-4e51-b9b8-9c73463974a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:55.758811 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec3017-6393-4e51-b9b8-9c73463974a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:55.759464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-87e54c1f-6406-4db6-9438-d29db9cdc77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:55.763555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec3017-6393-4e51-b9b8-9c73463974a5 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:55.784663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 204/406] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:34:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:55.790691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec3017-6393-4e51-b9b8-9c73463974a5 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:55.875874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 203/407] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:55.918852 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e54c1f-6406-4db6-9438-d29db9cdc77e None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:55.972829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec3017-6393-4e51-b9b8-9c73463974a5 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:56.018164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746faca6-a383-4ed7-8213-0a156e4bb77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:56.019529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746faca6-a383-4ed7-8213-0a156e4bb77c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:56.020070 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746faca6-a383-4ed7-8213-0a156e4bb77c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:56.021081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746faca6-a383-4ed7-8213-0a156e4bb77c None admin] PATH_INFO: `/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:56.022774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746faca6-a383-4ed7-8213-0a156e4bb77c None admin] RBAC: Authorizing `identity:get_group(group_id=fd1b13ec40364c0d8725b3e3c55f7439)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:56.025426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746faca6-a383-4ed7-8213-0a156e4bb77c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:56.027628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 205/408] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:55 2022] GET /identity/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:56.036194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746faca6-a383-4ed7-8213-0a156e4bb77c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:56.067891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e54c1f-6406-4db6-9438-d29db9cdc77e None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:56.127333 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c6b5a-d06a-4ab1-a066-c1ab41cab218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:56.128140 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c6b5a-d06a-4ab1-a066-c1ab41cab218 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:56.128416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c6b5a-d06a-4ab1-a066-c1ab41cab218 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:56.128686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c6b5a-d06a-4ab1-a066-c1ab41cab218 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:56.149187 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746faca6-a383-4ed7-8213-0a156e4bb77c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:56.155737 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c6b5a-d06a-4ab1-a066-c1ab41cab218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-0f5c6b5a-d06a-4ab1-a066-c1ab41cab218 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:56.167624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:56.168542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:56.169377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 204/409] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:34:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:56.175627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c6b5a-d06a-4ab1-a066-c1ab41cab218 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:56.184655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd122d-33e6-49cb-85e2-21feec6fceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:56.185635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd122d-33e6-49cb-85e2-21feec6fceb3 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:56.185955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd122d-33e6-49cb-85e2-21feec6fceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:56.186229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd122d-33e6-49cb-85e2-21feec6fceb3 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:56.187470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd122d-33e6-49cb-85e2-21feec6fceb3 None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:56.189453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd122d-33e6-49cb-85e2-21feec6fceb3 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:56.191556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 206/410] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:56 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:56.198632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd122d-33e6-49cb-85e2-21feec6fceb3 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:56.311174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd122d-33e6-49cb-85e2-21feec6fceb3 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:56.348120 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258a44b-0fe9-4c1a-ba55-1dada35ade3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:56.349014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258a44b-0fe9-4c1a-ba55-1dada35ade3a None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:56.349296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258a44b-0fe9-4c1a-ba55-1dada35ade3a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:56.349572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258a44b-0fe9-4c1a-ba55-1dada35ade3a None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36/groups/fd1b13ec40364c0d8725b3e3c55f7439/roles/142e36ee06a7422e8e8d32a1080ea89a` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:56.351914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258a44b-0fe9-4c1a-ba55-1dada35ade3a None admin] RBAC: Authorizing `identity:create_grant(project_id=7679b9c9048648c08cf01ca7f0b58d36, group_id=fd1b13ec40364c0d8725b3e3c55f7439, role_id=142e36ee06a7422e8e8d32a1080ea89a)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:56.353387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258a44b-0fe9-4c1a-ba55-1dada35ade3a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:56.367909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c6b5a-d06a-4ab1-a066-c1ab41cab218 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:56.368459 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 207/411] 10.222.0.73 () {58 vars in 1442 bytes} [Wed May 4 13:34:56 2022] PUT /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36/groups/fd1b13ec40364c0d8725b3e3c55f7439/roles/142e36ee06a7422e8e8d32a1080ea89a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:34:56.424149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4729f2e-c4d7-4a88-898a-11844c8df083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:56.424802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4729f2e-c4d7-4a88-898a-11844c8df083 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:56.425085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4729f2e-c4d7-4a88-898a-11844c8df083 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:56.425362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4729f2e-c4d7-4a88-898a-11844c8df083 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:56.426133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4729f2e-c4d7-4a88-898a-11844c8df083 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:56.426440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4729f2e-c4d7-4a88-898a-11844c8df083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:56.427938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4729f2e-c4d7-4a88-898a-11844c8df083 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:56.437753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 205/412] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:56.443977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258a44b-0fe9-4c1a-ba55-1dada35ade3a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:56.585081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258a44b-0fe9-4c1a-ba55-1dada35ade3a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:56.621069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317f8d0-343b-4bca-8b3b-48622d06be99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:56.621942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317f8d0-343b-4bca-8b3b-48622d06be99 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:56.622227 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317f8d0-343b-4bca-8b3b-48622d06be99 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:56.622508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317f8d0-343b-4bca-8b3b-48622d06be99 None admin] PATH_INFO: `/v3/groups/9320be0da03640779c9bf0ede2b99b21` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:56.623777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317f8d0-343b-4bca-8b3b-48622d06be99 None admin] RBAC: Authorizing `identity:get_group(group_id=9320be0da03640779c9bf0ede2b99b21)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:56.625244 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317f8d0-343b-4bca-8b3b-48622d06be99 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:56.627307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 208/413] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:56 2022] GET /identity/v3/groups/9320be0da03640779c9bf0ede2b99b21 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:56.632933 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4729f2e-c4d7-4a88-898a-11844c8df083 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:56.748823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4729f2e-c4d7-4a88-898a-11844c8df083 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:56.786477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61c339-feb9-4acb-9673-8bf266458e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:56.787386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61c339-feb9-4acb-9673-8bf266458e2c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:56.787667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61c339-feb9-4acb-9673-8bf266458e2c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:56.787941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61c339-feb9-4acb-9673-8bf266458e2c None admin] PATH_INFO: `/v3/projects/f25742121cef4f95a3f20f4e6e3a0601` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:56.789160 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61c339-feb9-4acb-9673-8bf266458e2c None admin] RBAC: Authorizing `identity:get_project(project_id=f25742121cef4f95a3f20f4e6e3a0601)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:56.790807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61c339-feb9-4acb-9673-8bf266458e2c None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:56.792921 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 206/414] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:56 2022] GET /identity/v3/projects/f25742121cef4f95a3f20f4e6e3a0601 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:56.800402 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317f8d0-343b-4bca-8b3b-48622d06be99 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:56.900585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6212e91-036c-46b0-ae5a-7ddd98555f0f None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:56.901229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6212e91-036c-46b0-ae5a-7ddd98555f0f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:56.901701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6212e91-036c-46b0-ae5a-7ddd98555f0f None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:56.903546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 207/415] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:34:56.908920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab802c4-9ed6-4930-bb2d-95f139c0125d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:56.909484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab802c4-9ed6-4930-bb2d-95f139c0125d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:56.909969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab802c4-9ed6-4930-bb2d-95f139c0125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:56.929623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-6ab802c4-9ed6-4930-bb2d-95f139c0125d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:56.931925 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6ab802c4-9ed6-4930-bb2d-95f139c0125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:56.977150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317f8d0-343b-4bca-8b3b-48622d06be99 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:57.008259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 208/416] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:57.027792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc8c0f-cae5-48d4-a258-d90d4f2b5519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:57.028677 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc8c0f-cae5-48d4-a258-d90d4f2b5519 None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:57.028965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc8c0f-cae5-48d4-a258-d90d4f2b5519 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:57.029240 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc8c0f-cae5-48d4-a258-d90d4f2b5519 None admin] PATH_INFO: `/v3/projects/f25742121cef4f95a3f20f4e6e3a0601/groups/9320be0da03640779c9bf0ede2b99b21/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:57.031815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc8c0f-cae5-48d4-a258-d90d4f2b5519 None admin] RBAC: Authorizing `identity:create_grant(project_id=f25742121cef4f95a3f20f4e6e3a0601, group_id=9320be0da03640779c9bf0ede2b99b21, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:57.033263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc8c0f-cae5-48d4-a258-d90d4f2b5519 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:57.043498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab802c4-9ed6-4930-bb2d-95f139c0125d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:57.071395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 209/417] 10.222.0.73 () {58 vars in 1442 bytes} [Wed May 4 13:34:56 2022] PUT /identity/v3/projects/f25742121cef4f95a3f20f4e6e3a0601/groups/9320be0da03640779c9bf0ede2b99b21/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:34:57.197449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab802c4-9ed6-4930-bb2d-95f139c0125d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:57.254450 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3307b7-3fa6-4b39-abac-d74160ce0e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:57.255292 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3307b7-3fa6-4b39-abac-d74160ce0e5d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:57.255580 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3307b7-3fa6-4b39-abac-d74160ce0e5d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:57.255856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3307b7-3fa6-4b39-abac-d74160ce0e5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:57.275731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3307b7-3fa6-4b39-abac-d74160ce0e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-2d3307b7-3fa6-4b39-abac-d74160ce0e5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:57.283906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:57.284856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:57.285647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:57.285647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:57.285647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:57.285647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:57.285647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:57.285647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:57.285647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:57.285647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:57.285647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:57.285647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:57.285647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:57.285647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:57.289230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 209/418] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:57.291447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc8c0f-cae5-48d4-a258-d90d4f2b5519 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:57.400359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc8c0f-cae5-48d4-a258-d90d4f2b5519 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:57.441755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815d534-d7f8-4d71-8318-9b13bd4b3ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:57.442484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815d534-d7f8-4d71-8318-9b13bd4b3ffe None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:57.442772 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815d534-d7f8-4d71-8318-9b13bd4b3ffe None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:57.443050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815d534-d7f8-4d71-8318-9b13bd4b3ffe None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:57.443827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815d534-d7f8-4d71-8318-9b13bd4b3ffe None admin] RBAC: Adding query filter params (name=member) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:57.444134 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815d534-d7f8-4d71-8318-9b13bd4b3ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:57.445775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815d534-d7f8-4d71-8318-9b13bd4b3ffe None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:57.454724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 210/419] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:57.460421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3307b7-3fa6-4b39-abac-d74160ce0e5d None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:57.598509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3307b7-3fa6-4b39-abac-d74160ce0e5d None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:57.632177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5264f-5f9e-497e-835a-256d386542ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:57.632825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5264f-5f9e-497e-835a-256d386542ae None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:57.633110 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5264f-5f9e-497e-835a-256d386542ae None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:57.633388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5264f-5f9e-497e-835a-256d386542ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:57.711507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5264f-5f9e-497e-835a-256d386542ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:57.711943 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e010dfa-c38d-472e-86a5-0e5ce49d1c3c None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:57.712238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e010dfa-c38d-472e-86a5-0e5ce49d1c3c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:57.712517 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e010dfa-c38d-472e-86a5-0e5ce49d1c3c None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:57.713033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5264f-5f9e-497e-835a-256d386542ae None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:57.714155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 211/420] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:34:57.724493 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e328dc-4ab9-4412-99a0-2b1938ab6044 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:57.724772 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e328dc-4ab9-4412-99a0-2b1938ab6044 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:57.725052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e328dc-4ab9-4412-99a0-2b1938ab6044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:57.743141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-04e328dc-4ab9-4412-99a0-2b1938ab6044 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:57.744342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-04e328dc-4ab9-4412-99a0-2b1938ab6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:57.813453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 212/421] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:57.822684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 210/422] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:57.828937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e328dc-4ab9-4412-99a0-2b1938ab6044 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:57.846784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5264f-5f9e-497e-835a-256d386542ae None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:57.937941 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e328dc-4ab9-4412-99a0-2b1938ab6044 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:57.975485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4676f3-8a05-4630-b814-4a10fa0f1803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:57.976340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4676f3-8a05-4630-b814-4a10fa0f1803 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:57.976615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4676f3-8a05-4630-b814-4a10fa0f1803 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:57.977244 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4676f3-8a05-4630-b814-4a10fa0f1803 None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:57.978266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4676f3-8a05-4630-b814-4a10fa0f1803 None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:57.979737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4676f3-8a05-4630-b814-4a10fa0f1803 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:57.981708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 213/423] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:57 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:58.000092 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4676f3-8a05-4630-b814-4a10fa0f1803 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:58.016193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5264f-5f9e-497e-835a-256d386542ae None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:58.068475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979a80a-c47f-4d7a-94a0-763706a24152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:58.069678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979a80a-c47f-4d7a-94a0-763706a24152 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:58.070439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979a80a-c47f-4d7a-94a0-763706a24152 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:58.070922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979a80a-c47f-4d7a-94a0-763706a24152 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:58.106287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979a80a-c47f-4d7a-94a0-763706a24152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-2979a80a-c47f-4d7a-94a0-763706a24152 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:58.115503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:58.116413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:58.117210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:58.117210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:58.117210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:58.117210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:58.117210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:58.117210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:58.117210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:58.117210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:58.117210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:58.117210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:58.117210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:58.117210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:34:58.119920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 211/424] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:34:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:34:58.128174 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979a80a-c47f-4d7a-94a0-763706a24152 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:58.135592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4676f3-8a05-4630-b814-4a10fa0f1803 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:58.179178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb9c99-73d5-432e-8cfd-b77937a0d810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:58.179714 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9c99-73d5-432e-8cfd-b77937a0d810 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:58.179990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9c99-73d5-432e-8cfd-b77937a0d810 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:58.180258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9c99-73d5-432e-8cfd-b77937a0d810 None admin] PATH_INFO: `/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:58.181461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb9c99-73d5-432e-8cfd-b77937a0d810 None admin] RBAC: Authorizing `identity:get_group(group_id=fd1b13ec40364c0d8725b3e3c55f7439)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:58.182900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb9c99-73d5-432e-8cfd-b77937a0d810 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:58.184858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 214/425] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:57 2022] GET /identity/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:58.190800 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb9c99-73d5-432e-8cfd-b77937a0d810 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:58.248097 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979a80a-c47f-4d7a-94a0-763706a24152 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:58.285294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654261d-9562-47b3-a269-5ad211919f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:58.286320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654261d-9562-47b3-a269-5ad211919f07 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:58.286820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654261d-9562-47b3-a269-5ad211919f07 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:58.287328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654261d-9562-47b3-a269-5ad211919f07 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:58.289220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654261d-9562-47b3-a269-5ad211919f07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:58.290715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654261d-9562-47b3-a269-5ad211919f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:58.292477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654261d-9562-47b3-a269-5ad211919f07 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:58.321390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 212/426] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:34:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:58.328421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654261d-9562-47b3-a269-5ad211919f07 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:58.373380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb9c99-73d5-432e-8cfd-b77937a0d810 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:58.430691 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654261d-9562-47b3-a269-5ad211919f07 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:58.437055 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6a71-56e7-44ab-bf15-05d69f4b40df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:58.437737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6a71-56e7-44ab-bf15-05d69f4b40df None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:58.438019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6a71-56e7-44ab-bf15-05d69f4b40df None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:58.438295 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6a71-56e7-44ab-bf15-05d69f4b40df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:58.439141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6a71-56e7-44ab-bf15-05d69f4b40df None admin] RBAC: Adding query filter params (group.id=fd1b13ec40364c0d8725b3e3c55f7439, role.id=2f5b0d90f1814fe8a58210b5cd048bf7, scope.project.id=8f60414b09e148d391f54308214c18a7) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:58.439481 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6a71-56e7-44ab-bf15-05d69f4b40df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:58.440974 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6a71-56e7-44ab-bf15-05d69f4b40df None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:58.455522 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 215/427] 10.222.0.73 () {56 vars in 1376 bytes} [Wed May 4 13:34:58 2022] GET /identity/v3/role_assignments?group.id=fd1b13ec40364c0d8725b3e3c55f7439&scope.project.id=8f60414b09e148d391f54308214c18a7&role.id=2f5b0d90f1814fe8a58210b5cd048bf7 => generated 611 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:58.471604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf519816-bfea-4452-9e05-db61c783bcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:58.473012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf519816-bfea-4452-9e05-db61c783bcdd None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:58.473494 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf519816-bfea-4452-9e05-db61c783bcdd None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:58.473992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf519816-bfea-4452-9e05-db61c783bcdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:58.547219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf519816-bfea-4452-9e05-db61c783bcdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:58.548997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf519816-bfea-4452-9e05-db61c783bcdd None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:58.654217 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 213/428] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 13:34:58.659928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6a71-56e7-44ab-bf15-05d69f4b40df None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:58.744425 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0f4c4-b6a5-4585-ade1-b688fff81374 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:58.745044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0f4c4-b6a5-4585-ade1-b688fff81374 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:58.745521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0f4c4-b6a5-4585-ade1-b688fff81374 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:58.747345 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 214/429] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:58.753438 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c15261-46d8-42f2-8a12-d5fa39f5bd81 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:58.754014 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c15261-46d8-42f2-8a12-d5fa39f5bd81 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:58.754511 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c15261-46d8-42f2-8a12-d5fa39f5bd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:58.772869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-13c15261-46d8-42f2-8a12-d5fa39f5bd81 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:58.774452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-13c15261-46d8-42f2-8a12-d5fa39f5bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:58.814926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6a71-56e7-44ab-bf15-05d69f4b40df None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:58.845452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 215/430] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:34:58.851230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048aac8f-94c0-48eb-83dd-c7fcbdc7287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:58.851230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048aac8f-94c0-48eb-83dd-c7fcbdc7287c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:58.851230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048aac8f-94c0-48eb-83dd-c7fcbdc7287c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:58.851579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048aac8f-94c0-48eb-83dd-c7fcbdc7287c None admin] PATH_INFO: `/v3/projects/8f60414b09e148d391f54308214c18a7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:58.852685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048aac8f-94c0-48eb-83dd-c7fcbdc7287c None admin] RBAC: Authorizing `identity:get_project(project_id=8f60414b09e148d391f54308214c18a7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:58.854138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048aac8f-94c0-48eb-83dd-c7fcbdc7287c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:58.856099 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 216/431] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:58 2022] GET /identity/v3/projects/8f60414b09e148d391f54308214c18a7 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:58.861681 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c15261-46d8-42f2-8a12-d5fa39f5bd81 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:58.876649 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048aac8f-94c0-48eb-83dd-c7fcbdc7287c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:58.966458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c15261-46d8-42f2-8a12-d5fa39f5bd81 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:58.985938 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048aac8f-94c0-48eb-83dd-c7fcbdc7287c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:59.002940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421f7c7-6942-4e91-bce9-56bf6de538eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:59.004172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f7c7-6942-4e91-bce9-56bf6de538eb None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.004655 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f7c7-6942-4e91-bce9-56bf6de538eb None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.005159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f7c7-6942-4e91-bce9-56bf6de538eb None admin] PATH_INFO: `/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:59.006559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421f7c7-6942-4e91-bce9-56bf6de538eb None admin] RBAC: Authorizing `identity:get_group(group_id=fd1b13ec40364c0d8725b3e3c55f7439)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:59.008220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421f7c7-6942-4e91-bce9-56bf6de538eb None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:59.010339 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 216/432] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:58 2022] GET /identity/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:59.017511 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421f7c7-6942-4e91-bce9-56bf6de538eb None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:59.026497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf5689-4cdc-466f-9c68-e0100174d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:59.027642 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf5689-4cdc-466f-9c68-e0100174d929 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.028646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf5689-4cdc-466f-9c68-e0100174d929 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.029142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf5689-4cdc-466f-9c68-e0100174d929 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:59.043604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf5689-4cdc-466f-9c68-e0100174d929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-83cf5689-4cdc-466f-9c68-e0100174d929 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:59.054172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:59.055080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:59.055923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:59.055923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:59.055923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:59.055923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:59.055923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:59.055923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:59.055923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:59.055923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:59.055923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:59.055923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:59.055923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 13:34:59.055923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:59.059285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 217/433] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:34:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:59.062671 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf5689-4cdc-466f-9c68-e0100174d929 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:59.135932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421f7c7-6942-4e91-bce9-56bf6de538eb None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:59.173351 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeb8a3-8331-465a-a238-9b8346dee6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:59.173351 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeb8a3-8331-465a-a238-9b8346dee6da None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.173351 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeb8a3-8331-465a-a238-9b8346dee6da None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.173351 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeb8a3-8331-465a-a238-9b8346dee6da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:59.173938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeb8a3-8331-465a-a238-9b8346dee6da None admin] RBAC: Adding query filter params (group.id=fd1b13ec40364c0d8725b3e3c55f7439, role.id=142e36ee06a7422e8e8d32a1080ea89a, scope.project.id=8f60414b09e148d391f54308214c18a7) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:59.174201 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeb8a3-8331-465a-a238-9b8346dee6da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:59.175817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeb8a3-8331-465a-a238-9b8346dee6da None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:59.185906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 217/434] 10.222.0.73 () {56 vars in 1376 bytes} [Wed May 4 13:34:59 2022] GET /identity/v3/role_assignments?group.id=fd1b13ec40364c0d8725b3e3c55f7439&scope.project.id=8f60414b09e148d391f54308214c18a7&role.id=142e36ee06a7422e8e8d32a1080ea89a => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:59.191644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf5689-4cdc-466f-9c68-e0100174d929 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:59.237825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16915ad3-5292-4291-a403-3e2f0610d4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:59.238885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16915ad3-5292-4291-a403-3e2f0610d4e2 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.239429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16915ad3-5292-4291-a403-3e2f0610d4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.239905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16915ad3-5292-4291-a403-3e2f0610d4e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:59.240878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16915ad3-5292-4291-a403-3e2f0610d4e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:59.241389 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16915ad3-5292-4291-a403-3e2f0610d4e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:59.243034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16915ad3-5292-4291-a403-3e2f0610d4e2 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:59.254581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 218/435] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:34:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:34:59.260468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeb8a3-8331-465a-a238-9b8346dee6da None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:59.385421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeb8a3-8331-465a-a238-9b8346dee6da None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:59.420651 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25143f2c-5807-4a98-946b-e260a95e285b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:59.421294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25143f2c-5807-4a98-946b-e260a95e285b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.421573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25143f2c-5807-4a98-946b-e260a95e285b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.421842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25143f2c-5807-4a98-946b-e260a95e285b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:59.491667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25143f2c-5807-4a98-946b-e260a95e285b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:59.493132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25143f2c-5807-4a98-946b-e260a95e285b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:59.514835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0553c5f-222c-4014-9295-df9d2b14f64b None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.515346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0553c5f-222c-4014-9295-df9d2b14f64b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.515421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0553c5f-222c-4014-9295-df9d2b14f64b None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:59.517353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 219/436] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:34:59.523116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693c607-a386-494e-b898-ed87533fda77 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.523753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693c607-a386-494e-b898-ed87533fda77 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.524250 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693c607-a386-494e-b898-ed87533fda77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:59.550042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-e693c607-a386-494e-b898-ed87533fda77 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:34:59.551690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e693c607-a386-494e-b898-ed87533fda77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:34:59.610634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 218/437] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:34:59.616331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25143f2c-5807-4a98-946b-e260a95e285b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:59.641282 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 220/438] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:34:59.664102 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693c607-a386-494e-b898-ed87533fda77 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:59.741559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25143f2c-5807-4a98-946b-e260a95e285b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:59.780562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693c607-a386-494e-b898-ed87533fda77 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:59.787421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92af5f0-9129-4c17-9930-5102b4a9847d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:59.788296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92af5f0-9129-4c17-9930-5102b4a9847d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.788573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92af5f0-9129-4c17-9930-5102b4a9847d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.788844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92af5f0-9129-4c17-9930-5102b4a9847d None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:59.790199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92af5f0-9129-4c17-9930-5102b4a9847d None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:59.793246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92af5f0-9129-4c17-9930-5102b4a9847d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:59.793675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 219/439] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:34:59 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:59.799910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92af5f0-9129-4c17-9930-5102b4a9847d None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:59.816911 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f2858-8d3e-479e-a65c-0a735636007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:59.817708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f2858-8d3e-479e-a65c-0a735636007d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.817992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f2858-8d3e-479e-a65c-0a735636007d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.818262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f2858-8d3e-479e-a65c-0a735636007d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:59.828347 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f2858-8d3e-479e-a65c-0a735636007d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-7b4f2858-8d3e-479e-a65c-0a735636007d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:34:59.836407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:34:59.837304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:34:59.838118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:34:59.838118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:34:59.838118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:34:59.838118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:34:59.838118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:34:59.838118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:34:59.838118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:34:59.838118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:34:59.838118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:34:59.838118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:34:59.838118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:34:59.838118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:34:59.842388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 221/440] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:34:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:34:59.843167 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f2858-8d3e-479e-a65c-0a735636007d None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:59.899012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92af5f0-9129-4c17-9930-5102b4a9847d None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:59.932233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3fa8f-871a-4036-a25c-0aaaea9d2e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:59.933082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3fa8f-871a-4036-a25c-0aaaea9d2e6a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.933356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3fa8f-871a-4036-a25c-0aaaea9d2e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.933622 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3fa8f-871a-4036-a25c-0aaaea9d2e6a None admin] PATH_INFO: `/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:59.934771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3fa8f-871a-4036-a25c-0aaaea9d2e6a None admin] RBAC: Authorizing `identity:get_group(group_id=fd1b13ec40364c0d8725b3e3c55f7439)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:59.936796 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3fa8f-871a-4036-a25c-0aaaea9d2e6a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:59.938391 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 220/441] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:34:59 2022] GET /identity/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:59.939617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535f18-8d71-4d77-a3f1-9e942704b224 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.939904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535f18-8d71-4d77-a3f1-9e942704b224 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.940171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6535f18-8d71-4d77-a3f1-9e942704b224 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:59.941492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 221/442] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:34:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:34:59.943826 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6535f18-8d71-4d77-a3f1-9e942704b224 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:34:59.946447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f2858-8d3e-479e-a65c-0a735636007d None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:34:59.977546 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d5248-de10-4823-b0f5-107510b3c69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:34:59.978205 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d5248-de10-4823-b0f5-107510b3c69d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.978491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d5248-de10-4823-b0f5-107510b3c69d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.978767 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d5248-de10-4823-b0f5-107510b3c69d None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:34:59.979540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d5248-de10-4823-b0f5-107510b3c69d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:34:59.979846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d5248-de10-4823-b0f5-107510b3c69d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:34:59.981212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d5248-de10-4823-b0f5-107510b3c69d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:34:59.989663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 222/443] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:34:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:34:59.990878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ead30-173e-4ac2-9894-3421cda7f0ed None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:34:59.991162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ead30-173e-4ac2-9894-3421cda7f0ed None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:34:59.991469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ead30-173e-4ac2-9894-3421cda7f0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:00.010444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-707ead30-173e-4ac2-9894-3421cda7f0ed None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:00.011650 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-707ead30-173e-4ac2-9894-3421cda7f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:00.041514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6535f18-8d71-4d77-a3f1-9e942704b224 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:00.072712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 223/444] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:00.073510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ead30-173e-4ac2-9894-3421cda7f0ed None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:00.084592 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c4c99-adec-43a3-a896-41ab7d2ea0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:00.085269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c4c99-adec-43a3-a896-41ab7d2ea0c6 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:00.085551 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c4c99-adec-43a3-a896-41ab7d2ea0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:00.085822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c4c99-adec-43a3-a896-41ab7d2ea0c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:00.086682 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c4c99-adec-43a3-a896-41ab7d2ea0c6 None admin] RBAC: Adding query filter params (group.id=fd1b13ec40364c0d8725b3e3c55f7439, role.id=2f5b0d90f1814fe8a58210b5cd048bf7, scope.project.id=7679b9c9048648c08cf01ca7f0b58d36) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:00.086996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c4c99-adec-43a3-a896-41ab7d2ea0c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:00.088445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c4c99-adec-43a3-a896-41ab7d2ea0c6 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:00.094456 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 222/445] 10.222.0.73 () {56 vars in 1376 bytes} [Wed May 4 13:34:59 2022] GET /identity/v3/role_assignments?group.id=fd1b13ec40364c0d8725b3e3c55f7439&scope.project.id=7679b9c9048648c08cf01ca7f0b58d36&role.id=2f5b0d90f1814fe8a58210b5cd048bf7 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:00.095812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c4c99-adec-43a3-a896-41ab7d2ea0c6 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:00.175493 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ead30-173e-4ac2-9894-3421cda7f0ed None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:00.200343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c4c99-adec-43a3-a896-41ab7d2ea0c6 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:00.211183 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffedb6-1ad4-4d4d-b297-17a50dce83fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:00.212050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffedb6-1ad4-4d4d-b297-17a50dce83fa None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:00.212171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffedb6-1ad4-4d4d-b297-17a50dce83fa None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:00.212407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffedb6-1ad4-4d4d-b297-17a50dce83fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:00.239536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01072ff6-419b-482f-9170-09e2965f98ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:00.240437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01072ff6-419b-482f-9170-09e2965f98ed None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:00.240793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01072ff6-419b-482f-9170-09e2965f98ed None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:00.241142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01072ff6-419b-482f-9170-09e2965f98ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:00.252425 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01072ff6-419b-482f-9170-09e2965f98ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-01072ff6-419b-482f-9170-09e2965f98ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:00.260295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:00.261248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:00.262232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 223/446] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:00.268127 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01072ff6-419b-482f-9170-09e2965f98ed None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:00.287224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffedb6-1ad4-4d4d-b297-17a50dce83fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:00.288716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffedb6-1ad4-4d4d-b297-17a50dce83fa None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:00.386409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01072ff6-419b-482f-9170-09e2965f98ed None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:00.398026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 224/447] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:00.404171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffedb6-1ad4-4d4d-b297-17a50dce83fa None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:00.425840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02e450-29d0-4a67-b5c9-a596dacf4edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:00.426509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02e450-29d0-4a67-b5c9-a596dacf4edd None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:00.426789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02e450-29d0-4a67-b5c9-a596dacf4edd None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:00.427058 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02e450-29d0-4a67-b5c9-a596dacf4edd None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:00.428305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02e450-29d0-4a67-b5c9-a596dacf4edd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:00.428305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02e450-29d0-4a67-b5c9-a596dacf4edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:00.429464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02e450-29d0-4a67-b5c9-a596dacf4edd None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:00.442662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 224/448] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:00.444467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02e450-29d0-4a67-b5c9-a596dacf4edd None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:00.511943 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffedb6-1ad4-4d4d-b297-17a50dce83fa None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:00.544199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02acce-5029-4f65-979f-9454ac7659b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:00.544789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02e450-29d0-4a67-b5c9-a596dacf4edd None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:00.545172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02acce-5029-4f65-979f-9454ac7659b7 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:00.545346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02acce-5029-4f65-979f-9454ac7659b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:00.545620 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02acce-5029-4f65-979f-9454ac7659b7 None admin] PATH_INFO: `/v3/projects/7679b9c9048648c08cf01ca7f0b58d36` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:00.546795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02acce-5029-4f65-979f-9454ac7659b7 None admin] RBAC: Authorizing `identity:get_project(project_id=7679b9c9048648c08cf01ca7f0b58d36)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:00.548265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02acce-5029-4f65-979f-9454ac7659b7 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:00.549934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 225/449] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:35:00 2022] GET /identity/v3/projects/7679b9c9048648c08cf01ca7f0b58d36 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:00.555259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02acce-5029-4f65-979f-9454ac7659b7 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:00.576276 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4418fe9-45aa-46f6-85e6-398940dbccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:00.577381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4418fe9-45aa-46f6-85e6-398940dbccba None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:00.577668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4418fe9-45aa-46f6-85e6-398940dbccba None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:00.577947 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4418fe9-45aa-46f6-85e6-398940dbccba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:00.642420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4418fe9-45aa-46f6-85e6-398940dbccba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:00.643893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4418fe9-45aa-46f6-85e6-398940dbccba None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:00.647247 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02acce-5029-4f65-979f-9454ac7659b7 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:00.678460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1ccb6-cf92-48a4-9bd5-d87a7cd1284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:00.679322 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1ccb6-cf92-48a4-9bd5-d87a7cd1284c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:00.679600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1ccb6-cf92-48a4-9bd5-d87a7cd1284c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:00.679869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1ccb6-cf92-48a4-9bd5-d87a7cd1284c None admin] PATH_INFO: `/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:00.681005 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1ccb6-cf92-48a4-9bd5-d87a7cd1284c None admin] RBAC: Authorizing `identity:get_group(group_id=fd1b13ec40364c0d8725b3e3c55f7439)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:00.682433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1ccb6-cf92-48a4-9bd5-d87a7cd1284c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:00.684162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 226/450] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:35:00 2022] GET /identity/v3/groups/fd1b13ec40364c0d8725b3e3c55f7439 => generated 226 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:00.690111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1ccb6-cf92-48a4-9bd5-d87a7cd1284c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:00.737778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 225/451] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:00.743186 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4418fe9-45aa-46f6-85e6-398940dbccba None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:00.783413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1ccb6-cf92-48a4-9bd5-d87a7cd1284c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:00.814284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ed6d-0633-4629-9735-88614d6ff448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:00.814921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ed6d-0633-4629-9735-88614d6ff448 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:00.815199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ed6d-0633-4629-9735-88614d6ff448 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:00.815501 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ed6d-0633-4629-9735-88614d6ff448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:00.816317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489ed6d-0633-4629-9735-88614d6ff448 None admin] RBAC: Adding query filter params (group.id=fd1b13ec40364c0d8725b3e3c55f7439, role.id=142e36ee06a7422e8e8d32a1080ea89a, scope.project.id=7679b9c9048648c08cf01ca7f0b58d36) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:00.816626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489ed6d-0633-4629-9735-88614d6ff448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:00.818034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489ed6d-0633-4629-9735-88614d6ff448 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:00.823840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 227/452] 10.222.0.73 () {56 vars in 1376 bytes} [Wed May 4 13:35:00 2022] GET /identity/v3/role_assignments?group.id=fd1b13ec40364c0d8725b3e3c55f7439&scope.project.id=7679b9c9048648c08cf01ca7f0b58d36&role.id=142e36ee06a7422e8e8d32a1080ea89a => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:00.833963 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4418fe9-45aa-46f6-85e6-398940dbccba None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:00.870053 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210340b7-2c1a-48d1-8ea3-0a18153412a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:00.870919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210340b7-2c1a-48d1-8ea3-0a18153412a7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:00.871198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210340b7-2c1a-48d1-8ea3-0a18153412a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:00.871495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210340b7-2c1a-48d1-8ea3-0a18153412a7 None admin] PATH_INFO: `/v3/projects/f25742121cef4f95a3f20f4e6e3a0601` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:00.872705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210340b7-2c1a-48d1-8ea3-0a18153412a7 None admin] RBAC: Authorizing `identity:get_project(project_id=f25742121cef4f95a3f20f4e6e3a0601)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:00.874787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210340b7-2c1a-48d1-8ea3-0a18153412a7 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:00.876585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 226/453] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:35:00 2022] GET /identity/v3/projects/f25742121cef4f95a3f20f4e6e3a0601 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:00.882325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ed6d-0633-4629-9735-88614d6ff448 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:00.983735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ed6d-0633-4629-9735-88614d6ff448 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:01.016175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a06810-5d66-46df-839a-feec6a6eea9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:01.017028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a06810-5d66-46df-839a-feec6a6eea9f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:01.017312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a06810-5d66-46df-839a-feec6a6eea9f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:01.017587 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a06810-5d66-46df-839a-feec6a6eea9f None admin] PATH_INFO: `/v3/groups/9320be0da03640779c9bf0ede2b99b21` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:01.018773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a06810-5d66-46df-839a-feec6a6eea9f None admin] RBAC: Authorizing `identity:get_group(group_id=9320be0da03640779c9bf0ede2b99b21)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:01.020240 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a06810-5d66-46df-839a-feec6a6eea9f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:01.021842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 228/454] 10.222.0.73 () {56 vars in 1180 bytes} [Wed May 4 13:35:00 2022] GET /identity/v3/groups/9320be0da03640779c9bf0ede2b99b21 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:01.027766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210340b7-2c1a-48d1-8ea3-0a18153412a7 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:01.126373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210340b7-2c1a-48d1-8ea3-0a18153412a7 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:01.160364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9748f88-9cf1-46e8-8fc1-5f1d02a1aa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:01.161012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9748f88-9cf1-46e8-8fc1-5f1d02a1aa3d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:01.161287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9748f88-9cf1-46e8-8fc1-5f1d02a1aa3d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:01.161554 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9748f88-9cf1-46e8-8fc1-5f1d02a1aa3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:01.162380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9748f88-9cf1-46e8-8fc1-5f1d02a1aa3d None admin] RBAC: Adding query filter params (group.id=9320be0da03640779c9bf0ede2b99b21, role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=f25742121cef4f95a3f20f4e6e3a0601) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:01.162681 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9748f88-9cf1-46e8-8fc1-5f1d02a1aa3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:01.164114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9748f88-9cf1-46e8-8fc1-5f1d02a1aa3d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:01.169757 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 227/455] 10.222.0.73 () {56 vars in 1376 bytes} [Wed May 4 13:35:01 2022] GET /identity/v3/role_assignments?group.id=9320be0da03640779c9bf0ede2b99b21&scope.project.id=f25742121cef4f95a3f20f4e6e3a0601&role.id=70e67f35994843ae942d4f1703d5619e => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:04.055056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d286-98a0-498d-a136-c03d3fcf296f None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.055605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d286-98a0-498d-a136-c03d3fcf296f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.055605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d286-98a0-498d-a136-c03d3fcf296f None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.057037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 229/456] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:04.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8daef-d78a-4d86-8c5e-8f733a5fa929 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.062773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8daef-d78a-4d86-8c5e-8f733a5fa929 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.062946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8daef-d78a-4d86-8c5e-8f733a5fa929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.082789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a2f8daef-d78a-4d86-8c5e-8f733a5fa929 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:04.084144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a2f8daef-d78a-4d86-8c5e-8f733a5fa929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:04.160759 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde49ebf-88d3-454c-9e41-a134c4c9e034 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.161068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde49ebf-88d3-454c-9e41-a134c4c9e034 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.161327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde49ebf-88d3-454c-9e41-a134c4c9e034 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.164023 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 230/457] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:04.168119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351a0fd-076e-4faa-8244-67636df7de60 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.168252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 228/458] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:04.168534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351a0fd-076e-4faa-8244-67636df7de60 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.168820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351a0fd-076e-4faa-8244-67636df7de60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.194139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-8351a0fd-076e-4faa-8244-67636df7de60 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:04.195627 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8351a0fd-076e-4faa-8244-67636df7de60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:04.197735 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53b1cf-3050-46c9-92e9-818aa2510037 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.198021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53b1cf-3050-46c9-92e9-818aa2510037 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.198298 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53b1cf-3050-46c9-92e9-818aa2510037 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.199802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 229/459] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:04.206554 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a72ea-f9dd-4dc9-aeb4-a0fbfb2716f8 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.206833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a72ea-f9dd-4dc9-aeb4-a0fbfb2716f8 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.207107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a72ea-f9dd-4dc9-aeb4-a0fbfb2716f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.230154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-474a72ea-f9dd-4dc9-aeb4-a0fbfb2716f8 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:04.231831 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-474a72ea-f9dd-4dc9-aeb4-a0fbfb2716f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:04.277513 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 231/460] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:04.278387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351a0fd-076e-4faa-8244-67636df7de60 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:04.331398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 230/461] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:04.332301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a72ea-f9dd-4dc9-aeb4-a0fbfb2716f8 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:04.389939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351a0fd-076e-4faa-8244-67636df7de60 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:04.423176 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b36518-25bc-4f77-84ee-139b527be8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:04.424005 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b36518-25bc-4f77-84ee-139b527be8da None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.424282 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b36518-25bc-4f77-84ee-139b527be8da None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.424556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b36518-25bc-4f77-84ee-139b527be8da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.434921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b36518-25bc-4f77-84ee-139b527be8da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:04.436425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b36518-25bc-4f77-84ee-139b527be8da None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-b3b36518-25bc-4f77-84ee-139b527be8da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:04.455054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:04.455973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:04.457263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:04.457263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:04.457263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:04.457263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:04.457263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 232/462] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:04.457263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b36518-25bc-4f77-84ee-139b527be8da None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:04.464077 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a72ea-f9dd-4dc9-aeb4-a0fbfb2716f8 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:04.498438 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0776cda-a403-4fa3-b07e-6ae9bdfc9444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:04.499420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0776cda-a403-4fa3-b07e-6ae9bdfc9444 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.499793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0776cda-a403-4fa3-b07e-6ae9bdfc9444 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.500158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0776cda-a403-4fa3-b07e-6ae9bdfc9444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.511014 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0776cda-a403-4fa3-b07e-6ae9bdfc9444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:04.512612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0776cda-a403-4fa3-b07e-6ae9bdfc9444 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-b0776cda-a403-4fa3-b07e-6ae9bdfc9444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:04.531409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:04.533104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:04.535259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:04.535259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:04.535259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:04.535259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:04.538677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 231/463] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:04.543261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0776cda-a403-4fa3-b07e-6ae9bdfc9444 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:04.577408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b36518-25bc-4f77-84ee-139b527be8da None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:04.621572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eaff2-e5fd-41a6-bacc-0d0b199ce496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:04.622365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eaff2-e5fd-41a6-bacc-0d0b199ce496 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.622639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eaff2-e5fd-41a6-bacc-0d0b199ce496 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.622917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eaff2-e5fd-41a6-bacc-0d0b199ce496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.633688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2eaff2-e5fd-41a6-bacc-0d0b199ce496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:04.635149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2eaff2-e5fd-41a6-bacc-0d0b199ce496 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:04.647805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0776cda-a403-4fa3-b07e-6ae9bdfc9444 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-dc2eaff2-e5fd-41a6-bacc-0d0b199ce496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:04.653022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:04.655020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:04.657212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:04.657212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:04.657212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:04.657212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:04.663445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 233/464] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:04.663445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eaff2-e5fd-41a6-bacc-0d0b199ce496 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:04.687115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4a0b0-de96-416e-a256-b12a7c08b57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:04.688372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4a0b0-de96-416e-a256-b12a7c08b57b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.688660 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4a0b0-de96-416e-a256-b12a7c08b57b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.688937 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4a0b0-de96-416e-a256-b12a7c08b57b None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.689826 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4a0b0-de96-416e-a256-b12a7c08b57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:04.690137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4a0b0-de96-416e-a256-b12a7c08b57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:04.692095 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4a0b0-de96-416e-a256-b12a7c08b57b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:04.711307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 232/465] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:04.712215 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4a0b0-de96-416e-a256-b12a7c08b57b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:04.776289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2eaff2-e5fd-41a6-bacc-0d0b199ce496 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:04.808119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4a0b0-de96-416e-a256-b12a7c08b57b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:04.809585 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2991a15-5873-4892-82c3-0af33551a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:04.810257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2991a15-5873-4892-82c3-0af33551a332 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.810535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2991a15-5873-4892-82c3-0af33551a332 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.811377 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2991a15-5873-4892-82c3-0af33551a332 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.812112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2991a15-5873-4892-82c3-0af33551a332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:04.812421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2991a15-5873-4892-82c3-0af33551a332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:04.813802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2991a15-5873-4892-82c3-0af33551a332 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:04.825244 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 234/466] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:04.826332 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2991a15-5873-4892-82c3-0af33551a332 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:04.846847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba05b95-f2fb-4bb3-b284-74973dc4982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:04.847463 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba05b95-f2fb-4bb3-b284-74973dc4982e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.847749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba05b95-f2fb-4bb3-b284-74973dc4982e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.848025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba05b95-f2fb-4bb3-b284-74973dc4982e None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.848743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba05b95-f2fb-4bb3-b284-74973dc4982e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:04.849045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba05b95-f2fb-4bb3-b284-74973dc4982e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:04.850392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba05b95-f2fb-4bb3-b284-74973dc4982e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:04.865460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 233/467] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:04.865460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ceb94c-fa3b-4201-b7b0-d98ce03e6cc3 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.865460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ceb94c-fa3b-4201-b7b0-d98ce03e6cc3 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.865460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ceb94c-fa3b-4201-b7b0-d98ce03e6cc3 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.865460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 234/468] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:04.865460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ceb94c-fa3b-4201-b7b0-d98ce03e6cc3 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:04.947146 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2991a15-5873-4892-82c3-0af33551a332 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:04.970065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ceb94c-fa3b-4201-b7b0-d98ce03e6cc3 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:04.990893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18255dc7-33e5-45a1-8077-243c965d9f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:04.991678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18255dc7-33e5-45a1-8077-243c965d9f41 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:04.991964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18255dc7-33e5-45a1-8077-243c965d9f41 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:04.992243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18255dc7-33e5-45a1-8077-243c965d9f41 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:04.992951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18255dc7-33e5-45a1-8077-243c965d9f41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:04.994404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18255dc7-33e5-45a1-8077-243c965d9f41 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:05.003072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d4c62-a510-4234-9541-6daee0b672b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:05.003873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d4c62-a510-4234-9541-6daee0b672b4 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:05.004147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d4c62-a510-4234-9541-6daee0b672b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:05.004471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d4c62-a510-4234-9541-6daee0b672b4 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:05.005320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d4c62-a510-4234-9541-6daee0b672b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:05.006890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d4c62-a510-4234-9541-6daee0b672b4 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:05.023534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 235/469] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:35:04 2022] POST /identity/v3/users => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:05.023534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18255dc7-33e5-45a1-8077-243c965d9f41 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:05.043420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 235/470] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:35:04 2022] POST /identity/v3/users => generated 248 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:05.045024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49733374-2538-4169-b2d0-5cd6d9d27a2e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:05.045889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49733374-2538-4169-b2d0-5cd6d9d27a2e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:05.046168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49733374-2538-4169-b2d0-5cd6d9d27a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:05.089845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-49733374-2538-4169-b2d0-5cd6d9d27a2e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:05.091089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-49733374-2538-4169-b2d0-5cd6d9d27a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:05.162504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18255dc7-33e5-45a1-8077-243c965d9f41 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:05.177986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 236/471] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:05.177986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcab71-52f4-4da1-8528-44e41db48f62 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:05.177986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcab71-52f4-4da1-8528-44e41db48f62 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:05.177986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcab71-52f4-4da1-8528-44e41db48f62 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:05.181629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 237/472] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:05.183103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba82f1e-aff6-4255-9611-88d46d6d82b7 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:05.183410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba82f1e-aff6-4255-9611-88d46d6d82b7 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:05.183851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba82f1e-aff6-4255-9611-88d46d6d82b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:05.216234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-9ba82f1e-aff6-4255-9611-88d46d6d82b7 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:05.217504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-9ba82f1e-aff6-4255-9611-88d46d6d82b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:05.225601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9538328-b973-4189-8888-48fc263b62ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:05.227356 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9538328-b973-4189-8888-48fc263b62ef None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:05.227832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9538328-b973-4189-8888-48fc263b62ef None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:05.228113 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9538328-b973-4189-8888-48fc263b62ef None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:05.229953 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9538328-b973-4189-8888-48fc263b62ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:05.232138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9538328-b973-4189-8888-48fc263b62ef None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:05.257823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 236/473] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:35:05 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:05.258956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9538328-b973-4189-8888-48fc263b62ef None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:05.302692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 238/474] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:05.328085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba82f1e-aff6-4255-9611-88d46d6d82b7 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:05.408516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9538328-b973-4189-8888-48fc263b62ef None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:05.453366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee43d6-fe9b-47b0-96ee-9542d5e632e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:05.454533 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee43d6-fe9b-47b0-96ee-9542d5e632e1 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:05.454793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba82f1e-aff6-4255-9611-88d46d6d82b7 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:05.455268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee43d6-fe9b-47b0-96ee-9542d5e632e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:05.455746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee43d6-fe9b-47b0-96ee-9542d5e632e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:05.468236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee43d6-fe9b-47b0-96ee-9542d5e632e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:05.470065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee43d6-fe9b-47b0-96ee-9542d5e632e1 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-20ee43d6-fe9b-47b0-96ee-9542d5e632e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:05.488612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:05.489547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:05.490383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:05.490383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:05.490383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:05.490383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:05.491953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645611c7-a12a-4cd0-b9b6-6f54198466b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:05.492669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645611c7-a12a-4cd0-b9b6-6f54198466b8 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:05.492911 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645611c7-a12a-4cd0-b9b6-6f54198466b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:05.493236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645611c7-a12a-4cd0-b9b6-6f54198466b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:05.493451 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 237/475] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:05.493930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645611c7-a12a-4cd0-b9b6-6f54198466b8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:05.499084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645611c7-a12a-4cd0-b9b6-6f54198466b8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:05.500947 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee43d6-fe9b-47b0-96ee-9542d5e632e1 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:05.512314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.sql.core [None req-645611c7-a12a-4cd0-b9b6-6f54198466b8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 13:35:05.512314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 13:35:05.512314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [parameters: {'id': 'cc4392c29c5041b1b15a6188ad809e55', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 13:35:05.512314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86423) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-645611c7-a12a-4cd0-b9b6-6f54198466b8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application result = self._query(query) May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application conn.query(q) May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application result.read() May 04 13:35:05.536452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return ref.to_dict() May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 13:35:05.537361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application next(self.gen) May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application yield resource May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application next(self.gen) May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self.session.rollback() May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self.force_reraise() May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise self.value May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application session.commit() May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 13:35:05.538380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._prepare_impl() May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self.session.flush() May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._flush(objects) May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application compat.raise_( May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application flush_context.execute() May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rec.execute(self) May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 13:35:05.539260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 13:35:05.540149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application result = self._query(query) May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application conn.query(q) May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application result.read() May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 13:35:05.540966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [parameters: {'id': 'cc4392c29c5041b1b15a6188ad809e55', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:05.541732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 13:35:05.542514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:05.544891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 239/476] 10.222.0.73 () {60 vars in 1131 bytes} [Wed May 4 13:35:05 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:05.544891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645611c7-a12a-4cd0-b9b6-6f54198466b8 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:05.637273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee43d6-fe9b-47b0-96ee-9542d5e632e1 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:05.661591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645611c7-a12a-4cd0-b9b6-6f54198466b8 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:05.700315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990c58-1613-4404-b7c8-6ea2bc260fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:05.701280 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990c58-1613-4404-b7c8-6ea2bc260fd6 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:05.701612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990c58-1613-4404-b7c8-6ea2bc260fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:05.701891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990c58-1613-4404-b7c8-6ea2bc260fd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:05.702534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9e56-5704-4bd3-b7b9-7c99ee58b090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:05.703500 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9e56-5704-4bd3-b7b9-7c99ee58b090 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:05.703993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9e56-5704-4bd3-b7b9-7c99ee58b090 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:05.704503 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9e56-5704-4bd3-b7b9-7c99ee58b090 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:05.705424 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c9e56-5704-4bd3-b7b9-7c99ee58b090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:05.705929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c9e56-5704-4bd3-b7b9-7c99ee58b090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:05.707511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c9e56-5704-4bd3-b7b9-7c99ee58b090 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:05.717534 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20990c58-1613-4404-b7c8-6ea2bc260fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:05.732150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 238/477] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-20990c58-1613-4404-b7c8-6ea2bc260fd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:05.733928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:05.734788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:05.735624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:05.735624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:05.735624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:05.735624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:05.735624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:05.735624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:05.735624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:05.735624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:05.735624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:05.735624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:05.735624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 13:35:05.735624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:05.736682 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 240/478] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:35:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:05.741469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9e56-5704-4bd3-b7b9-7c99ee58b090 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:05.748517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990c58-1613-4404-b7c8-6ea2bc260fd6 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:05.867655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9e56-5704-4bd3-b7b9-7c99ee58b090 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:05.916868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990c58-1613-4404-b7c8-6ea2bc260fd6 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:05.944944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93eaae-fd60-42b1-ac2c-b76dee34e86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:05.945890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93eaae-fd60-42b1-ac2c-b76dee34e86f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:05.946417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93eaae-fd60-42b1-ac2c-b76dee34e86f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:05.946417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93eaae-fd60-42b1-ac2c-b76dee34e86f None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:05.947245 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93eaae-fd60-42b1-ac2c-b76dee34e86f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:05.947514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93eaae-fd60-42b1-ac2c-b76dee34e86f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:05.955324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93eaae-fd60-42b1-ac2c-b76dee34e86f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:05.958262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec2009-b226-4516-9ca4-8bcbf0871d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:05.958939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec2009-b226-4516-9ca4-8bcbf0871d25 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:05.959241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec2009-b226-4516-9ca4-8bcbf0871d25 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:05.959518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec2009-b226-4516-9ca4-8bcbf0871d25 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:05.960225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec2009-b226-4516-9ca4-8bcbf0871d25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:05.961656 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec2009-b226-4516-9ca4-8bcbf0871d25 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:05.964984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 239/479] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:05.998060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 241/480] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:35:05 2022] POST /identity/v3/users => generated 249 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:07.829330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0537e9c-580b-4b6a-b818-401d365323ac None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:07.829903 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0537e9c-580b-4b6a-b818-401d365323ac None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:07.829903 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0537e9c-580b-4b6a-b818-401d365323ac None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:07.831646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 240/481] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:07.837229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b1dad-077b-4fd7-9b04-360155881f9b None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:07.837770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b1dad-077b-4fd7-9b04-360155881f9b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:07.837770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b1dad-077b-4fd7-9b04-360155881f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:07.856663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-562b1dad-077b-4fd7-9b04-360155881f9b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:07.858922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-562b1dad-077b-4fd7-9b04-360155881f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:07.942731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 242/482] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:07.970747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0537e9c-580b-4b6a-b818-401d365323ac None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:08.096928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0537e9c-580b-4b6a-b818-401d365323ac None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:08.140821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb4eca-5590-428b-bef9-230da77a83ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:08.141617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb4eca-5590-428b-bef9-230da77a83ed None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.141896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb4eca-5590-428b-bef9-230da77a83ed None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.142165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb4eca-5590-428b-bef9-230da77a83ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.152291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb4eca-5590-428b-bef9-230da77a83ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-58fb4eca-5590-428b-bef9-230da77a83ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:08.164985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:08.165909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:08.166786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 241/483] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:08.169609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912c0df-0e38-498b-a872-a354cb320d17 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.170413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912c0df-0e38-498b-a872-a354cb320d17 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.171112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912c0df-0e38-498b-a872-a354cb320d17 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.171715 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0953c-f470-4c45-9931-cbd4b41598fa None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.172002 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0953c-f470-4c45-9931-cbd4b41598fa None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.172282 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0953c-f470-4c45-9931-cbd4b41598fa None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.173719 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 243/485] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:08.173825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 242/485] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:08.178001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0953c-f470-4c45-9931-cbd4b41598fa None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:08.179598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad784c-fb26-4455-99f2-602fc186f77b None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.180092 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad784c-fb26-4455-99f2-602fc186f77b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.180584 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad784c-fb26-4455-99f2-602fc186f77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.198155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-23ad784c-fb26-4455-99f2-602fc186f77b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:08.199712 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-23ad784c-fb26-4455-99f2-602fc186f77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:08.276415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 244/486] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:35:08.284767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4033d1-a589-4d7d-bafa-56970e8eac34 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.285311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4033d1-a589-4d7d-bafa-56970e8eac34 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.285792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4033d1-a589-4d7d-bafa-56970e8eac34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.313731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0953c-f470-4c45-9931-cbd4b41598fa None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:08.318651 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-6a4033d1-a589-4d7d-bafa-56970e8eac34 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:08.320367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6a4033d1-a589-4d7d-bafa-56970e8eac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:08.357551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eade15f-2c60-44c0-b436-78fbaf51be98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:08.358140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eade15f-2c60-44c0-b436-78fbaf51be98 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.358431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eade15f-2c60-44c0-b436-78fbaf51be98 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.358700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eade15f-2c60-44c0-b436-78fbaf51be98 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.359473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eade15f-2c60-44c0-b436-78fbaf51be98 None admin] RBAC: Adding query filter params (name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:08.359779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eade15f-2c60-44c0-b436-78fbaf51be98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:08.361165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eade15f-2c60-44c0-b436-78fbaf51be98 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:08.369526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 243/487] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:08.370094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eade15f-2c60-44c0-b436-78fbaf51be98 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:08.392289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 245/488] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:08.393588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4033d1-a589-4d7d-bafa-56970e8eac34 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:08.493265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eade15f-2c60-44c0-b436-78fbaf51be98 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:08.494404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4033d1-a589-4d7d-bafa-56970e8eac34 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:08.527697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12040819-e5a5-4d21-a5dc-ef2d30384bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:08.528675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12040819-e5a5-4d21-a5dc-ef2d30384bea None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.528960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12040819-e5a5-4d21-a5dc-ef2d30384bea None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.529236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12040819-e5a5-4d21-a5dc-ef2d30384bea None admin] PATH_INFO: `/v3/roles/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.532350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff4629-023a-4cf0-87d0-9cf0d65dd5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:08.533373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff4629-023a-4cf0-87d0-9cf0d65dd5c0 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.533870 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff4629-023a-4cf0-87d0-9cf0d65dd5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.534341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff4629-023a-4cf0-87d0-9cf0d65dd5c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.540077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12040819-e5a5-4d21-a5dc-ef2d30384bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:08.545350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff4629-023a-4cf0-87d0-9cf0d65dd5c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:08.547026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff4629-023a-4cf0-87d0-9cf0d65dd5c0 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-12040819-e5a5-4d21-a5dc-ef2d30384bea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:08.548035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:08.548939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:08.549744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 244/489] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:08.550411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12040819-e5a5-4d21-a5dc-ef2d30384bea None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-95ff4629-023a-4cf0-87d0-9cf0d65dd5c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:08.574406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:08.575349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:08.576285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:08.576285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:08.576285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:08.576285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:08.578998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 246/490] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:08.580096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff4629-023a-4cf0-87d0-9cf0d65dd5c0 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:08.650979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12040819-e5a5-4d21-a5dc-ef2d30384bea None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:08.687639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff4629-023a-4cf0-87d0-9cf0d65dd5c0 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:08.689117 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1392-cc9d-4301-b19d-127dea6f65e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:08.689956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1392-cc9d-4301-b19d-127dea6f65e6 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.690351 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1392-cc9d-4301-b19d-127dea6f65e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.690522 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1392-cc9d-4301-b19d-127dea6f65e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.703431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff1392-cc9d-4301-b19d-127dea6f65e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-19ff1392-cc9d-4301-b19d-127dea6f65e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:08.711433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:08.712361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:08.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 245/491] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:08.714473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1392-cc9d-4301-b19d-127dea6f65e6 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:08.734771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb550e7-f588-4444-9354-adaa2362d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:08.735849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb550e7-f588-4444-9354-adaa2362d202 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.736337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb550e7-f588-4444-9354-adaa2362d202 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.736813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb550e7-f588-4444-9354-adaa2362d202 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.737789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb550e7-f588-4444-9354-adaa2362d202 None admin] RBAC: Adding query filter params (name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:08.738311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb550e7-f588-4444-9354-adaa2362d202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:08.740202 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb550e7-f588-4444-9354-adaa2362d202 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:08.750069 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 247/492] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:08.751360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb550e7-f588-4444-9354-adaa2362d202 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:08.818970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1392-cc9d-4301-b19d-127dea6f65e6 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:08.854220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb550e7-f588-4444-9354-adaa2362d202 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:08.855426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd20831-5273-4570-858d-0fa9825719dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:08.856625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd20831-5273-4570-858d-0fa9825719dd None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.856978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd20831-5273-4570-858d-0fa9825719dd None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.857260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd20831-5273-4570-858d-0fa9825719dd None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.858627 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd20831-5273-4570-858d-0fa9825719dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:08.858939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd20831-5273-4570-858d-0fa9825719dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:08.860350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd20831-5273-4570-858d-0fa9825719dd None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:08.875340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 246/493] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:08.875340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd20831-5273-4570-858d-0fa9825719dd None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:08.890080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef86a3-361c-49f4-8f23-0ae4f39aab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:08.890743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef86a3-361c-49f4-8f23-0ae4f39aab56 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.891019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef86a3-361c-49f4-8f23-0ae4f39aab56 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.891314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef86a3-361c-49f4-8f23-0ae4f39aab56 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.892057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef86a3-361c-49f4-8f23-0ae4f39aab56 None admin] RBAC: Adding query filter params (name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:08.892360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef86a3-361c-49f4-8f23-0ae4f39aab56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:08.893693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef86a3-361c-49f4-8f23-0ae4f39aab56 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:08.901422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 248/494] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:08.902524 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12074d3-65c7-432c-b0e6-3f52ea8446ae None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.902816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12074d3-65c7-432c-b0e6-3f52ea8446ae None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.903092 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12074d3-65c7-432c-b0e6-3f52ea8446ae None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.904344 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 249/495] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:08.905473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb9525-0d0c-4c3c-87db-1cd21e8eb139 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:08.905760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb9525-0d0c-4c3c-87db-1cd21e8eb139 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:08.906032 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb9525-0d0c-4c3c-87db-1cd21e8eb139 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:08.907244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 250/496] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:08.907938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb9525-0d0c-4c3c-87db-1cd21e8eb139 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:08.971704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd20831-5273-4570-858d-0fa9825719dd None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:09.002956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb9525-0d0c-4c3c-87db-1cd21e8eb139 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:09.003861 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e757d3-c7a2-43ab-a80e-8cdc9403572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:09.004644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e757d3-c7a2-43ab-a80e-8cdc9403572f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.004926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e757d3-c7a2-43ab-a80e-8cdc9403572f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.005201 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e757d3-c7a2-43ab-a80e-8cdc9403572f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.015028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e757d3-c7a2-43ab-a80e-8cdc9403572f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:09.016514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e757d3-c7a2-43ab-a80e-8cdc9403572f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-e4e757d3-c7a2-43ab-a80e-8cdc9403572f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:09.033776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:09.034805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:09.035883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:09.035883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:09.035883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:09.035883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:09.035883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 247/497] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:09.035883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e757d3-c7a2-43ab-a80e-8cdc9403572f None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:09.036198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c7b28-f435-4cf5-b75d-4bdd3752744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:09.036826 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c7b28-f435-4cf5-b75d-4bdd3752744b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.037111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c7b28-f435-4cf5-b75d-4bdd3752744b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.037383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c7b28-f435-4cf5-b75d-4bdd3752744b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.045444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c7b28-f435-4cf5-b75d-4bdd3752744b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:09.046856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c7b28-f435-4cf5-b75d-4bdd3752744b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-6b4c7b28-f435-4cf5-b75d-4bdd3752744b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:09.062417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:09.063375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:09.064279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:09.064279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:09.064279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:09.064279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:09.064279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:09.064279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:09.064279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:09.064279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:09.064279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:35:09.064279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:09.064279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 251/498] 10.222.0.73 () {56 vars in 1093 bytes} [Wed May 4 13:35:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:09.065157 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566659-05ec-4c02-91a2-c56b6a323a74 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.065469 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566659-05ec-4c02-91a2-c56b6a323a74 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.065711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566659-05ec-4c02-91a2-c56b6a323a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.081739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-89566659-05ec-4c02-91a2-c56b6a323a74 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:09.082890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-89566659-05ec-4c02-91a2-c56b6a323a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:09.136059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e757d3-c7a2-43ab-a80e-8cdc9403572f None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:09.144925 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 252/499] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:09.146338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45a96f-c5f0-4a39-a8c9-d5625c04d85d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.146630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45a96f-c5f0-4a39-a8c9-d5625c04d85d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.146903 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45a96f-c5f0-4a39-a8c9-d5625c04d85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.162563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-fd45a96f-c5f0-4a39-a8c9-d5625c04d85d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:09.163727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fd45a96f-c5f0-4a39-a8c9-d5625c04d85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:09.169702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343d09-000f-444a-8d86-6267d94e44da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:09.171115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343d09-000f-444a-8d86-6267d94e44da None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.171419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343d09-000f-444a-8d86-6267d94e44da None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.171701 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343d09-000f-444a-8d86-6267d94e44da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.181616 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343d09-000f-444a-8d86-6267d94e44da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:09.183039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343d09-000f-444a-8d86-6267d94e44da None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-e3343d09-000f-444a-8d86-6267d94e44da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:09.200274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:09.201143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:09.206792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:09.206792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:09.206792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:09.206792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:09.206792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 248/500] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:09.206792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343d09-000f-444a-8d86-6267d94e44da None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:09.231576 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 253/501] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:09.232443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45a96f-c5f0-4a39-a8c9-d5625c04d85d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:09.311455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343d09-000f-444a-8d86-6267d94e44da None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:09.327585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45a96f-c5f0-4a39-a8c9-d5625c04d85d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:09.342573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f45aa-61c8-4e5f-b3f9-4bb8e2373c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:09.343232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f45aa-61c8-4e5f-b3f9-4bb8e2373c1e None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.343526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f45aa-61c8-4e5f-b3f9-4bb8e2373c1e None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.343799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f45aa-61c8-4e5f-b3f9-4bb8e2373c1e None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.344507 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f45aa-61c8-4e5f-b3f9-4bb8e2373c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:09.344808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f45aa-61c8-4e5f-b3f9-4bb8e2373c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:09.346155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f45aa-61c8-4e5f-b3f9-4bb8e2373c1e None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:09.357091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 249/502] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:09.358480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f45aa-61c8-4e5f-b3f9-4bb8e2373c1e None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:09.364081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac7cca-2c07-4f5a-8fe2-de07bc9aa926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:09.364750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac7cca-2c07-4f5a-8fe2-de07bc9aa926 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.365027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac7cca-2c07-4f5a-8fe2-de07bc9aa926 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.365297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac7cca-2c07-4f5a-8fe2-de07bc9aa926 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.366138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac7cca-2c07-4f5a-8fe2-de07bc9aa926 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:09.366439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac7cca-2c07-4f5a-8fe2-de07bc9aa926 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:09.367882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac7cca-2c07-4f5a-8fe2-de07bc9aa926 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:09.403359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 254/503] 10.222.0.73 () {56 vars in 1133 bytes} [Wed May 4 13:35:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:09.404221 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac7cca-2c07-4f5a-8fe2-de07bc9aa926 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:09.454391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f45aa-61c8-4e5f-b3f9-4bb8e2373c1e None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:09.485725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e4686-e3ed-40a2-b9a2-5dc4f5b80e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:09.486498 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e4686-e3ed-40a2-b9a2-5dc4f5b80e17 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.486779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e4686-e3ed-40a2-b9a2-5dc4f5b80e17 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.487052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e4686-e3ed-40a2-b9a2-5dc4f5b80e17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.496886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e4686-e3ed-40a2-b9a2-5dc4f5b80e17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:09.497018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac7cca-2c07-4f5a-8fe2-de07bc9aa926 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:09.498345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e4686-e3ed-40a2-b9a2-5dc4f5b80e17 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-f01e4686-e3ed-40a2-b9a2-5dc4f5b80e17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:09.515358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:09.516419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:09.517279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:09.517279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:09.517279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:09.517279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:09.517279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 250/504] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:09.517279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e4686-e3ed-40a2-b9a2-5dc4f5b80e17 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:09.535382 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909d93c-0588-4da0-a1bb-bbf3521396e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:09.536046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909d93c-0588-4da0-a1bb-bbf3521396e1 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.536323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909d93c-0588-4da0-a1bb-bbf3521396e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.536598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909d93c-0588-4da0-a1bb-bbf3521396e1 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.537310 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909d93c-0588-4da0-a1bb-bbf3521396e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:09.537611 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909d93c-0588-4da0-a1bb-bbf3521396e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:09.538964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909d93c-0588-4da0-a1bb-bbf3521396e1 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:09.549612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 255/505] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:09.550371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909d93c-0588-4da0-a1bb-bbf3521396e1 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:09.611683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e4686-e3ed-40a2-b9a2-5dc4f5b80e17 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:09.642766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f36c9a-3400-48f6-ac62-0a4de65e8d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:09.643579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f36c9a-3400-48f6-ac62-0a4de65e8d37 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.643709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909d93c-0588-4da0-a1bb-bbf3521396e1 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:09.643865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f36c9a-3400-48f6-ac62-0a4de65e8d37 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.644132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f36c9a-3400-48f6-ac62-0a4de65e8d37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.653730 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f36c9a-3400-48f6-ac62-0a4de65e8d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-d8f36c9a-3400-48f6-ac62-0a4de65e8d37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:09.661820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:09.662778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:09.663603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 251/506] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:09.664272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f36c9a-3400-48f6-ac62-0a4de65e8d37 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:09.679820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca8c52-f0cc-47b0-8742-9ae9584458bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:09.680610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca8c52-f0cc-47b0-8742-9ae9584458bd None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.680894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca8c52-f0cc-47b0-8742-9ae9584458bd None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.681167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca8c52-f0cc-47b0-8742-9ae9584458bd None admin] PATH_INFO: `/v3/users/glance` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.688484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca8c52-f0cc-47b0-8742-9ae9584458bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:09.689917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca8c52-f0cc-47b0-8742-9ae9584458bd None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-98ca8c52-f0cc-47b0-8742-9ae9584458bd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:09.704363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:09.705299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:09.706208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:09.706208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:09.706208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:09.706208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:09.706208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:09.706208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:09.706208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:09.706208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:09.706208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 13:35:09.706208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:09.706208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 256/507] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:09.706803 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca8c52-f0cc-47b0-8742-9ae9584458bd None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:09.761941 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f36c9a-3400-48f6-ac62-0a4de65e8d37 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:09.793249 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa8602-3abd-4394-8210-518624d10c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:09.793873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa8602-3abd-4394-8210-518624d10c98 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.794147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa8602-3abd-4394-8210-518624d10c98 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.794424 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa8602-3abd-4394-8210-518624d10c98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.798893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca8c52-f0cc-47b0-8742-9ae9584458bd None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:09.830365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d91a9d-2e73-4957-b539-f088f4990c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:09.831002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d91a9d-2e73-4957-b539-f088f4990c40 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.831305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d91a9d-2e73-4957-b539-f088f4990c40 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.831580 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d91a9d-2e73-4957-b539-f088f4990c40 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.832290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d91a9d-2e73-4957-b539-f088f4990c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:09.832593 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d91a9d-2e73-4957-b539-f088f4990c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:09.833953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d91a9d-2e73-4957-b539-f088f4990c40 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:09.846795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 257/508] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:09.847625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d91a9d-2e73-4957-b539-f088f4990c40 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:09.856905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa8602-3abd-4394-8210-518624d10c98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:09.858384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa8602-3abd-4394-8210-518624d10c98 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:09.938593 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d91a9d-2e73-4957-b539-f088f4990c40 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:09.948408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 252/509] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:09.949060 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa8602-3abd-4394-8210-518624d10c98 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:09.970840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023154cb-874f-4cfa-898e-b6a448c015ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:09.971589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023154cb-874f-4cfa-898e-b6a448c015ef None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:09.971862 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023154cb-874f-4cfa-898e-b6a448c015ef None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:09.972133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023154cb-874f-4cfa-898e-b6a448c015ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:09.978813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023154cb-874f-4cfa-898e-b6a448c015ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:09.980251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023154cb-874f-4cfa-898e-b6a448c015ef None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-023154cb-874f-4cfa-898e-b6a448c015ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:09.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:09.995327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:10.001393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:10.001393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:10.001393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:10.001393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:10.001393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:10.001393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:10.001393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:10.001393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:10.001393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:35:10.001393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:10.001393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 258/510] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:10.001393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023154cb-874f-4cfa-898e-b6a448c015ef None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:10.039726 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa8602-3abd-4394-8210-518624d10c98 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:10.071588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d607ea2-4071-4eb2-8072-2be1b60c0d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:10.072232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d607ea2-4071-4eb2-8072-2be1b60c0d96 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:10.072506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d607ea2-4071-4eb2-8072-2be1b60c0d96 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:10.072777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d607ea2-4071-4eb2-8072-2be1b60c0d96 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:10.073513 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d607ea2-4071-4eb2-8072-2be1b60c0d96 None admin] RBAC: Adding query filter params (name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:10.073813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d607ea2-4071-4eb2-8072-2be1b60c0d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:10.075155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d607ea2-4071-4eb2-8072-2be1b60c0d96 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:10.083238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 253/511] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:10.083887 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d607ea2-4071-4eb2-8072-2be1b60c0d96 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:10.093342 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023154cb-874f-4cfa-898e-b6a448c015ef None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:10.125050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0ce41-e190-41a6-b7fa-1fe5923fbbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:10.125701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0ce41-e190-41a6-b7fa-1fe5923fbbdc None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:10.125977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0ce41-e190-41a6-b7fa-1fe5923fbbdc None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:10.126247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0ce41-e190-41a6-b7fa-1fe5923fbbdc None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:10.127064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0ce41-e190-41a6-b7fa-1fe5923fbbdc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:10.127494 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0ce41-e190-41a6-b7fa-1fe5923fbbdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:10.128880 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0ce41-e190-41a6-b7fa-1fe5923fbbdc None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:10.145567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 259/512] 10.222.0.73 () {56 vars in 1137 bytes} [Wed May 4 13:35:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:10.146338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0ce41-e190-41a6-b7fa-1fe5923fbbdc None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:10.175215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d607ea2-4071-4eb2-8072-2be1b60c0d96 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:10.207022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8dc6-2449-4056-ac90-824162b7c460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:10.207777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8dc6-2449-4056-ac90-824162b7c460 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:10.208058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8dc6-2449-4056-ac90-824162b7c460 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:10.208329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8dc6-2449-4056-ac90-824162b7c460 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:10.209024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e8dc6-2449-4056-ac90-824162b7c460 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:10.210510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e8dc6-2449-4056-ac90-824162b7c460 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:10.230170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 254/513] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:35:10 2022] POST /identity/v3/users => generated 247 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:10.231149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8dc6-2449-4056-ac90-824162b7c460 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:10.247357 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0ce41-e190-41a6-b7fa-1fe5923fbbdc None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:10.283636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96729482-dc2a-434e-a567-efcfcf614ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:10.284464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96729482-dc2a-434e-a567-efcfcf614ac1 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:10.284745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96729482-dc2a-434e-a567-efcfcf614ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:10.285016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96729482-dc2a-434e-a567-efcfcf614ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:10.297650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96729482-dc2a-434e-a567-efcfcf614ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:10.298932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96729482-dc2a-434e-a567-efcfcf614ac1 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-96729482-dc2a-434e-a567-efcfcf614ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:10.318495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:10.319431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:10.320562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:10.320562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:10.320562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:10.320562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:10.324974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 260/514] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:10.325856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96729482-dc2a-434e-a567-efcfcf614ac1 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:10.350702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8dc6-2449-4056-ac90-824162b7c460 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:10.385073 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50bae7-3bd2-46eb-810b-313963a2c68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:10.385751 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50bae7-3bd2-46eb-810b-313963a2c68e None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:10.386027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50bae7-3bd2-46eb-810b-313963a2c68e None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:10.386301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50bae7-3bd2-46eb-810b-313963a2c68e None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:10.387151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50bae7-3bd2-46eb-810b-313963a2c68e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:10.387486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50bae7-3bd2-46eb-810b-313963a2c68e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:10.389028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50bae7-3bd2-46eb-810b-313963a2c68e None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:10.426798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 255/515] 10.222.0.73 () {56 vars in 1137 bytes} [Wed May 4 13:35:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:10.428058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50bae7-3bd2-46eb-810b-313963a2c68e None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:10.438488 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96729482-dc2a-434e-a567-efcfcf614ac1 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:10.473627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884a42a-f548-42d9-93a2-ecb7a0229b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:10.474425 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884a42a-f548-42d9-93a2-ecb7a0229b25 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:10.474700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884a42a-f548-42d9-93a2-ecb7a0229b25 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:10.474967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884a42a-f548-42d9-93a2-ecb7a0229b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:10.487237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884a42a-f548-42d9-93a2-ecb7a0229b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:10.488594 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884a42a-f548-42d9-93a2-ecb7a0229b25 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-b884a42a-f548-42d9-93a2-ecb7a0229b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:10.506265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:10.507169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:10.508033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:10.508033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:10.508033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:10.508033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:10.511273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 261/516] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:10.512310 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884a42a-f548-42d9-93a2-ecb7a0229b25 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:10.537504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50bae7-3bd2-46eb-810b-313963a2c68e None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:10.571830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74163e8e-05cb-4f9e-82ab-7a50e026009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:10.572481 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74163e8e-05cb-4f9e-82ab-7a50e026009f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:10.572751 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74163e8e-05cb-4f9e-82ab-7a50e026009f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:10.573051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74163e8e-05cb-4f9e-82ab-7a50e026009f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:10.609802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884a42a-f548-42d9-93a2-ecb7a0229b25 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:10.637012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74163e8e-05cb-4f9e-82ab-7a50e026009f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:10.638484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74163e8e-05cb-4f9e-82ab-7a50e026009f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:10.643830 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e0477-129d-4d1e-9667-384f434d2f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:10.644679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e0477-129d-4d1e-9667-384f434d2f58 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:10.645107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e0477-129d-4d1e-9667-384f434d2f58 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:10.645529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e0477-129d-4d1e-9667-384f434d2f58 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:10.646414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e0477-129d-4d1e-9667-384f434d2f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:10.646865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e0477-129d-4d1e-9667-384f434d2f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:10.648387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e0477-129d-4d1e-9667-384f434d2f58 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:10.660851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 262/517] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:10.661891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e0477-129d-4d1e-9667-384f434d2f58 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:10.737382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 256/518] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:10.737382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74163e8e-05cb-4f9e-82ab-7a50e026009f None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:10.758697 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e0477-129d-4d1e-9667-384f434d2f58 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:10.792315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cd95a-19ed-49e5-8241-146a2d6e15c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:10.793050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cd95a-19ed-49e5-8241-146a2d6e15c9 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:10.793238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cd95a-19ed-49e5-8241-146a2d6e15c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:10.793511 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cd95a-19ed-49e5-8241-146a2d6e15c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:10.838621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74163e8e-05cb-4f9e-82ab-7a50e026009f None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:10.859634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cd95a-19ed-49e5-8241-146a2d6e15c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:10.861267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cd95a-19ed-49e5-8241-146a2d6e15c9 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:10.871182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ef5e7-b68f-4c66-87d5-1093868f87d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:10.871855 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ef5e7-b68f-4c66-87d5-1093868f87d3 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:10.872132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ef5e7-b68f-4c66-87d5-1093868f87d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:10.872404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ef5e7-b68f-4c66-87d5-1093868f87d3 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:10.873141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ef5e7-b68f-4c66-87d5-1093868f87d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:10.873442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ef5e7-b68f-4c66-87d5-1093868f87d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:10.874785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ef5e7-b68f-4c66-87d5-1093868f87d3 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:10.889881 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 257/519] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:10.889881 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ef5e7-b68f-4c66-87d5-1093868f87d3 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:10.959812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 263/520] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:10.959812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cd95a-19ed-49e5-8241-146a2d6e15c9 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:10.986182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ef5e7-b68f-4c66-87d5-1093868f87d3 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:11.019840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660480f-85e4-4b36-a849-2676807e8a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:11.020687 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660480f-85e4-4b36-a849-2676807e8a94 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:11.020972 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660480f-85e4-4b36-a849-2676807e8a94 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:11.021249 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660480f-85e4-4b36-a849-2676807e8a94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:11.028125 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660480f-85e4-4b36-a849-2676807e8a94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:11.030222 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660480f-85e4-4b36-a849-2676807e8a94 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-5660480f-85e4-4b36-a849-2676807e8a94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:11.045394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:11.046283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:11.047133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:11.047133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:11.047133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:11.047133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:11.047133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:11.047133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:11.047133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:11.047133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:11.051411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 258/521] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:11.052258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660480f-85e4-4b36-a849-2676807e8a94 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:11.052700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cd95a-19ed-49e5-8241-146a2d6e15c9 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:11.086578 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c404b-4fdc-4746-bc10-4b309fa5e51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:11.087674 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c404b-4fdc-4746-bc10-4b309fa5e51a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:11.088013 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c404b-4fdc-4746-bc10-4b309fa5e51a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:11.088285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c404b-4fdc-4746-bc10-4b309fa5e51a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:11.098976 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c404b-4fdc-4746-bc10-4b309fa5e51a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:11.100553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c404b-4fdc-4746-bc10-4b309fa5e51a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-357c404b-4fdc-4746-bc10-4b309fa5e51a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:11.117713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:11.118581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:11.124213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:11.124213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:11.124213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:11.124213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:11.124213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 264/522] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:11.124213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c404b-4fdc-4746-bc10-4b309fa5e51a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:11.159115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660480f-85e4-4b36-a849-2676807e8a94 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:11.192386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be551694-79f0-49ec-9cb5-cf19b044dc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:11.193171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be551694-79f0-49ec-9cb5-cf19b044dc18 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:11.193452 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be551694-79f0-49ec-9cb5-cf19b044dc18 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:11.193726 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be551694-79f0-49ec-9cb5-cf19b044dc18 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:11.202040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be551694-79f0-49ec-9cb5-cf19b044dc18 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:11.203508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be551694-79f0-49ec-9cb5-cf19b044dc18 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-be551694-79f0-49ec-9cb5-cf19b044dc18 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:11.220360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:11.224860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:11.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:11.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:11.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:11.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:11.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:11.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:11.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:11.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:11.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 13:35:11.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:11.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 259/523] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:11.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be551694-79f0-49ec-9cb5-cf19b044dc18 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:11.232884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c404b-4fdc-4746-bc10-4b309fa5e51a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:11.271728 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b967d-9e0b-40fd-8190-631f4c6fa95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:11.272905 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b967d-9e0b-40fd-8190-631f4c6fa95b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:11.273396 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b967d-9e0b-40fd-8190-631f4c6fa95b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:11.273797 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b967d-9e0b-40fd-8190-631f4c6fa95b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:11.284387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b967d-9e0b-40fd-8190-631f4c6fa95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:11.285812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b967d-9e0b-40fd-8190-631f4c6fa95b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-ad3b967d-9e0b-40fd-8190-631f4c6fa95b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:11.307630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:11.308547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:11.309394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:11.309394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:11.309394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:11.309394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:11.309394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 265/524] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:11.309653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b967d-9e0b-40fd-8190-631f4c6fa95b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:11.326663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be551694-79f0-49ec-9cb5-cf19b044dc18 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:11.360664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23705fa2-43e4-4e91-a6e8-aac6fe3bd4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:11.361471 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23705fa2-43e4-4e91-a6e8-aac6fe3bd4c9 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:11.361748 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23705fa2-43e4-4e91-a6e8-aac6fe3bd4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:11.362298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23705fa2-43e4-4e91-a6e8-aac6fe3bd4c9 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:11.363081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23705fa2-43e4-4e91-a6e8-aac6fe3bd4c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:11.363414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23705fa2-43e4-4e91-a6e8-aac6fe3bd4c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:11.365275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23705fa2-43e4-4e91-a6e8-aac6fe3bd4c9 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:11.388255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 260/525] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:11.390546 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23705fa2-43e4-4e91-a6e8-aac6fe3bd4c9 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:11.415620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b967d-9e0b-40fd-8190-631f4c6fa95b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:11.449516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3f01b-51a3-44dc-9209-dd3bdcb6bb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:11.450171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3f01b-51a3-44dc-9209-dd3bdcb6bb21 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:11.450451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3f01b-51a3-44dc-9209-dd3bdcb6bb21 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:11.450723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3f01b-51a3-44dc-9209-dd3bdcb6bb21 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:11.452017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3f01b-51a3-44dc-9209-dd3bdcb6bb21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:11.452321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3f01b-51a3-44dc-9209-dd3bdcb6bb21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:11.453669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3f01b-51a3-44dc-9209-dd3bdcb6bb21 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:11.468686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 266/526] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:11.468686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3f01b-51a3-44dc-9209-dd3bdcb6bb21 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:11.489512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23705fa2-43e4-4e91-a6e8-aac6fe3bd4c9 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:11.525665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383034a-5278-4643-8b68-a8d0b6822287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:11.526243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383034a-5278-4643-8b68-a8d0b6822287 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:11.526522 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383034a-5278-4643-8b68-a8d0b6822287 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:11.526793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383034a-5278-4643-8b68-a8d0b6822287 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:11.527656 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383034a-5278-4643-8b68-a8d0b6822287 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:11.527966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383034a-5278-4643-8b68-a8d0b6822287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:11.529406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383034a-5278-4643-8b68-a8d0b6822287 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:11.545920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 261/527] 10.222.0.73 () {56 vars in 1139 bytes} [Wed May 4 13:35:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:11.546708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383034a-5278-4643-8b68-a8d0b6822287 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:11.571739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3f01b-51a3-44dc-9209-dd3bdcb6bb21 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:11.603918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cfae4-e8f4-46f6-b1d7-9003eddf6c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:11.604569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cfae4-e8f4-46f6-b1d7-9003eddf6c06 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:11.604845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cfae4-e8f4-46f6-b1d7-9003eddf6c06 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:11.605118 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cfae4-e8f4-46f6-b1d7-9003eddf6c06 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:11.605821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cfae4-e8f4-46f6-b1d7-9003eddf6c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:11.606119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cfae4-e8f4-46f6-b1d7-9003eddf6c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:11.607507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cfae4-e8f4-46f6-b1d7-9003eddf6c06 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:11.623871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 267/528] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:11.624551 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cfae4-e8f4-46f6-b1d7-9003eddf6c06 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:11.644427 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383034a-5278-4643-8b68-a8d0b6822287 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:11.676179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18f120-3aac-47b7-98ca-d27758f6a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:11.676827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18f120-3aac-47b7-98ca-d27758f6a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:11.677108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18f120-3aac-47b7-98ca-d27758f6a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:11.677409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18f120-3aac-47b7-98ca-d27758f6a9b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:11.678233 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18f120-3aac-47b7-98ca-d27758f6a9b7 None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=10d07b370370461a90cab0b182938292) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:11.678541 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18f120-3aac-47b7-98ca-d27758f6a9b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:11.680010 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18f120-3aac-47b7-98ca-d27758f6a9b7 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:11.685414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 262/529] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:11 2022] GET /identity/v3/role_assignments?user.id=10d07b370370461a90cab0b182938292&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:11.686700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18f120-3aac-47b7-98ca-d27758f6a9b7 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:11.733753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cfae4-e8f4-46f6-b1d7-9003eddf6c06 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:11.771284 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ec3f-be27-435b-95c8-f42f553e23ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:11.771562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ec3f-be27-435b-95c8-f42f553e23ae None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:11.771742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ec3f-be27-435b-95c8-f42f553e23ae None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:11.771972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8ec3f-be27-435b-95c8-f42f553e23ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:11.781079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8ec3f-be27-435b-95c8-f42f553e23ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:11.782279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8ec3f-be27-435b-95c8-f42f553e23ae None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-96e8ec3f-be27-435b-95c8-f42f553e23ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:11.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:11.799238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:11.800366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:11.800366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:11.800366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:11.800366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:11.800366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:11.800366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:11.800366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:11.800366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:11.803663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 268/530] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:11.804654 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ec3f-be27-435b-95c8-f42f553e23ae None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:11.808507 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18f120-3aac-47b7-98ca-d27758f6a9b7 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:11.844091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455cb5-c39f-4b59-81c0-0879228421fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:11.844999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455cb5-c39f-4b59-81c0-0879228421fc None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:11.845447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455cb5-c39f-4b59-81c0-0879228421fc None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:11.845859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455cb5-c39f-4b59-81c0-0879228421fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:11.911990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8ec3f-be27-435b-95c8-f42f553e23ae None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:11.915158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455cb5-c39f-4b59-81c0-0879228421fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:11.917123 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455cb5-c39f-4b59-81c0-0879228421fc None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:11.946816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0c89b-d4f7-480d-a5e0-d0d59ef1c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:11.947805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0c89b-d4f7-480d-a5e0-d0d59ef1c734 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:11.947943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0c89b-d4f7-480d-a5e0-d0d59ef1c734 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:11.948177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0c89b-d4f7-480d-a5e0-d0d59ef1c734 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:11.955033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0c89b-d4f7-480d-a5e0-d0d59ef1c734 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:11.956501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0c89b-d4f7-480d-a5e0-d0d59ef1c734 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-f3d0c89b-d4f7-480d-a5e0-d0d59ef1c734 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:11.972056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:11.973559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:11.974704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:11.974704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:11.974704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:11.974704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:11.974704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:11.974704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:11.974704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:11.974704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:11.977577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 269/531] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:11.978447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0c89b-d4f7-480d-a5e0-d0d59ef1c734 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:12.022968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 263/532] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:12.024185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455cb5-c39f-4b59-81c0-0879228421fc None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:12.083856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0c89b-d4f7-480d-a5e0-d0d59ef1c734 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:12.118006 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2f454-997c-432a-b6f0-3c44e0593eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:12.118715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2f454-997c-432a-b6f0-3c44e0593eb0 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:12.118942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2f454-997c-432a-b6f0-3c44e0593eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:12.119229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2f454-997c-432a-b6f0-3c44e0593eb0 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:12.120042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2f454-997c-432a-b6f0-3c44e0593eb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:12.120327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2f454-997c-432a-b6f0-3c44e0593eb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:12.121756 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2f454-997c-432a-b6f0-3c44e0593eb0 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:12.126444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455cb5-c39f-4b59-81c0-0879228421fc None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:12.140191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 270/533] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:12.140838 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2f454-997c-432a-b6f0-3c44e0593eb0 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:12.161881 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbd220-f573-44a3-8929-edd9ec37c186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:12.162756 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbd220-f573-44a3-8929-edd9ec37c186 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:12.163176 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbd220-f573-44a3-8929-edd9ec37c186 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:12.163610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbd220-f573-44a3-8929-edd9ec37c186 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:12.164636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbd220-f573-44a3-8929-edd9ec37c186 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:12.165080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbd220-f573-44a3-8929-edd9ec37c186 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:12.166642 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbd220-f573-44a3-8929-edd9ec37c186 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:12.179066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 264/534] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:12.180143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbd220-f573-44a3-8929-edd9ec37c186 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:12.262558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2f454-997c-432a-b6f0-3c44e0593eb0 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:12.289539 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbd220-f573-44a3-8929-edd9ec37c186 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:12.312425 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a799369-6480-43a9-b93a-4d6c79db8b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:12.315994 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a799369-6480-43a9-b93a-4d6c79db8b40 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:12.316267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a799369-6480-43a9-b93a-4d6c79db8b40 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:12.316541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a799369-6480-43a9-b93a-4d6c79db8b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:12.327898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a799369-6480-43a9-b93a-4d6c79db8b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:12.329307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a799369-6480-43a9-b93a-4d6c79db8b40 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:12.334693 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901f5ad-6050-4367-bc24-2f12baeaecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:12.335638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901f5ad-6050-4367-bc24-2f12baeaecd1 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:12.336120 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901f5ad-6050-4367-bc24-2f12baeaecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:12.336994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901f5ad-6050-4367-bc24-2f12baeaecd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:12.338467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901f5ad-6050-4367-bc24-2f12baeaecd1 None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=bbf2b88cc78d4defa7cefb7bf0ae6144) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:12.339041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901f5ad-6050-4367-bc24-2f12baeaecd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:12.341017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901f5ad-6050-4367-bc24-2f12baeaecd1 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:12.348059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 265/535] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:12 2022] GET /identity/v3/role_assignments?user.id=bbf2b88cc78d4defa7cefb7bf0ae6144&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-0a799369-6480-43a9-b93a-4d6c79db8b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:12.348328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:12.349399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:12.350487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:12.350487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:12.350487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:12.350487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:12.351935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901f5ad-6050-4367-bc24-2f12baeaecd1 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:12.357040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 271/536] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:12.359013 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a799369-6480-43a9-b93a-4d6c79db8b40 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:12.509578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901f5ad-6050-4367-bc24-2f12baeaecd1 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:12.514139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a799369-6480-43a9-b93a-4d6c79db8b40 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:12.556405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1d985-8cb6-4a4a-b171-9a835fd3cd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:12.557936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1d985-8cb6-4a4a-b171-9a835fd3cd12 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:12.558680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1d985-8cb6-4a4a-b171-9a835fd3cd12 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:12.559113 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1d985-8cb6-4a4a-b171-9a835fd3cd12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:12.560373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1d985-8cb6-4a4a-b171-9a835fd3cd12 None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=962dca9381254a08b18ea171183190d0) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:12.560893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1d985-8cb6-4a4a-b171-9a835fd3cd12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:12.563366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1d985-8cb6-4a4a-b171-9a835fd3cd12 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:12.571976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 266/537] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:12 2022] GET /identity/v3/role_assignments?user.id=962dca9381254a08b18ea171183190d0&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:12.578417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac272562-8a9a-4829-b417-eb36c8977264 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:12.579375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3898e-c357-4487-8938-dda1f92a80a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:12.580081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3898e-c357-4487-8938-dda1f92a80a1 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:12.580360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3898e-c357-4487-8938-dda1f92a80a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:12.580632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3898e-c357-4487-8938-dda1f92a80a1 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:12.581388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3898e-c357-4487-8938-dda1f92a80a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:12.581695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3898e-c357-4487-8938-dda1f92a80a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:12.583155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3898e-c357-4487-8938-dda1f92a80a1 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:12.585002 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac272562-8a9a-4829-b417-eb36c8977264 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:12.585274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac272562-8a9a-4829-b417-eb36c8977264 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:12.587077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 267/538] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:12 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:12.597046 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eec92-997e-434c-80f5-3f219aef0548 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:12.597349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eec92-997e-434c-80f5-3f219aef0548 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:12.597603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eec92-997e-434c-80f5-3f219aef0548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:12.600158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 272/539] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:12.614348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3898e-c357-4487-8938-dda1f92a80a1 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:12.622079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-ff4eec92-997e-434c-80f5-3f219aef0548 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:12.623361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ff4eec92-997e-434c-80f5-3f219aef0548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:12.696713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 268/540] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:35:12.728313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eec92-997e-434c-80f5-3f219aef0548 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:12.775409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3898e-c357-4487-8938-dda1f92a80a1 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:12.811667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe5420-4192-43dd-a3fd-6f461b8c6c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:12.812642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe5420-4192-43dd-a3fd-6f461b8c6c72 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:12.813210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe5420-4192-43dd-a3fd-6f461b8c6c72 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:12.813498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe5420-4192-43dd-a3fd-6f461b8c6c72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:12.823085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe5420-4192-43dd-a3fd-6f461b8c6c72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:12.825317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe5420-4192-43dd-a3fd-6f461b8c6c72 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:12.831084 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eec92-997e-434c-80f5-3f219aef0548 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-3ffe5420-4192-43dd-a3fd-6f461b8c6c72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:12.854133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:12.855016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:12.855904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:12.855904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:12.855904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:12.855904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:12.855904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:12.855904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:12.855904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:12.855904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:12.855904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 273/541] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:12.862220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe5420-4192-43dd-a3fd-6f461b8c6c72 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:12.872695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9833ea-a2c5-417d-a21b-2a283bbfe1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:12.874043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9833ea-a2c5-417d-a21b-2a283bbfe1cf None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:12.874321 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9833ea-a2c5-417d-a21b-2a283bbfe1cf None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:12.874780 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9833ea-a2c5-417d-a21b-2a283bbfe1cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:12.886268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9833ea-a2c5-417d-a21b-2a283bbfe1cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-7c9833ea-a2c5-417d-a21b-2a283bbfe1cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:12.895026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:12.896951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:12.897959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 269/542] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:12.917009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9833ea-a2c5-417d-a21b-2a283bbfe1cf None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:12.981760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe5420-4192-43dd-a3fd-6f461b8c6c72 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:13.033654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9833ea-a2c5-417d-a21b-2a283bbfe1cf None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:13.051916 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46ce27-5aaa-47c5-88eb-05a91e2d4084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:13.052661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46ce27-5aaa-47c5-88eb-05a91e2d4084 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:13.052945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46ce27-5aaa-47c5-88eb-05a91e2d4084 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:13.053217 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46ce27-5aaa-47c5-88eb-05a91e2d4084 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:13.054012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46ce27-5aaa-47c5-88eb-05a91e2d4084 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:13.054319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46ce27-5aaa-47c5-88eb-05a91e2d4084 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:13.055778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46ce27-5aaa-47c5-88eb-05a91e2d4084 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:13.067365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd869e2-92fd-47db-bfe0-3fcc9aebd3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:13.068075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd869e2-92fd-47db-bfe0-3fcc9aebd3da None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:13.068352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd869e2-92fd-47db-bfe0-3fcc9aebd3da None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:13.068626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd869e2-92fd-47db-bfe0-3fcc9aebd3da None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:13.069375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd869e2-92fd-47db-bfe0-3fcc9aebd3da None admin] RBAC: Adding query filter params (name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:13.069677 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd869e2-92fd-47db-bfe0-3fcc9aebd3da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:13.071449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd869e2-92fd-47db-bfe0-3fcc9aebd3da None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:13.078374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 274/543] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:13.080762 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 270/544] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:13.083884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46ce27-5aaa-47c5-88eb-05a91e2d4084 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:13.085678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd869e2-92fd-47db-bfe0-3fcc9aebd3da None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:13.198080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd869e2-92fd-47db-bfe0-3fcc9aebd3da None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:13.247905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3c74c-2dc1-4b3b-8cdb-ad750a9adf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:13.249664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3c74c-2dc1-4b3b-8cdb-ad750a9adf42 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:13.250085 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3c74c-2dc1-4b3b-8cdb-ad750a9adf42 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:13.250373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3c74c-2dc1-4b3b-8cdb-ad750a9adf42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:13.263844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3c74c-2dc1-4b3b-8cdb-ad750a9adf42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:13.265299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3c74c-2dc1-4b3b-8cdb-ad750a9adf42 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:13.267633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46ce27-5aaa-47c5-88eb-05a91e2d4084 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-93e3c74c-2dc1-4b3b-8cdb-ad750a9adf42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:13.282414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:13.284505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:13.286573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:13.286573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:13.286573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:13.286573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:13.291663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 271/545] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:13.308064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3c74c-2dc1-4b3b-8cdb-ad750a9adf42 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:13.319227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2e678-578d-4ff3-bdfa-b860cd898c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:13.319227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2e678-578d-4ff3-bdfa-b860cd898c75 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:13.319227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2e678-578d-4ff3-bdfa-b860cd898c75 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:13.319227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2e678-578d-4ff3-bdfa-b860cd898c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:13.319877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2e678-578d-4ff3-bdfa-b860cd898c75 None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=963a38e769674dbba95a231e47a7191f) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:13.319877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2e678-578d-4ff3-bdfa-b860cd898c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:13.321473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2e678-578d-4ff3-bdfa-b860cd898c75 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:13.328018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 275/546] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:13 2022] GET /identity/v3/role_assignments?user.id=963a38e769674dbba95a231e47a7191f&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:13.432328 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3c74c-2dc1-4b3b-8cdb-ad750a9adf42 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:13.477191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579e322-472c-4f0f-9785-2bd195bd3fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:13.477880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579e322-472c-4f0f-9785-2bd195bd3fd2 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:13.478162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579e322-472c-4f0f-9785-2bd195bd3fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:13.478437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579e322-472c-4f0f-9785-2bd195bd3fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:13.479168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579e322-472c-4f0f-9785-2bd195bd3fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:13.479502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579e322-472c-4f0f-9785-2bd195bd3fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:13.480876 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579e322-472c-4f0f-9785-2bd195bd3fd2 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:13.494317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 272/547] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:13.500365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2e678-578d-4ff3-bdfa-b860cd898c75 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:13.617474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2e678-578d-4ff3-bdfa-b860cd898c75 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:13.652143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d96f9-2f1f-4858-9d15-ba1bf3ae3f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:13.652949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d96f9-2f1f-4858-9d15-ba1bf3ae3f2e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:13.653231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d96f9-2f1f-4858-9d15-ba1bf3ae3f2e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:13.653507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d96f9-2f1f-4858-9d15-ba1bf3ae3f2e None admin] PATH_INFO: `/v3/users/swift` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:13.662197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d96f9-2f1f-4858-9d15-ba1bf3ae3f2e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:13.663711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d96f9-2f1f-4858-9d15-ba1bf3ae3f2e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-ae6d96f9-2f1f-4858-9d15-ba1bf3ae3f2e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:13.678616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:13.680817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:13.682992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:13.682992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:13.682992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:13.682992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:13.682992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:13.682992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:13.682992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:13.682992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:13.682992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 13:35:13.682992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:13.682992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 276/548] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:13.687552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579e322-472c-4f0f-9785-2bd195bd3fd2 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:13.814909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579e322-472c-4f0f-9785-2bd195bd3fd2 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:13.859681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4e82f-0e3c-4958-a598-2a4505cac836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:13.860350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4e82f-0e3c-4958-a598-2a4505cac836 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:13.860629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4e82f-0e3c-4958-a598-2a4505cac836 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:13.860906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4e82f-0e3c-4958-a598-2a4505cac836 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:13.861743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4e82f-0e3c-4958-a598-2a4505cac836 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:13.862050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4e82f-0e3c-4958-a598-2a4505cac836 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:13.863509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4e82f-0e3c-4958-a598-2a4505cac836 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:13.886659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 273/549] 10.222.0.73 () {56 vars in 1135 bytes} [Wed May 4 13:35:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:13.892491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d96f9-2f1f-4858-9d15-ba1bf3ae3f2e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:14.013198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d96f9-2f1f-4858-9d15-ba1bf3ae3f2e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:14.049452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642f845-847d-47db-a1ec-250b97da0060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:14.050119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642f845-847d-47db-a1ec-250b97da0060 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:14.050402 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642f845-847d-47db-a1ec-250b97da0060 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:14.050678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642f845-847d-47db-a1ec-250b97da0060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:14.125103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642f845-847d-47db-a1ec-250b97da0060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:14.126490 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642f845-847d-47db-a1ec-250b97da0060 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:14.225492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 277/550] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:14.232274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4e82f-0e3c-4958-a598-2a4505cac836 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:14.283532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e47f2-9c57-4368-9518-0d93dee53a82 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:14.283864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e47f2-9c57-4368-9518-0d93dee53a82 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:14.284379 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e47f2-9c57-4368-9518-0d93dee53a82 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:14.286446 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 278/551] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:14.290687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03cf20-1693-4e9a-8cab-a82c7511a8dc None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:14.291049 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03cf20-1693-4e9a-8cab-a82c7511a8dc None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:14.291274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03cf20-1693-4e9a-8cab-a82c7511a8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:14.328182 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-fe03cf20-1693-4e9a-8cab-a82c7511a8dc None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:14.329386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fe03cf20-1693-4e9a-8cab-a82c7511a8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:14.359442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4e82f-0e3c-4958-a598-2a4505cac836 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:14.397867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48874803-c36a-4188-9970-7b27808b5443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:14.398575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48874803-c36a-4188-9970-7b27808b5443 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:14.398853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48874803-c36a-4188-9970-7b27808b5443 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:14.399127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48874803-c36a-4188-9970-7b27808b5443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:14.418819 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48874803-c36a-4188-9970-7b27808b5443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:14.420336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48874803-c36a-4188-9970-7b27808b5443 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-48874803-c36a-4188-9970-7b27808b5443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:14.448088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:14.450160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:14.452803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:14.452803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:14.452803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:14.452803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:14.452803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 274/552] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:14.456097 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48874803-c36a-4188-9970-7b27808b5443 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:14.480780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 279/553] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:35:14.526261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03cf20-1693-4e9a-8cab-a82c7511a8dc None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:14.612741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48874803-c36a-4188-9970-7b27808b5443 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:14.652861 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c3550-b77e-4c5e-97e5-c0d6dcfd922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:14.653435 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c3550-b77e-4c5e-97e5-c0d6dcfd922c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:14.653713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c3550-b77e-4c5e-97e5-c0d6dcfd922c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:14.654028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c3550-b77e-4c5e-97e5-c0d6dcfd922c None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:14.654781 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c3550-b77e-4c5e-97e5-c0d6dcfd922c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:14.655083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c3550-b77e-4c5e-97e5-c0d6dcfd922c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:14.656455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c3550-b77e-4c5e-97e5-c0d6dcfd922c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:14.669691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 275/554] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:14.675387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c3550-b77e-4c5e-97e5-c0d6dcfd922c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:14.705509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03cf20-1693-4e9a-8cab-a82c7511a8dc None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:14.769808 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28206562-1888-4a19-9a10-5c02e89f5a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:14.770631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28206562-1888-4a19-9a10-5c02e89f5a8a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:14.770915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28206562-1888-4a19-9a10-5c02e89f5a8a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:14.771190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28206562-1888-4a19-9a10-5c02e89f5a8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:14.785537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28206562-1888-4a19-9a10-5c02e89f5a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-28206562-1888-4a19-9a10-5c02e89f5a8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:14.793677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:14.796234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:14.797194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 280/555] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:14.803805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28206562-1888-4a19-9a10-5c02e89f5a8a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:14.873870 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c3550-b77e-4c5e-97e5-c0d6dcfd922c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:14.911543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28206562-1888-4a19-9a10-5c02e89f5a8a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:14.946501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc586a-d2a0-4b47-8e80-c61dab6af27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:14.947172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc586a-d2a0-4b47-8e80-c61dab6af27a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:14.948535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc586a-d2a0-4b47-8e80-c61dab6af27a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:14.948535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc586a-d2a0-4b47-8e80-c61dab6af27a None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:14.948855 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc586a-d2a0-4b47-8e80-c61dab6af27a None admin] RBAC: Adding query filter params (name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:14.949390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc586a-d2a0-4b47-8e80-c61dab6af27a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:14.955235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaed97d-b65d-45a9-b51e-52c004b28bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:14.955381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc586a-d2a0-4b47-8e80-c61dab6af27a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:14.955488 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed97d-b65d-45a9-b51e-52c004b28bcc None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:14.955488 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed97d-b65d-45a9-b51e-52c004b28bcc None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:14.955488 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed97d-b65d-45a9-b51e-52c004b28bcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:14.961374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 281/556] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:14.965791 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaed97d-b65d-45a9-b51e-52c004b28bcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:14.967303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaed97d-b65d-45a9-b51e-52c004b28bcc None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:14.972239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc586a-d2a0-4b47-8e80-c61dab6af27a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-6eaed97d-b65d-45a9-b51e-52c004b28bcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:14.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:14.983980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:14.984913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:14.984913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:14.984913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:14.984913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:14.984913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:14.984913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:14.984913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:14.984913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:14.984913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 276/557] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:14.995231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaed97d-b65d-45a9-b51e-52c004b28bcc None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:15.082319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc586a-d2a0-4b47-8e80-c61dab6af27a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:15.112889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaed97d-b65d-45a9-b51e-52c004b28bcc None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:15.125571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949aad4-eac4-4fb2-8ac8-50efa8298317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:15.126381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949aad4-eac4-4fb2-8ac8-50efa8298317 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:15.126665 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949aad4-eac4-4fb2-8ac8-50efa8298317 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:15.126940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949aad4-eac4-4fb2-8ac8-50efa8298317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:15.149579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2f089-5908-4d53-beec-6ec0daf395b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:15.150827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2f089-5908-4d53-beec-6ec0daf395b9 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:15.151944 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949aad4-eac4-4fb2-8ac8-50efa8298317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:15.152496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2f089-5908-4d53-beec-6ec0daf395b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:15.154742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949aad4-eac4-4fb2-8ac8-50efa8298317 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:15.155348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2f089-5908-4d53-beec-6ec0daf395b9 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:15.156418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2f089-5908-4d53-beec-6ec0daf395b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:15.156947 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2f089-5908-4d53-beec-6ec0daf395b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:15.158632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2f089-5908-4d53-beec-6ec0daf395b9 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:15.181349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 277/558] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-8949aad4-eac4-4fb2-8ac8-50efa8298317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:15.183420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:15.184252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:15.185090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:15.185090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:15.185090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:15.185090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:15.187654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2f089-5908-4d53-beec-6ec0daf395b9 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:15.189153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 282/559] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:15.196171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949aad4-eac4-4fb2-8ac8-50efa8298317 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:15.365764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949aad4-eac4-4fb2-8ac8-50efa8298317 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:15.385821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2f089-5908-4d53-beec-6ec0daf395b9 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:15.408318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006c628-e612-4e81-80c1-e639ce6f6906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:15.409813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006c628-e612-4e81-80c1-e639ce6f6906 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:15.410593 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006c628-e612-4e81-80c1-e639ce6f6906 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:15.411100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006c628-e612-4e81-80c1-e639ce6f6906 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:15.412570 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006c628-e612-4e81-80c1-e639ce6f6906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:15.413240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006c628-e612-4e81-80c1-e639ce6f6906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:15.415411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006c628-e612-4e81-80c1-e639ce6f6906 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:15.423409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f15d20-40fd-443e-8457-dec91a604a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:15.424663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f15d20-40fd-443e-8457-dec91a604a75 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:15.425024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f15d20-40fd-443e-8457-dec91a604a75 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:15.425374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f15d20-40fd-443e-8457-dec91a604a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:15.426695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f15d20-40fd-443e-8457-dec91a604a75 None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=773a01334f8a41d4bf94c5aa205d70ea) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:15.427104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f15d20-40fd-443e-8457-dec91a604a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:15.429054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f15d20-40fd-443e-8457-dec91a604a75 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:15.430498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 283/560] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:15.437021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affc475-115c-40da-b102-f05fe0c7046e None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:15.437259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affc475-115c-40da-b102-f05fe0c7046e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:15.438810 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affc475-115c-40da-b102-f05fe0c7046e None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:15.440239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 284/561] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:15.440956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affc475-115c-40da-b102-f05fe0c7046e None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:15.442662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 278/562] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:15 2022] GET /identity/v3/role_assignments?user.id=773a01334f8a41d4bf94c5aa205d70ea&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:15.453257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364aed7-54b2-4e00-8746-b2247a259393 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:15.453928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364aed7-54b2-4e00-8746-b2247a259393 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:15.454432 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364aed7-54b2-4e00-8746-b2247a259393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:15.472352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-7364aed7-54b2-4e00-8746-b2247a259393 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:15.473947 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7364aed7-54b2-4e00-8746-b2247a259393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:15.551038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 279/563] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:15.554154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1efbfb-640b-4b6f-9051-4388465b7922 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:15.554711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1efbfb-640b-4b6f-9051-4388465b7922 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:15.555198 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1efbfb-640b-4b6f-9051-4388465b7922 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:15.556778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 280/564] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:15.566764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a430e5-ebc3-4499-96df-afeeaa79481d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:15.568535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a430e5-ebc3-4499-96df-afeeaa79481d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:15.569211 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a430e5-ebc3-4499-96df-afeeaa79481d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:15.590614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affc475-115c-40da-b102-f05fe0c7046e None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:15.596327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-00a430e5-ebc3-4499-96df-afeeaa79481d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:15.598365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-00a430e5-ebc3-4499-96df-afeeaa79481d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:15.637466 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502b15d-f702-47ca-9667-f98f93241076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:15.637466 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502b15d-f702-47ca-9667-f98f93241076 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:15.637466 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502b15d-f702-47ca-9667-f98f93241076 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:15.637895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502b15d-f702-47ca-9667-f98f93241076 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:15.645914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502b15d-f702-47ca-9667-f98f93241076 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:15.648968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502b15d-f702-47ca-9667-f98f93241076 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-3502b15d-f702-47ca-9667-f98f93241076 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:15.670692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:15.671927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:15.672849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:15.672849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:15.672849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:15.672849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:15.672849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:15.672849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:15.672849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:15.672849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:15.672849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:35:15.672849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:15.672849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 285/565] 10.222.0.73 () {56 vars in 1093 bytes} [Wed May 4 13:35:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:15.674869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502b15d-f702-47ca-9667-f98f93241076 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:15.681284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 281/566] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:15.682180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a430e5-ebc3-4499-96df-afeeaa79481d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:15.786572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a430e5-ebc3-4499-96df-afeeaa79481d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:15.805463 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502b15d-f702-47ca-9667-f98f93241076 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:15.821616 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b356795-a3ee-44ca-8f3c-82a5208dc413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:15.822292 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b356795-a3ee-44ca-8f3c-82a5208dc413 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:15.822579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b356795-a3ee-44ca-8f3c-82a5208dc413 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:15.822857 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b356795-a3ee-44ca-8f3c-82a5208dc413 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:15.823806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b356795-a3ee-44ca-8f3c-82a5208dc413 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:15.824119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b356795-a3ee-44ca-8f3c-82a5208dc413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:15.825558 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b356795-a3ee-44ca-8f3c-82a5208dc413 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:15.848061 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 282/567] 10.222.0.73 () {56 vars in 1133 bytes} [Wed May 4 13:35:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:15.848266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080de7d7-3a0f-47c2-b8dc-95bdbec38521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:15.848895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080de7d7-3a0f-47c2-b8dc-95bdbec38521 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:15.849003 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b356795-a3ee-44ca-8f3c-82a5208dc413 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:15.849229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080de7d7-3a0f-47c2-b8dc-95bdbec38521 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:15.849788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080de7d7-3a0f-47c2-b8dc-95bdbec38521 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:15.862189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080de7d7-3a0f-47c2-b8dc-95bdbec38521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-080de7d7-3a0f-47c2-b8dc-95bdbec38521 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:15.870195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:15.871179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:15.872044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:15.872044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:15.872044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:15.872044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:15.872044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:15.872044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:15.872044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:15.872044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:15.872044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:15.872044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:15.872044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:15.872044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:15.877064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 286/568] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:15.877934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080de7d7-3a0f-47c2-b8dc-95bdbec38521 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:15.953655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b356795-a3ee-44ca-8f3c-82a5208dc413 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:15.987452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080de7d7-3a0f-47c2-b8dc-95bdbec38521 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:15.987958 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0ce07-e213-4a01-8259-0f131a0855b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:15.988749 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0ce07-e213-4a01-8259-0f131a0855b3 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:15.989032 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0ce07-e213-4a01-8259-0f131a0855b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:15.989311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0ce07-e213-4a01-8259-0f131a0855b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.007142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0ce07-e213-4a01-8259-0f131a0855b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-26f0ce07-e213-4a01-8259-0f131a0855b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:16.017786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:16.018752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:16.020017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 283/569] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:16.020696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0ce07-e213-4a01-8259-0f131a0855b3 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:16.026582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1caee-858e-4103-b714-0a6a37eee07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:16.027722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1caee-858e-4103-b714-0a6a37eee07a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.028256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1caee-858e-4103-b714-0a6a37eee07a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.028732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1caee-858e-4103-b714-0a6a37eee07a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.040323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1caee-858e-4103-b714-0a6a37eee07a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:16.042002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1caee-858e-4103-b714-0a6a37eee07a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-2df1caee-858e-4103-b714-0a6a37eee07a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:16.061442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:16.062343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:16.063762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:16.063762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:16.063762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:16.063762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:16.070545 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 287/570] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:16.071639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1caee-858e-4103-b714-0a6a37eee07a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:16.133077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0ce07-e213-4a01-8259-0f131a0855b3 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:16.165329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65b30c-0b8a-4fd0-b754-0b6d9d605a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:16.165991 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65b30c-0b8a-4fd0-b754-0b6d9d605a27 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.166289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65b30c-0b8a-4fd0-b754-0b6d9d605a27 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.166552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65b30c-0b8a-4fd0-b754-0b6d9d605a27 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.167327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65b30c-0b8a-4fd0-b754-0b6d9d605a27 None admin] RBAC: Adding query filter params (name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:16.167639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65b30c-0b8a-4fd0-b754-0b6d9d605a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:16.169064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65b30c-0b8a-4fd0-b754-0b6d9d605a27 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:16.171099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1caee-858e-4103-b714-0a6a37eee07a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:16.177143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 284/571] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:16.178272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65b30c-0b8a-4fd0-b754-0b6d9d605a27 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:16.210257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2f784-9216-4848-a685-45fe27de04a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:16.210924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2f784-9216-4848-a685-45fe27de04a8 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.211218 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2f784-9216-4848-a685-45fe27de04a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.211502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2f784-9216-4848-a685-45fe27de04a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.212241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2f784-9216-4848-a685-45fe27de04a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:16.212544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2f784-9216-4848-a685-45fe27de04a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:16.213886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2f784-9216-4848-a685-45fe27de04a8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:16.226331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 288/572] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:16.226331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf7d47-9284-4bf1-b743-035b8bb16744 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.226331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf7d47-9284-4bf1-b743-035b8bb16744 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.226331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf7d47-9284-4bf1-b743-035b8bb16744 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.228817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 289/573] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:16.229592 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf7d47-9284-4bf1-b743-035b8bb16744 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:16.279189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65b30c-0b8a-4fd0-b754-0b6d9d605a27 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:16.322667 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb02e65-8610-4905-8e89-86f50e6c0631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:16.323368 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb02e65-8610-4905-8e89-86f50e6c0631 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.323707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb02e65-8610-4905-8e89-86f50e6c0631 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.323985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb02e65-8610-4905-8e89-86f50e6c0631 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.324697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb02e65-8610-4905-8e89-86f50e6c0631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:16.324997 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb02e65-8610-4905-8e89-86f50e6c0631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:16.326388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb02e65-8610-4905-8e89-86f50e6c0631 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:16.331663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf7d47-9284-4bf1-b743-035b8bb16744 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:16.338701 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 285/574] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:16.341109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb02e65-8610-4905-8e89-86f50e6c0631 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:16.373617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f8780-bf87-4d72-8b40-6d6075f5d512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:16.375166 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f8780-bf87-4d72-8b40-6d6075f5d512 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.375491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f8780-bf87-4d72-8b40-6d6075f5d512 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.375762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f8780-bf87-4d72-8b40-6d6075f5d512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.387948 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f8780-bf87-4d72-8b40-6d6075f5d512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:16.389424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f8780-bf87-4d72-8b40-6d6075f5d512 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-041f8780-bf87-4d72-8b40-6d6075f5d512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:16.406143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:16.407078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:16.408003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:16.408003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:16.408003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:16.408003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:16.408003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 290/575] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:16.408755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022a2fb-2068-40f4-819f-a1e8301f2091 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.408866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022a2fb-2068-40f4-819f-a1e8301f2091 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.409108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022a2fb-2068-40f4-819f-a1e8301f2091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.425540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-8022a2fb-2068-40f4-819f-a1e8301f2091 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:16.426729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-8022a2fb-2068-40f4-819f-a1e8301f2091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:16.445282 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb02e65-8610-4905-8e89-86f50e6c0631 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:16.477616 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c02558-dd14-4fbe-9d76-7b4d5dc3424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:16.478416 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c02558-dd14-4fbe-9d76-7b4d5dc3424b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.478699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c02558-dd14-4fbe-9d76-7b4d5dc3424b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.478977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c02558-dd14-4fbe-9d76-7b4d5dc3424b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.489202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c02558-dd14-4fbe-9d76-7b4d5dc3424b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:16.490671 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c02558-dd14-4fbe-9d76-7b4d5dc3424b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:16.503413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 291/576] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:16.504507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022a2fb-2068-40f4-819f-a1e8301f2091 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-24c02558-dd14-4fbe-9d76-7b4d5dc3424b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:16.508601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:16.509464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:16.510336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:16.510336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:16.510336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:16.510336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:16.510336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 286/577] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:16.515118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c02558-dd14-4fbe-9d76-7b4d5dc3424b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:16.602257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022a2fb-2068-40f4-819f-a1e8301f2091 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:16.612678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c02558-dd14-4fbe-9d76-7b4d5dc3424b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:16.636903 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085381c2-21b7-4b20-a2ce-767751a89bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:16.637699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085381c2-21b7-4b20-a2ce-767751a89bdf None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.637985 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085381c2-21b7-4b20-a2ce-767751a89bdf None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.638265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085381c2-21b7-4b20-a2ce-767751a89bdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.644872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085381c2-21b7-4b20-a2ce-767751a89bdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:16.645883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14a14e-4292-4c26-bdfa-5b2242a0b07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:16.646304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085381c2-21b7-4b20-a2ce-767751a89bdf None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:16.646937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14a14e-4292-4c26-bdfa-5b2242a0b07d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.647437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14a14e-4292-4c26-bdfa-5b2242a0b07d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.647891 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14a14e-4292-4c26-bdfa-5b2242a0b07d None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.648803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14a14e-4292-4c26-bdfa-5b2242a0b07d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:16.649342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14a14e-4292-4c26-bdfa-5b2242a0b07d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:16.650885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14a14e-4292-4c26-bdfa-5b2242a0b07d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-085381c2-21b7-4b20-a2ce-767751a89bdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:16.660644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:16.661662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:16.662568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:16.662568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:16.662568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:16.662568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:16.662568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:16.662568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:16.662568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:16.662568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:16.662568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 292/578] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:16.663554 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085381c2-21b7-4b20-a2ce-767751a89bdf None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:16.669673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 287/579] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:16.671442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14a14e-4292-4c26-bdfa-5b2242a0b07d None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:16.767673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085381c2-21b7-4b20-a2ce-767751a89bdf None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:16.767880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14a14e-4292-4c26-bdfa-5b2242a0b07d None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:16.801182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf9bb-9d39-49c3-af8e-1ed4824fb6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:16.801968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf9bb-9d39-49c3-af8e-1ed4824fb6be None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.802252 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf9bb-9d39-49c3-af8e-1ed4824fb6be None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.802355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6006c3-1967-4d4b-9df7-b843c66b0f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:16.802555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf9bb-9d39-49c3-af8e-1ed4824fb6be None admin] PATH_INFO: `/v3/roles/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.802941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6006c3-1967-4d4b-9df7-b843c66b0f8d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.803408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6006c3-1967-4d4b-9df7-b843c66b0f8d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.803682 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6006c3-1967-4d4b-9df7-b843c66b0f8d None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.804597 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6006c3-1967-4d4b-9df7-b843c66b0f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:16.805158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6006c3-1967-4d4b-9df7-b843c66b0f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:16.806612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6006c3-1967-4d4b-9df7-b843c66b0f8d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:16.812472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bf9bb-9d39-49c3-af8e-1ed4824fb6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:16.823973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 293/580] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:16.823973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6006c3-1967-4d4b-9df7-b843c66b0f8d None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-c48bf9bb-9d39-49c3-af8e-1ed4824fb6be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:16.824226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:16.825083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 288/581] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:16.825921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf9bb-9d39-49c3-af8e-1ed4824fb6be None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:16.922634 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf9bb-9d39-49c3-af8e-1ed4824fb6be None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:16.936475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6006c3-1967-4d4b-9df7-b843c66b0f8d None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:16.961143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a7bdc-6650-4db7-b600-22118e00fbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:16.961889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a7bdc-6650-4db7-b600-22118e00fbd3 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.962171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a7bdc-6650-4db7-b600-22118e00fbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.962445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a7bdc-6650-4db7-b600-22118e00fbd3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.970481 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a7bdc-6650-4db7-b600-22118e00fbd3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:16.971947 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a7bdc-6650-4db7-b600-22118e00fbd3 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:16.972178 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3d80c-5a1a-4dbe-bbcd-c607a02c4371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:16.972830 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3d80c-5a1a-4dbe-bbcd-c607a02c4371 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:16.973113 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3d80c-5a1a-4dbe-bbcd-c607a02c4371 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:16.973386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3d80c-5a1a-4dbe-bbcd-c607a02c4371 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:16.974162 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3d80c-5a1a-4dbe-bbcd-c607a02c4371 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:16.974465 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3d80c-5a1a-4dbe-bbcd-c607a02c4371 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:16.975884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3d80c-5a1a-4dbe-bbcd-c607a02c4371 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-cd9a7bdc-6650-4db7-b600-22118e00fbd3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:16.986523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:16.987523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:16.989075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:16.989075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:16.989075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:16.989075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:16.989075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:16.989075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:16.989075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:16.989075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:16.989075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:35:16.989075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:16.989075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 289/582] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:16.989075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a7bdc-6650-4db7-b600-22118e00fbd3 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:16.996207 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 294/583] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:16.996207 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3d80c-5a1a-4dbe-bbcd-c607a02c4371 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:17.086116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a7bdc-6650-4db7-b600-22118e00fbd3 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:17.094495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3d80c-5a1a-4dbe-bbcd-c607a02c4371 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:17.118080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d3650-5f4a-45bf-8294-ca3f2c79f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:17.118878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d3650-5f4a-45bf-8294-ca3f2c79f138 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:17.119161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d3650-5f4a-45bf-8294-ca3f2c79f138 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:17.119480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d3650-5f4a-45bf-8294-ca3f2c79f138 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:17.127149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d3650-5f4a-45bf-8294-ca3f2c79f138 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:17.127307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d727c-b70c-4061-955c-08fe04125788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:17.127917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d727c-b70c-4061-955c-08fe04125788 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:17.128200 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d727c-b70c-4061-955c-08fe04125788 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:17.128474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d727c-b70c-4061-955c-08fe04125788 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:17.128630 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d3650-5f4a-45bf-8294-ca3f2c79f138 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:17.129225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d727c-b70c-4061-955c-08fe04125788 None admin] RBAC: Adding query filter params (name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:17.129521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d727c-b70c-4061-955c-08fe04125788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:17.130880 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d727c-b70c-4061-955c-08fe04125788 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:17.143926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 295/584] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:17.143926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d727c-b70c-4061-955c-08fe04125788 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-ea0d3650-5f4a-45bf-8294-ca3f2c79f138 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:17.144154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:17.145051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:17.145963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:17.145963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:17.145963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:17.145963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:17.145963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:17.145963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:17.145963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:17.145963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:17.145963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 13:35:17.145963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:17.145963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 290/585] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:17.147968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d3650-5f4a-45bf-8294-ca3f2c79f138 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:17.245109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d727c-b70c-4061-955c-08fe04125788 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:17.249826 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d3650-5f4a-45bf-8294-ca3f2c79f138 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:17.281818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8b196-d935-456d-8361-33130884cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:17.282894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8b196-d935-456d-8361-33130884cf1b None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:17.283268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8b196-d935-456d-8361-33130884cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:17.283615 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8b196-d935-456d-8361-33130884cf1b None admin] PATH_INFO: `/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/10d07b370370461a90cab0b182938292/roles/bf0187c127ce4dcd9e2606d8dc4810ef` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:17.284934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04145c54-2a9b-4659-89ee-65b7b8795296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:17.285595 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04145c54-2a9b-4659-89ee-65b7b8795296 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:17.285877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04145c54-2a9b-4659-89ee-65b7b8795296 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:17.286149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04145c54-2a9b-4659-89ee-65b7b8795296 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:17.286993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04145c54-2a9b-4659-89ee-65b7b8795296 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:17.287335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04145c54-2a9b-4659-89ee-65b7b8795296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:17.288750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04145c54-2a9b-4659-89ee-65b7b8795296 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:17.300327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8b196-d935-456d-8361-33130884cf1b None admin] RBAC: Authorizing `identity:create_grant(project_id=fbace3b0d2f54a408012ccc368865c82, user_id=10d07b370370461a90cab0b182938292, role_id=bf0187c127ce4dcd9e2606d8dc4810ef)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:17.301778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8b196-d935-456d-8361-33130884cf1b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:17.306483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 291/586] 10.222.0.73 () {56 vars in 1137 bytes} [Wed May 4 13:35:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:17.307399 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04145c54-2a9b-4659-89ee-65b7b8795296 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:17.331562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 296/587] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:35:17 2022] PUT /identity/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/10d07b370370461a90cab0b182938292/roles/bf0187c127ce4dcd9e2606d8dc4810ef => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:35:17.331562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8b196-d935-456d-8361-33130884cf1b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:17.427518 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04145c54-2a9b-4659-89ee-65b7b8795296 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:17.462007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8b196-d935-456d-8361-33130884cf1b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:17.462904 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226589f6-abb8-41d1-8fb3-9a84460d7741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:17.463871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226589f6-abb8-41d1-8fb3-9a84460d7741 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:17.464248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226589f6-abb8-41d1-8fb3-9a84460d7741 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:17.464641 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226589f6-abb8-41d1-8fb3-9a84460d7741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:17.475904 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226589f6-abb8-41d1-8fb3-9a84460d7741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:17.477566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226589f6-abb8-41d1-8fb3-9a84460d7741 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-226589f6-abb8-41d1-8fb3-9a84460d7741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:17.500740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:17.501844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:17.502944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:17.502944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:17.502944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:17.502944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:17.508195 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 292/588] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:17.508195 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226589f6-abb8-41d1-8fb3-9a84460d7741 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:17.512913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bae907-0057-4010-b180-88efa1438ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:17.514088 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae907-0057-4010-b180-88efa1438ea2 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:17.514577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae907-0057-4010-b180-88efa1438ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:17.515057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae907-0057-4010-b180-88efa1438ea2 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:17.516229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bae907-0057-4010-b180-88efa1438ea2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:17.517386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bae907-0057-4010-b180-88efa1438ea2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:17.519467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bae907-0057-4010-b180-88efa1438ea2 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:17.544147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 297/589] 10.222.0.73 () {56 vars in 1137 bytes} [Wed May 4 13:35:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:17.545957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bae907-0057-4010-b180-88efa1438ea2 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:17.633254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226589f6-abb8-41d1-8fb3-9a84460d7741 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:17.661320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bae907-0057-4010-b180-88efa1438ea2 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:17.678832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77165f-2adc-444e-b3e3-6a1d290a937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:17.680263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77165f-2adc-444e-b3e3-6a1d290a937d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:17.680744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77165f-2adc-444e-b3e3-6a1d290a937d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:17.681213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77165f-2adc-444e-b3e3-6a1d290a937d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:17.693418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77165f-2adc-444e-b3e3-6a1d290a937d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:17.695361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77165f-2adc-444e-b3e3-6a1d290a937d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:17.701684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38a3b-53ce-4b6d-8872-865eb827bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:17.703095 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38a3b-53ce-4b6d-8872-865eb827bb0b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:17.703667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38a3b-53ce-4b6d-8872-865eb827bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:17.704497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b38a3b-53ce-4b6d-8872-865eb827bb0b None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:17.705693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b38a3b-53ce-4b6d-8872-865eb827bb0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:17.706178 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b38a3b-53ce-4b6d-8872-865eb827bb0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:17.707736 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b38a3b-53ce-4b6d-8872-865eb827bb0b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-2c77165f-2adc-444e-b3e3-6a1d290a937d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:17.713575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:17.714456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:17.715415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:17.715415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:17.715415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:17.715415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:17.715415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 293/590] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:17.715687 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77165f-2adc-444e-b3e3-6a1d290a937d None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:17.723512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 298/591] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:17.724716 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38a3b-53ce-4b6d-8872-865eb827bb0b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:17.824847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77165f-2adc-444e-b3e3-6a1d290a937d None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:17.840809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b38a3b-53ce-4b6d-8872-865eb827bb0b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:17.858980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a14c-9b7e-4e4e-a04a-c35f73ecc030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:17.859787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a14c-9b7e-4e4e-a04a-c35f73ecc030 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:17.860059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a14c-9b7e-4e4e-a04a-c35f73ecc030 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:17.860326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a14c-9b7e-4e4e-a04a-c35f73ecc030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:17.870318 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54a14c-9b7e-4e4e-a04a-c35f73ecc030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:17.871793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54a14c-9b7e-4e4e-a04a-c35f73ecc030 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:17.875230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565b743-3928-4273-b0f1-a02b25144139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:17.876146 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565b743-3928-4273-b0f1-a02b25144139 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:17.876627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565b743-3928-4273-b0f1-a02b25144139 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:17.877098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565b743-3928-4273-b0f1-a02b25144139 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:17.878034 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565b743-3928-4273-b0f1-a02b25144139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:17.878538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565b743-3928-4273-b0f1-a02b25144139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:17.880103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565b743-3928-4273-b0f1-a02b25144139 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-8d54a14c-9b7e-4e4e-a04a-c35f73ecc030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:17.888433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:17.889892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:17.890975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:17.890975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:17.890975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:17.890975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:17.895246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 294/592] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:17.895431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a14c-9b7e-4e4e-a04a-c35f73ecc030 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:17.898414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 299/593] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:17.899631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ba18b-781a-4d8b-a295-68e13bc1734f None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:17.899946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ba18b-781a-4d8b-a295-68e13bc1734f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:17.900254 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ba18b-781a-4d8b-a295-68e13bc1734f None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:17.901479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 300/594] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:17.902663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ba18b-781a-4d8b-a295-68e13bc1734f None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:17.994364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a14c-9b7e-4e4e-a04a-c35f73ecc030 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:18.001699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ba18b-781a-4d8b-a295-68e13bc1734f None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:18.028094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5916b4-79e4-4783-80b4-c7ae8225d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:18.028916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5916b4-79e4-4783-80b4-c7ae8225d7f0 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.029758 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5916b4-79e4-4783-80b4-c7ae8225d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.030035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5916b4-79e4-4783-80b4-c7ae8225d7f0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.036624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccf6fd-c7ab-4a9d-8829-ba5faeab1678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:18.037280 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccf6fd-c7ab-4a9d-8829-ba5faeab1678 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.037412 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5916b4-79e4-4783-80b4-c7ae8225d7f0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:18.037565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccf6fd-c7ab-4a9d-8829-ba5faeab1678 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.037837 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccf6fd-c7ab-4a9d-8829-ba5faeab1678 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.038551 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccf6fd-c7ab-4a9d-8829-ba5faeab1678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:18.038858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccf6fd-c7ab-4a9d-8829-ba5faeab1678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:18.039257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5916b4-79e4-4783-80b4-c7ae8225d7f0 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:18.040237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccf6fd-c7ab-4a9d-8829-ba5faeab1678 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:18.058566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 301/595] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:18.058566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccf6fd-c7ab-4a9d-8829-ba5faeab1678 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-ca5916b4-79e4-4783-80b4-c7ae8225d7f0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:18.058823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:18.059925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 295/596] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d532be8-e61c-451d-b2ac-ab6eecb91273 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.061058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d532be8-e61c-451d-b2ac-ab6eecb91273 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.061895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d532be8-e61c-451d-b2ac-ab6eecb91273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.077803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-8d532be8-e61c-451d-b2ac-ab6eecb91273 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:18.078907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8d532be8-e61c-451d-b2ac-ab6eecb91273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:18.147741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 296/597] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:18.147741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d532be8-e61c-451d-b2ac-ab6eecb91273 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:18.158802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccf6fd-c7ab-4a9d-8829-ba5faeab1678 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:18.192507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7371c-8852-476b-a78a-2f837655f0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:18.193289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7371c-8852-476b-a78a-2f837655f0f0 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.193566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7371c-8852-476b-a78a-2f837655f0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.193836 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7371c-8852-476b-a78a-2f837655f0f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.202353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7371c-8852-476b-a78a-2f837655f0f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:18.204245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a7371c-8852-476b-a78a-2f837655f0f0 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-82a7371c-8852-476b-a78a-2f837655f0f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:18.217900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:18.218809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:18.220134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:18.220134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:18.220134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:18.220134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:18.220134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:18.220134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:18.220134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:18.220134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:18.220134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 302/598] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:18.220134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7371c-8852-476b-a78a-2f837655f0f0 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:18.252666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d532be8-e61c-451d-b2ac-ab6eecb91273 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:18.285402 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806af31-2d0e-485b-b6cc-313ca5f3119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:18.286354 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806af31-2d0e-485b-b6cc-313ca5f3119e None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.286635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806af31-2d0e-485b-b6cc-313ca5f3119e None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.286906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806af31-2d0e-485b-b6cc-313ca5f3119e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.293431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806af31-2d0e-485b-b6cc-313ca5f3119e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:18.294902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806af31-2d0e-485b-b6cc-313ca5f3119e None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-b806af31-2d0e-485b-b6cc-313ca5f3119e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:18.313121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:18.314213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:18.315437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:18.315437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:18.315437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:18.315437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:18.315437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:18.315437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:18.315437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:18.315437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:18.315437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 297/599] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:18.319554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806af31-2d0e-485b-b6cc-313ca5f3119e None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:18.325918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7371c-8852-476b-a78a-2f837655f0f0 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:18.359248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9af14-1b3e-41a3-8d60-04068602a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:18.359864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9af14-1b3e-41a3-8d60-04068602a92a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.360145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9af14-1b3e-41a3-8d60-04068602a92a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.360421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9af14-1b3e-41a3-8d60-04068602a92a None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.361261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9af14-1b3e-41a3-8d60-04068602a92a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:18.361571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9af14-1b3e-41a3-8d60-04068602a92a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:18.362986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9af14-1b3e-41a3-8d60-04068602a92a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:18.384373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 303/600] 10.222.0.73 () {56 vars in 1139 bytes} [Wed May 4 13:35:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:18.384373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9af14-1b3e-41a3-8d60-04068602a92a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:18.418675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806af31-2d0e-485b-b6cc-313ca5f3119e None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:18.453755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7e618-15ce-4cff-9d6f-8bb0995db7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:18.454535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7e618-15ce-4cff-9d6f-8bb0995db7d0 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.454821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7e618-15ce-4cff-9d6f-8bb0995db7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.455088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7e618-15ce-4cff-9d6f-8bb0995db7d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.465046 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7e618-15ce-4cff-9d6f-8bb0995db7d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-5bb7e618-15ce-4cff-9d6f-8bb0995db7d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:18.472670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:18.473589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:18.474434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 298/601] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:18.475190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7e618-15ce-4cff-9d6f-8bb0995db7d0 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:18.491263 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9af14-1b3e-41a3-8d60-04068602a92a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:18.525919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848bbc0-3acf-40b7-8dd0-76f082b0e1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:18.526748 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848bbc0-3acf-40b7-8dd0-76f082b0e1a5 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.527128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848bbc0-3acf-40b7-8dd0-76f082b0e1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.527532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848bbc0-3acf-40b7-8dd0-76f082b0e1a5 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.528421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848bbc0-3acf-40b7-8dd0-76f082b0e1a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:18.528827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848bbc0-3acf-40b7-8dd0-76f082b0e1a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:18.530370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c848bbc0-3acf-40b7-8dd0-76f082b0e1a5 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:18.541773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 304/602] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:18.542756 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848bbc0-3acf-40b7-8dd0-76f082b0e1a5 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:18.584718 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7e618-15ce-4cff-9d6f-8bb0995db7d0 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:18.616325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed35017-2376-44bc-8bf8-c9bfb343ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:18.616928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed35017-2376-44bc-8bf8-c9bfb343ef52 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.617210 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed35017-2376-44bc-8bf8-c9bfb343ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.617486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed35017-2376-44bc-8bf8-c9bfb343ef52 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.618263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed35017-2376-44bc-8bf8-c9bfb343ef52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:18.618584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed35017-2376-44bc-8bf8-c9bfb343ef52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:18.620018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed35017-2376-44bc-8bf8-c9bfb343ef52 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:18.632731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 299/603] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:18.633334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed35017-2376-44bc-8bf8-c9bfb343ef52 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:18.645398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848bbc0-3acf-40b7-8dd0-76f082b0e1a5 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:18.678291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f9f21-6807-4965-8c42-61d9e8c7ee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:18.679183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f9f21-6807-4965-8c42-61d9e8c7ee35 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.679490 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f9f21-6807-4965-8c42-61d9e8c7ee35 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.679768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f9f21-6807-4965-8c42-61d9e8c7ee35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.690453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f9f21-6807-4965-8c42-61d9e8c7ee35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:18.691927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f9f21-6807-4965-8c42-61d9e8c7ee35 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-b77f9f21-6807-4965-8c42-61d9e8c7ee35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:18.709060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:18.709964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:18.710901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:18.710901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:18.710901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:18.710901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:18.710901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 305/604] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:18.711611 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f9f21-6807-4965-8c42-61d9e8c7ee35 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:18.729586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed35017-2376-44bc-8bf8-c9bfb343ef52 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:18.762887 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00d732-d9e1-4fad-a5b6-d4db11f67c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:18.763641 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00d732-d9e1-4fad-a5b6-d4db11f67c23 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.763914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00d732-d9e1-4fad-a5b6-d4db11f67c23 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.764188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00d732-d9e1-4fad-a5b6-d4db11f67c23 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.764920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00d732-d9e1-4fad-a5b6-d4db11f67c23 None admin] RBAC: Adding query filter params (name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:18.765221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00d732-d9e1-4fad-a5b6-d4db11f67c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:18.766575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00d732-d9e1-4fad-a5b6-d4db11f67c23 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:18.774419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 300/605] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:18.775008 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00d732-d9e1-4fad-a5b6-d4db11f67c23 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:18.814604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f9f21-6807-4965-8c42-61d9e8c7ee35 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:18.847839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e364db-97e7-481f-8438-2f86236b0c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:18.848717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e364db-97e7-481f-8438-2f86236b0c2e None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.848995 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e364db-97e7-481f-8438-2f86236b0c2e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.849264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e364db-97e7-481f-8438-2f86236b0c2e None admin] PATH_INFO: `/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/962dca9381254a08b18ea171183190d0/roles/bf0187c127ce4dcd9e2606d8dc4810ef` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.865171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e364db-97e7-481f-8438-2f86236b0c2e None admin] RBAC: Authorizing `identity:create_grant(project_id=fbace3b0d2f54a408012ccc368865c82, user_id=962dca9381254a08b18ea171183190d0, role_id=bf0187c127ce4dcd9e2606d8dc4810ef)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:18.866641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e364db-97e7-481f-8438-2f86236b0c2e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:18.876327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00d732-d9e1-4fad-a5b6-d4db11f67c23 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:18.879827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 306/606] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:35:18 2022] PUT /identity/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/962dca9381254a08b18ea171183190d0/roles/bf0187c127ce4dcd9e2606d8dc4810ef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:35:18.892214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e364db-97e7-481f-8438-2f86236b0c2e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:18.918310 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b0df3-4c92-4829-aeac-d0b2f70d2a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:18.919298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b0df3-4c92-4829-aeac-d0b2f70d2a63 None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:18.919583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b0df3-4c92-4829-aeac-d0b2f70d2a63 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:18.920526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b0df3-4c92-4829-aeac-d0b2f70d2a63 None admin] PATH_INFO: `/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/bbf2b88cc78d4defa7cefb7bf0ae6144/roles/bf0187c127ce4dcd9e2606d8dc4810ef` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:18.937884 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b0df3-4c92-4829-aeac-d0b2f70d2a63 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbace3b0d2f54a408012ccc368865c82, user_id=bbf2b88cc78d4defa7cefb7bf0ae6144, role_id=bf0187c127ce4dcd9e2606d8dc4810ef)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:18.938730 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b0df3-4c92-4829-aeac-d0b2f70d2a63 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:18.957105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 301/607] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:35:18 2022] PUT /identity/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/bbf2b88cc78d4defa7cefb7bf0ae6144/roles/bf0187c127ce4dcd9e2606d8dc4810ef => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:35:18.958162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b0df3-4c92-4829-aeac-d0b2f70d2a63 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:19.026085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e364db-97e7-481f-8438-2f86236b0c2e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:19.064540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9aa08-b239-4995-b204-b6eaadd57787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:19.065587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9aa08-b239-4995-b204-b6eaadd57787 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:19.066098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9aa08-b239-4995-b204-b6eaadd57787 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:19.066577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9aa08-b239-4995-b204-b6eaadd57787 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:19.067567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9aa08-b239-4995-b204-b6eaadd57787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:19.068101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9aa08-b239-4995-b204-b6eaadd57787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:19.069734 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9aa08-b239-4995-b204-b6eaadd57787 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:19.071335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b0df3-4c92-4829-aeac-d0b2f70d2a63 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:19.087568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 307/608] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:19.089352 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9aa08-b239-4995-b204-b6eaadd57787 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:19.109429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaede7-15bc-412b-b4ed-ae76f671d5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:19.110295 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaede7-15bc-412b-b4ed-ae76f671d5af None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:19.110563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaede7-15bc-412b-b4ed-ae76f671d5af None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:19.110882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaaede7-15bc-412b-b4ed-ae76f671d5af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:19.122332 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaaede7-15bc-412b-b4ed-ae76f671d5af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:19.124371 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaaede7-15bc-412b-b4ed-ae76f671d5af None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-eaaaede7-15bc-412b-b4ed-ae76f671d5af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:19.144323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:19.145294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:19.146188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:19.146188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:19.146188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:19.146188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:19.146188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 302/609] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:19.156462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaede7-15bc-412b-b4ed-ae76f671d5af None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:19.221594 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9aa08-b239-4995-b204-b6eaadd57787 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:19.258648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa458c1-c2e8-4469-a31d-afc4e2aed168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:19.259753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa458c1-c2e8-4469-a31d-afc4e2aed168 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:19.260209 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa458c1-c2e8-4469-a31d-afc4e2aed168 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:19.260636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa458c1-c2e8-4469-a31d-afc4e2aed168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:19.272710 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa458c1-c2e8-4469-a31d-afc4e2aed168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:19.274386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa458c1-c2e8-4469-a31d-afc4e2aed168 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:19.279498 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaaede7-15bc-412b-b4ed-ae76f671d5af None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-baa458c1-c2e8-4469-a31d-afc4e2aed168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:19.293658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:19.295445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:19.296341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:19.296341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:19.296341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:19.296341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:19.296341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:19.296341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:19.296341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:19.296341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:19.302155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 308/610] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:19.305171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa458c1-c2e8-4469-a31d-afc4e2aed168 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:19.324284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421eeb2-f13e-4faf-a8cb-5c3489d4cf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:19.325213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421eeb2-f13e-4faf-a8cb-5c3489d4cf54 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:19.325490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421eeb2-f13e-4faf-a8cb-5c3489d4cf54 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:19.325814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421eeb2-f13e-4faf-a8cb-5c3489d4cf54 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:19.327056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421eeb2-f13e-4faf-a8cb-5c3489d4cf54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:19.327399 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421eeb2-f13e-4faf-a8cb-5c3489d4cf54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:19.328844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421eeb2-f13e-4faf-a8cb-5c3489d4cf54 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:19.345027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 303/611] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:19.351960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421eeb2-f13e-4faf-a8cb-5c3489d4cf54 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:19.462724 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa458c1-c2e8-4469-a31d-afc4e2aed168 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:19.537325 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d158edd-5a03-4b8a-a370-8a7bf82a0ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:19.537987 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d158edd-5a03-4b8a-a370-8a7bf82a0ed4 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:19.538267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d158edd-5a03-4b8a-a370-8a7bf82a0ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:19.538538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d158edd-5a03-4b8a-a370-8a7bf82a0ed4 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:19.539354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d158edd-5a03-4b8a-a370-8a7bf82a0ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:19.539663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d158edd-5a03-4b8a-a370-8a7bf82a0ed4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:19.541069 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d158edd-5a03-4b8a-a370-8a7bf82a0ed4 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:19.552547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421eeb2-f13e-4faf-a8cb-5c3489d4cf54 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:19.564984 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 309/612] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:19.571996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d158edd-5a03-4b8a-a370-8a7bf82a0ed4 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:19.617855 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d908fa9-4bd2-48f9-b72b-d29321bb543c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:19.618646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d908fa9-4bd2-48f9-b72b-d29321bb543c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:19.618925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d908fa9-4bd2-48f9-b72b-d29321bb543c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:19.619193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d908fa9-4bd2-48f9-b72b-d29321bb543c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:19.636302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d908fa9-4bd2-48f9-b72b-d29321bb543c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:19.637873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d908fa9-4bd2-48f9-b72b-d29321bb543c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-9d908fa9-4bd2-48f9-b72b-d29321bb543c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:19.663454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:19.664552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:19.665491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:19.665491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:19.665491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:19.665491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:19.665491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:19.665491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:19.665491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:19.665491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:19.665491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 13:35:19.665491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:19.675237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 304/613] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:19.678955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2edb4-61a6-445c-ae9f-2e9016142b50 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:19.679260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2edb4-61a6-445c-ae9f-2e9016142b50 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:19.679541 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2edb4-61a6-445c-ae9f-2e9016142b50 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:19.681133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 305/614] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:19.686773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c4a3e-7561-46ac-b1d2-51ac0490ac33 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:19.687122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c4a3e-7561-46ac-b1d2-51ac0490ac33 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:19.687436 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c4a3e-7561-46ac-b1d2-51ac0490ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:19.708172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-646c4a3e-7561-46ac-b1d2-51ac0490ac33 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:19.709430 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-646c4a3e-7561-46ac-b1d2-51ac0490ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:19.720827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d158edd-5a03-4b8a-a370-8a7bf82a0ed4 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:19.756319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a6ec3-7e6a-4c1c-90bd-265292ea877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:19.757208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a6ec3-7e6a-4c1c-90bd-265292ea877a None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:19.757490 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a6ec3-7e6a-4c1c-90bd-265292ea877a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:19.757766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a6ec3-7e6a-4c1c-90bd-265292ea877a None admin] PATH_INFO: `/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/963a38e769674dbba95a231e47a7191f/roles/bf0187c127ce4dcd9e2606d8dc4810ef` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:19.777488 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a6ec3-7e6a-4c1c-90bd-265292ea877a None admin] RBAC: Authorizing `identity:create_grant(project_id=fbace3b0d2f54a408012ccc368865c82, user_id=963a38e769674dbba95a231e47a7191f, role_id=bf0187c127ce4dcd9e2606d8dc4810ef)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:19.779465 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a6ec3-7e6a-4c1c-90bd-265292ea877a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:19.793215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 306/615] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:19.793215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c4a3e-7561-46ac-b1d2-51ac0490ac33 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:19.802746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 310/616] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:35:19 2022] PUT /identity/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/963a38e769674dbba95a231e47a7191f/roles/bf0187c127ce4dcd9e2606d8dc4810ef => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:35:19.821855 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a6ec3-7e6a-4c1c-90bd-265292ea877a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:19.899010 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c4a3e-7561-46ac-b1d2-51ac0490ac33 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:19.926969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a6ec3-7e6a-4c1c-90bd-265292ea877a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:19.936389 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0622c3e-3132-45a3-9bbb-2000f9162a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:19.936914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0622c3e-3132-45a3-9bbb-2000f9162a5b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:19.937328 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0622c3e-3132-45a3-9bbb-2000f9162a5b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:19.937770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0622c3e-3132-45a3-9bbb-2000f9162a5b None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:19.938988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0622c3e-3132-45a3-9bbb-2000f9162a5b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:19.939145 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0622c3e-3132-45a3-9bbb-2000f9162a5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:19.940744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0622c3e-3132-45a3-9bbb-2000f9162a5b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:19.964815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 307/617] 10.222.0.73 () {56 vars in 1135 bytes} [Wed May 4 13:35:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:19.966484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0622c3e-3132-45a3-9bbb-2000f9162a5b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:19.968377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703d87b-154a-41ac-bc7c-3df2d036b4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:19.969422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703d87b-154a-41ac-bc7c-3df2d036b4da None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:19.969907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703d87b-154a-41ac-bc7c-3df2d036b4da None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:19.970412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703d87b-154a-41ac-bc7c-3df2d036b4da None admin] PATH_INFO: `/v3/roles/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:19.982830 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703d87b-154a-41ac-bc7c-3df2d036b4da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-3703d87b-154a-41ac-bc7c-3df2d036b4da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:19.991244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:19.992232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:19.993051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:19.993051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:19.993051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:19.993051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:19.993051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:19.993051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:19.993051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:19.993051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:19.993051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:19.993051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:19.993051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:19.993051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:19.995906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 311/618] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:20.002535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703d87b-154a-41ac-bc7c-3df2d036b4da None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:20.076876 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0622c3e-3132-45a3-9bbb-2000f9162a5b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:20.107033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703d87b-154a-41ac-bc7c-3df2d036b4da None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:20.116484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1850939-d14a-4f99-938a-965801571b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:20.117657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1850939-d14a-4f99-938a-965801571b3c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:20.118153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1850939-d14a-4f99-938a-965801571b3c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:20.118621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1850939-d14a-4f99-938a-965801571b3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:20.130389 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1850939-d14a-4f99-938a-965801571b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:20.132224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1850939-d14a-4f99-938a-965801571b3c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:20.145033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919b2fc-d3c2-4977-88bc-ce4c75a546e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:20.145701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919b2fc-d3c2-4977-88bc-ce4c75a546e6 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:20.145986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919b2fc-d3c2-4977-88bc-ce4c75a546e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:20.146261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919b2fc-d3c2-4977-88bc-ce4c75a546e6 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:20.147019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919b2fc-d3c2-4977-88bc-ce4c75a546e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:20.147356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919b2fc-d3c2-4977-88bc-ce4c75a546e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:20.148729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919b2fc-d3c2-4977-88bc-ce4c75a546e6 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-d1850939-d14a-4f99-938a-965801571b3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:20.152573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:20.153431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:20.154333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:20.154333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:20.154333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:20.154333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:20.156613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 308/619] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:20.159116 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 312/620] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:20.162274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1850939-d14a-4f99-938a-965801571b3c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:20.165021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919b2fc-d3c2-4977-88bc-ce4c75a546e6 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:20.267184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1850939-d14a-4f99-938a-965801571b3c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:20.275120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919b2fc-d3c2-4977-88bc-ce4c75a546e6 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:20.306967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afc867-d989-42f8-a60a-8be872b9d52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:20.307656 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afc867-d989-42f8-a60a-8be872b9d52b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:20.307930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afc867-d989-42f8-a60a-8be872b9d52b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:20.308197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afc867-d989-42f8-a60a-8be872b9d52b None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:20.309801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afc867-d989-42f8-a60a-8be872b9d52b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:20.309801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afc867-d989-42f8-a60a-8be872b9d52b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:20.314819 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afc867-d989-42f8-a60a-8be872b9d52b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:20.326557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 309/621] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:20.333212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afc867-d989-42f8-a60a-8be872b9d52b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:20.346737 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08943fea-9cbc-43af-acf9-9ab4f8543fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:20.347566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08943fea-9cbc-43af-acf9-9ab4f8543fc7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:20.347846 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08943fea-9cbc-43af-acf9-9ab4f8543fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:20.348114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08943fea-9cbc-43af-acf9-9ab4f8543fc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:20.368396 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08943fea-9cbc-43af-acf9-9ab4f8543fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:20.369839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08943fea-9cbc-43af-acf9-9ab4f8543fc7 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-08943fea-9cbc-43af-acf9-9ab4f8543fc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:20.399100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:20.400096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:20.400965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:20.400965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:20.400965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:20.400965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:20.415824 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 313/622] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:20.424519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08943fea-9cbc-43af-acf9-9ab4f8543fc7 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:20.534911 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afc867-d989-42f8-a60a-8be872b9d52b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:20.587112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08943fea-9cbc-43af-acf9-9ab4f8543fc7 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:20.597317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1506f-631d-482f-a220-71d5591160e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:20.598103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1506f-631d-482f-a220-71d5591160e0 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:20.598378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1506f-631d-482f-a220-71d5591160e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:20.598644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1506f-631d-482f-a220-71d5591160e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:20.609112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1506f-631d-482f-a220-71d5591160e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:20.610537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1506f-631d-482f-a220-71d5591160e0 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-f9e1506f-631d-482f-a220-71d5591160e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:20.634011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:20.634889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:20.635824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:20.635824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:20.635824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:20.635824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:20.635824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:20.635824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:20.635824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:20.635824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:20.636427 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 310/623] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:20.647054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1506f-631d-482f-a220-71d5591160e0 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:20.652480 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d3502-b1f6-406b-a9a6-c73d0b9d4a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:20.653391 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d3502-b1f6-406b-a9a6-c73d0b9d4a78 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:20.653878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d3502-b1f6-406b-a9a6-c73d0b9d4a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:20.654915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d3502-b1f6-406b-a9a6-c73d0b9d4a78 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:20.655872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d3502-b1f6-406b-a9a6-c73d0b9d4a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:20.656404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d3502-b1f6-406b-a9a6-c73d0b9d4a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:20.657959 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d3502-b1f6-406b-a9a6-c73d0b9d4a78 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:20.671175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 314/624] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:20.676038 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d3502-b1f6-406b-a9a6-c73d0b9d4a78 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:20.835708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1506f-631d-482f-a220-71d5591160e0 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:20.872153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd62e-d44c-4560-ad8c-43b7bd552aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:20.872833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd62e-d44c-4560-ad8c-43b7bd552aad None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:20.873119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd62e-d44c-4560-ad8c-43b7bd552aad None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:20.873245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d3502-b1f6-406b-a9a6-c73d0b9d4a78 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:20.873420 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd62e-d44c-4560-ad8c-43b7bd552aad None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:20.874169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cd62e-d44c-4560-ad8c-43b7bd552aad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:20.874478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cd62e-d44c-4560-ad8c-43b7bd552aad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:20.876085 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cd62e-d44c-4560-ad8c-43b7bd552aad None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:20.889905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 311/625] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:20.896342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd62e-d44c-4560-ad8c-43b7bd552aad None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:20.947418 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4af9ec-2d09-44b6-a931-f67a697b6921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:20.948215 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4af9ec-2d09-44b6-a931-f67a697b6921 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:20.948490 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4af9ec-2d09-44b6-a931-f67a697b6921 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:20.948758 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4af9ec-2d09-44b6-a931-f67a697b6921 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:20.961057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4af9ec-2d09-44b6-a931-f67a697b6921 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:20.962483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4af9ec-2d09-44b6-a931-f67a697b6921 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-5f4af9ec-2d09-44b6-a931-f67a697b6921 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:20.979746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:20.980751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:20.982235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:20.982235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:20.982235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:20.982235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:20.982235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:20.982235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:20.982235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:20.982235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:20.982235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:35:20.982235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:20.982235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 315/626] 10.222.0.73 () {56 vars in 1093 bytes} [Wed May 4 13:35:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:20.987865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4af9ec-2d09-44b6-a931-f67a697b6921 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:21.099369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd62e-d44c-4560-ad8c-43b7bd552aad None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:21.133573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b6c73-0636-49df-a308-f04646a4d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:21.134463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b6c73-0636-49df-a308-f04646a4d8e9 None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:21.134738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b6c73-0636-49df-a308-f04646a4d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:21.135443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b6c73-0636-49df-a308-f04646a4d8e9 None admin] PATH_INFO: `/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/773a01334f8a41d4bf94c5aa205d70ea/roles/bf0187c127ce4dcd9e2606d8dc4810ef` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:21.150586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b6c73-0636-49df-a308-f04646a4d8e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbace3b0d2f54a408012ccc368865c82, user_id=773a01334f8a41d4bf94c5aa205d70ea, role_id=bf0187c127ce4dcd9e2606d8dc4810ef)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:21.152053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b6c73-0636-49df-a308-f04646a4d8e9 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:21.166076 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4af9ec-2d09-44b6-a931-f67a697b6921 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:21.179574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 312/627] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:35:20 2022] PUT /identity/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/773a01334f8a41d4bf94c5aa205d70ea/roles/bf0187c127ce4dcd9e2606d8dc4810ef => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:35:21.213342 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a5bd3-9f98-4f5b-ba21-9926f535d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:21.214114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a5bd3-9f98-4f5b-ba21-9926f535d859 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:21.214397 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a5bd3-9f98-4f5b-ba21-9926f535d859 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:21.214711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a5bd3-9f98-4f5b-ba21-9926f535d859 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:21.215632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a5bd3-9f98-4f5b-ba21-9926f535d859 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:21.216023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a5bd3-9f98-4f5b-ba21-9926f535d859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:21.218198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a5bd3-9f98-4f5b-ba21-9926f535d859 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:21.243416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 316/628] 10.222.0.73 () {56 vars in 1133 bytes} [Wed May 4 13:35:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:21.244937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b6c73-0636-49df-a308-f04646a4d8e9 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:21.356446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b6c73-0636-49df-a308-f04646a4d8e9 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:21.393149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6050fb0-1808-4508-a7d9-c3368f3fcf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:21.393809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6050fb0-1808-4508-a7d9-c3368f3fcf49 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:21.394089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6050fb0-1808-4508-a7d9-c3368f3fcf49 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:21.394364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6050fb0-1808-4508-a7d9-c3368f3fcf49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:21.470216 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6050fb0-1808-4508-a7d9-c3368f3fcf49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:21.474288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6050fb0-1808-4508-a7d9-c3368f3fcf49 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:21.578207 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 313/629] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:21.583602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a5bd3-9f98-4f5b-ba21-9926f535d859 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:21.689156 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b7b2-d7c9-4400-9a79-c76b6cc15e03 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:21.689707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b7b2-d7c9-4400-9a79-c76b6cc15e03 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:21.689707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b7b2-d7c9-4400-9a79-c76b6cc15e03 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:21.691083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 314/630] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:21.691572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a5bd3-9f98-4f5b-ba21-9926f535d859 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:21.697611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222744f4-a237-4f75-8737-de791e434dd8 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:21.698220 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222744f4-a237-4f75-8737-de791e434dd8 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:21.698705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222744f4-a237-4f75-8737-de791e434dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:21.716495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-222744f4-a237-4f75-8737-de791e434dd8 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:21.718576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-222744f4-a237-4f75-8737-de791e434dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:21.734496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf8b61-5e9a-4a10-a706-ef9593e0ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:21.735315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf8b61-5e9a-4a10-a706-ef9593e0ef6f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:21.735596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf8b61-5e9a-4a10-a706-ef9593e0ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:21.735868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf8b61-5e9a-4a10-a706-ef9593e0ef6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:21.747666 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf8b61-5e9a-4a10-a706-ef9593e0ef6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:21.753196 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf8b61-5e9a-4a10-a706-ef9593e0ef6f None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-39cf8b61-5e9a-4a10-a706-ef9593e0ef6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:21.769074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:21.770028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:21.770973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:21.770973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:21.770973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:21.770973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:21.770973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 317/631] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:21.775836 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf8b61-5e9a-4a10-a706-ef9593e0ef6f None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:21.843230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 315/632] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:35:21.843230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489437e-179b-41c1-b8ad-ee5a6eceaae6 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:21.843230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489437e-179b-41c1-b8ad-ee5a6eceaae6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:21.843230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489437e-179b-41c1-b8ad-ee5a6eceaae6 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:21.843230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 316/633] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:21.855903 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580489e8-dc36-42f7-b7ec-d14681320b6b None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:21.856183 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580489e8-dc36-42f7-b7ec-d14681320b6b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:21.856457 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580489e8-dc36-42f7-b7ec-d14681320b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:21.873780 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-580489e8-dc36-42f7-b7ec-d14681320b6b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:21.874936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-580489e8-dc36-42f7-b7ec-d14681320b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:21.931619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf8b61-5e9a-4a10-a706-ef9593e0ef6f None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:21.959607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 317/634] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:35:21.959607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580489e8-dc36-42f7-b7ec-d14681320b6b None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:21.978444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea207cf8-d0ed-4770-9087-2716d63cfda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:21.979102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea207cf8-d0ed-4770-9087-2716d63cfda2 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:21.979403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea207cf8-d0ed-4770-9087-2716d63cfda2 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:21.979675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea207cf8-d0ed-4770-9087-2716d63cfda2 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:21.980662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea207cf8-d0ed-4770-9087-2716d63cfda2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:21.980662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea207cf8-d0ed-4770-9087-2716d63cfda2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:21.982023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea207cf8-d0ed-4770-9087-2716d63cfda2 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:21.993454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 318/635] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:21.994258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea207cf8-d0ed-4770-9087-2716d63cfda2 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:22.085057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580489e8-dc36-42f7-b7ec-d14681320b6b None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:22.100678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea207cf8-d0ed-4770-9087-2716d63cfda2 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:22.125950 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e3be6-c07b-4eaf-853c-9d7b8c4846d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:22.126991 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e3be6-c07b-4eaf-853c-9d7b8c4846d6 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:22.127680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e3be6-c07b-4eaf-853c-9d7b8c4846d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:22.128065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e3be6-c07b-4eaf-853c-9d7b8c4846d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:22.135465 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbe290-ea6e-406d-b3b3-e71cde936371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:22.136523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbe290-ea6e-406d-b3b3-e71cde936371 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:22.136909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbe290-ea6e-406d-b3b3-e71cde936371 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:22.137288 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbe290-ea6e-406d-b3b3-e71cde936371 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:22.140279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e3be6-c07b-4eaf-853c-9d7b8c4846d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:22.148254 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbe290-ea6e-406d-b3b3-e71cde936371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-0d1e3be6-c07b-4eaf-853c-9d7b8c4846d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:22.149852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:22.150983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:22.152067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:22.152067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:22.152067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:22.152067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:22.152067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:22.152067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:22.152067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:22.152067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:22.152067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:22.152067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:22.152067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:22.152067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:22.154477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 318/636] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:22.155434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e3be6-c07b-4eaf-853c-9d7b8c4846d6 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-cedbe290-ea6e-406d-b3b3-e71cde936371 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:22.163688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:22.164908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:22.165946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:22.165946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:22.165946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:22.165946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:22.165946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:22.165946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:22.165946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:22.165946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:22.165946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:22.165946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:22.165946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:22.165946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:22.171677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 319/637] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:22.172645 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbe290-ea6e-406d-b3b3-e71cde936371 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:22.272143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e3be6-c07b-4eaf-853c-9d7b8c4846d6 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:22.280193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbe290-ea6e-406d-b3b3-e71cde936371 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:22.309962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f1f76-204f-48b4-ba85-5196a681b8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:22.312029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f1f76-204f-48b4-ba85-5196a681b8dd None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:22.312308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f1f76-204f-48b4-ba85-5196a681b8dd None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:22.312581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f1f76-204f-48b4-ba85-5196a681b8dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:22.323229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f1f76-204f-48b4-ba85-5196a681b8dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:22.323394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ba71-0100-48af-b4a7-aa5c1731cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:22.323394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ba71-0100-48af-b4a7-aa5c1731cdb5 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:22.323394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ba71-0100-48af-b4a7-aa5c1731cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:22.323675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f1f76-204f-48b4-ba85-5196a681b8dd None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:22.323761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1ba71-0100-48af-b4a7-aa5c1731cdb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:22.323761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ba71-0100-48af-b4a7-aa5c1731cdb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:22.323761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ba71-0100-48af-b4a7-aa5c1731cdb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:22.324662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1ba71-0100-48af-b4a7-aa5c1731cdb5 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-b39f1f76-204f-48b4-ba85-5196a681b8dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:22.337026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:22.338364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:22.339508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:22.339508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:22.339508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:22.339508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:22.339508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:22.339508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:22.339508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:22.339508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:22.340174 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 320/638] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:22.340174 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ba71-0100-48af-b4a7-aa5c1731cdb5 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:22.340966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 319/639] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:22.344005 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f1f76-204f-48b4-ba85-5196a681b8dd None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:22.452473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1ba71-0100-48af-b4a7-aa5c1731cdb5 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:22.460730 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f1f76-204f-48b4-ba85-5196a681b8dd None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:22.493812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a98b72-eb35-42a4-9ad7-5eaa32881285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:22.494647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a98b72-eb35-42a4-9ad7-5eaa32881285 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:22.495004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a98b72-eb35-42a4-9ad7-5eaa32881285 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:22.495421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a98b72-eb35-42a4-9ad7-5eaa32881285 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:22.496362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a98b72-eb35-42a4-9ad7-5eaa32881285 None admin] RBAC: Adding query filter params (name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:22.496765 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a98b72-eb35-42a4-9ad7-5eaa32881285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:22.499047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a98b72-eb35-42a4-9ad7-5eaa32881285 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:22.499238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984a9e7-698d-4df1-a58b-d359595f989c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:22.500090 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984a9e7-698d-4df1-a58b-d359595f989c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:22.500580 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984a9e7-698d-4df1-a58b-d359595f989c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:22.500919 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984a9e7-698d-4df1-a58b-d359595f989c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:22.511819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 321/640] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:22.512629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984a9e7-698d-4df1-a58b-d359595f989c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:22.512795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a98b72-eb35-42a4-9ad7-5eaa32881285 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:22.514245 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984a9e7-698d-4df1-a58b-d359595f989c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-d984a9e7-698d-4df1-a58b-d359595f989c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:22.536105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:22.538193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:22.540053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:22.540053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:22.540053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:22.540053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:22.540053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 320/641] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:22.540053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984a9e7-698d-4df1-a58b-d359595f989c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:22.634291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a98b72-eb35-42a4-9ad7-5eaa32881285 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:22.664592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984a9e7-698d-4df1-a58b-d359595f989c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:22.675369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c0246-2b5e-472a-8a06-bf528e12ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:22.676133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c0246-2b5e-472a-8a06-bf528e12ab2f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:22.676484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c0246-2b5e-472a-8a06-bf528e12ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:22.676832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c0246-2b5e-472a-8a06-bf528e12ab2f None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:22.678246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c0246-2b5e-472a-8a06-bf528e12ab2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:22.678635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c0246-2b5e-472a-8a06-bf528e12ab2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:22.680139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c0246-2b5e-472a-8a06-bf528e12ab2f None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:22.693324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 322/642] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:22.694287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c0246-2b5e-472a-8a06-bf528e12ab2f None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:22.709561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f39a94-0e8e-4cef-8137-356248f54588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:22.710630 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f39a94-0e8e-4cef-8137-356248f54588 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:22.710908 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f39a94-0e8e-4cef-8137-356248f54588 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:22.711180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f39a94-0e8e-4cef-8137-356248f54588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:22.724937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f39a94-0e8e-4cef-8137-356248f54588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:22.726955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f39a94-0e8e-4cef-8137-356248f54588 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-98f39a94-0e8e-4cef-8137-356248f54588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:22.749115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:22.750042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:22.751027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:22.751027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:22.751027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:22.751027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:22.751027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 321/643] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:22.751910 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f39a94-0e8e-4cef-8137-356248f54588 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:22.800686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c0246-2b5e-472a-8a06-bf528e12ab2f None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:22.833515 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f8712-6c12-4ff9-a93f-df9447a47eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:22.834173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f8712-6c12-4ff9-a93f-df9447a47eba None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:22.834454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f8712-6c12-4ff9-a93f-df9447a47eba None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:22.834729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f8712-6c12-4ff9-a93f-df9447a47eba None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:22.835470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f8712-6c12-4ff9-a93f-df9447a47eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:22.835776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f8712-6c12-4ff9-a93f-df9447a47eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:22.837120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f8712-6c12-4ff9-a93f-df9447a47eba None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:22.852722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 323/644] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:22.852722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4f1f7-a285-4c7f-82d3-549601327268 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:22.852722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4f1f7-a285-4c7f-82d3-549601327268 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:22.852722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4f1f7-a285-4c7f-82d3-549601327268 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:22.852722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 324/645] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:22.856406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4f1f7-a285-4c7f-82d3-549601327268 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:22.860825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f39a94-0e8e-4cef-8137-356248f54588 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:22.892732 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99148630-1cba-49c1-ab5d-724669f9653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:22.893389 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148630-1cba-49c1-ab5d-724669f9653c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:22.893668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148630-1cba-49c1-ab5d-724669f9653c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:22.893942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99148630-1cba-49c1-ab5d-724669f9653c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:22.894753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99148630-1cba-49c1-ab5d-724669f9653c None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=10d07b370370461a90cab0b182938292) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:22.895057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99148630-1cba-49c1-ab5d-724669f9653c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:22.896492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99148630-1cba-49c1-ab5d-724669f9653c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:22.907539 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 322/646] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:22 2022] GET /identity/v3/role_assignments?user.id=10d07b370370461a90cab0b182938292&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:22.908283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99148630-1cba-49c1-ab5d-724669f9653c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:22.995237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4f1f7-a285-4c7f-82d3-549601327268 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:23.022830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99148630-1cba-49c1-ab5d-724669f9653c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:23.032219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749bf08-1ea5-4d3d-9986-9605d36be439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:23.033486 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749bf08-1ea5-4d3d-9986-9605d36be439 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:23.033773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749bf08-1ea5-4d3d-9986-9605d36be439 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:23.034048 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749bf08-1ea5-4d3d-9986-9605d36be439 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:23.034798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749bf08-1ea5-4d3d-9986-9605d36be439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:23.035532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749bf08-1ea5-4d3d-9986-9605d36be439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:23.037314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749bf08-1ea5-4d3d-9986-9605d36be439 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:23.054843 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 325/647] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:23.056367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb44aff-1acd-42c8-a2b3-d70d0eb10c8f None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:23.056760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb44aff-1acd-42c8-a2b3-d70d0eb10c8f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:23.057114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb44aff-1acd-42c8-a2b3-d70d0eb10c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:23.068848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f959732-7ab2-4ee0-82c9-54011c4e02e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:23.069679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f959732-7ab2-4ee0-82c9-54011c4e02e7 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:23.069966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f959732-7ab2-4ee0-82c9-54011c4e02e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:23.070508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f959732-7ab2-4ee0-82c9-54011c4e02e7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:23.075576 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-7cb44aff-1acd-42c8-a2b3-d70d0eb10c8f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:23.077492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7cb44aff-1acd-42c8-a2b3-d70d0eb10c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:23.082007 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f959732-7ab2-4ee0-82c9-54011c4e02e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:23.084050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f959732-7ab2-4ee0-82c9-54011c4e02e7 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-8f959732-7ab2-4ee0-82c9-54011c4e02e7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:23.101126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:23.102144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:23.103128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:23.103128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:23.103128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:23.103128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:23.103128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:23.103128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:23.103128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:23.103128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:23.103128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 13:35:23.103128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:23.106925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 323/648] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:23.107898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f959732-7ab2-4ee0-82c9-54011c4e02e7 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:23.152507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 326/649] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:23.153312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb44aff-1acd-42c8-a2b3-d70d0eb10c8f None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:23.236273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f959732-7ab2-4ee0-82c9-54011c4e02e7 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:23.268815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb44aff-1acd-42c8-a2b3-d70d0eb10c8f None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:23.282182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2512aa7-cdc7-427c-8ea6-0a8d2cbde669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:23.283521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2512aa7-cdc7-427c-8ea6-0a8d2cbde669 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:23.284349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2512aa7-cdc7-427c-8ea6-0a8d2cbde669 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:23.285109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2512aa7-cdc7-427c-8ea6-0a8d2cbde669 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:23.294655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2512aa7-cdc7-427c-8ea6-0a8d2cbde669 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:23.297514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2512aa7-cdc7-427c-8ea6-0a8d2cbde669 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:23.311225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa74cf-eadc-4d6b-9249-d70e8fc7781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:23.311840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa74cf-eadc-4d6b-9249-d70e8fc7781c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:23.312123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa74cf-eadc-4d6b-9249-d70e8fc7781c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:23.314227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa74cf-eadc-4d6b-9249-d70e8fc7781c None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:23.315104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa74cf-eadc-4d6b-9249-d70e8fc7781c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:23.315461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa74cf-eadc-4d6b-9249-d70e8fc7781c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:23.316960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa74cf-eadc-4d6b-9249-d70e8fc7781c None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-a2512aa7-cdc7-427c-8ea6-0a8d2cbde669 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:23.317805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:23.318765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:23.319747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:23.319747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:23.319747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:23.319747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:23.319747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:23.319747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:23.319747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:23.319747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:23.319747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:35:23.319747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:23.321191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 324/650] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:23.327124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2512aa7-cdc7-427c-8ea6-0a8d2cbde669 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:23.346495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 327/651] 10.222.0.73 () {56 vars in 1137 bytes} [Wed May 4 13:35:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:23.347452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa74cf-eadc-4d6b-9249-d70e8fc7781c None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:23.439848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2512aa7-cdc7-427c-8ea6-0a8d2cbde669 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:23.466062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa74cf-eadc-4d6b-9249-d70e8fc7781c None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:23.474112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1752f-eb25-45ef-98f0-77709470569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:23.474997 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1752f-eb25-45ef-98f0-77709470569d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:23.475374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1752f-eb25-45ef-98f0-77709470569d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:23.475720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1752f-eb25-45ef-98f0-77709470569d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:23.486073 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1752f-eb25-45ef-98f0-77709470569d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-49d1752f-eb25-45ef-98f0-77709470569d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:23.494021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:23.494979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:23.495842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:23.495842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:23.495842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:23.495842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:23.495842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:23.495842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:23.495842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:23.495842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:23.495842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:23.495842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:23.495842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:23.495842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:23.499505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 325/652] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:23.500441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1752f-eb25-45ef-98f0-77709470569d None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:23.509537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f89ca8-5970-4f5d-a774-d1ba8766cad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:23.510481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f89ca8-5970-4f5d-a774-d1ba8766cad4 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:23.511380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f89ca8-5970-4f5d-a774-d1ba8766cad4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:23.511865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f89ca8-5970-4f5d-a774-d1ba8766cad4 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:23.512899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f89ca8-5970-4f5d-a774-d1ba8766cad4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:23.514275 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f89ca8-5970-4f5d-a774-d1ba8766cad4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:23.516038 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f89ca8-5970-4f5d-a774-d1ba8766cad4 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:23.538061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 328/653] 10.222.0.73 () {56 vars in 1137 bytes} [Wed May 4 13:35:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:23.538061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f89ca8-5970-4f5d-a774-d1ba8766cad4 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:23.611183 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1752f-eb25-45ef-98f0-77709470569d None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:23.642678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f89ca8-5970-4f5d-a774-d1ba8766cad4 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:23.647577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901de9f3-dea0-400e-be22-e8aa66ccfa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:23.648394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901de9f3-dea0-400e-be22-e8aa66ccfa44 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:23.648844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901de9f3-dea0-400e-be22-e8aa66ccfa44 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:23.649274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901de9f3-dea0-400e-be22-e8aa66ccfa44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:23.678026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf43ef-3527-407c-8108-e70fd5369ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:23.678859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf43ef-3527-407c-8108-e70fd5369ab1 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:23.679362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf43ef-3527-407c-8108-e70fd5369ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:23.679742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf43ef-3527-407c-8108-e70fd5369ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:23.680600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf43ef-3527-407c-8108-e70fd5369ab1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:23.681056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf43ef-3527-407c-8108-e70fd5369ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:23.682456 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf43ef-3527-407c-8108-e70fd5369ab1 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:23.692736 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 329/654] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:23.697653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf43ef-3527-407c-8108-e70fd5369ab1 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:23.720218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901de9f3-dea0-400e-be22-e8aa66ccfa44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:23.722294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901de9f3-dea0-400e-be22-e8aa66ccfa44 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:23.800161 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf43ef-3527-407c-8108-e70fd5369ab1 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:23.820467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 326/655] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:23.821530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901de9f3-dea0-400e-be22-e8aa66ccfa44 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:23.836299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf90e5-4521-4f36-9b8e-5683f71a2768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:23.837234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf90e5-4521-4f36-9b8e-5683f71a2768 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:23.837704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf90e5-4521-4f36-9b8e-5683f71a2768 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:23.838053 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf90e5-4521-4f36-9b8e-5683f71a2768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:23.908238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf90e5-4521-4f36-9b8e-5683f71a2768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:23.910888 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf90e5-4521-4f36-9b8e-5683f71a2768 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:23.923871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901de9f3-dea0-400e-be22-e8aa66ccfa44 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:23.962495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a794da-99fc-4fd7-b89f-423729e62d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:23.963306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a794da-99fc-4fd7-b89f-423729e62d83 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:23.963586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a794da-99fc-4fd7-b89f-423729e62d83 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:23.964024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a794da-99fc-4fd7-b89f-423729e62d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:23.973385 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a794da-99fc-4fd7-b89f-423729e62d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:23.975630 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a794da-99fc-4fd7-b89f-423729e62d83 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-d2a794da-99fc-4fd7-b89f-423729e62d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:23.997654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:23.999132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:24.000080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:24.000080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:24.000080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:24.000080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:24.000305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 327/656] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:24.001364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b7085-d39d-4c04-b794-aa8ce5d42c94 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.001645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b7085-d39d-4c04-b794-aa8ce5d42c94 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.001917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b7085-d39d-4c04-b794-aa8ce5d42c94 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.007059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 328/657] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:24.007059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b7085-d39d-4c04-b794-aa8ce5d42c94 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:24.011702 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 330/658] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:24.016586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf90e5-4521-4f36-9b8e-5683f71a2768 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:24.106568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf90e5-4521-4f36-9b8e-5683f71a2768 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:24.114013 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b7085-d39d-4c04-b794-aa8ce5d42c94 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:24.139997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c67a9-6d94-4696-8fed-280f54c8c29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:24.140671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c67a9-6d94-4696-8fed-280f54c8c29e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.140948 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c67a9-6d94-4696-8fed-280f54c8c29e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.141225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c67a9-6d94-4696-8fed-280f54c8c29e None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.141940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c67a9-6d94-4696-8fed-280f54c8c29e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:24.142247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c67a9-6d94-4696-8fed-280f54c8c29e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:24.143634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c67a9-6d94-4696-8fed-280f54c8c29e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:24.148391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e44ae3-10cf-422e-8888-0f57ac295bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:24.149173 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e44ae3-10cf-422e-8888-0f57ac295bf2 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.149457 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e44ae3-10cf-422e-8888-0f57ac295bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.150201 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e44ae3-10cf-422e-8888-0f57ac295bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.159477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 331/659] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:24.159477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8a72-4ae6-492f-93fe-31172ee6a948 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.159477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8a72-4ae6-492f-93fe-31172ee6a948 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.159477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b8a72-4ae6-492f-93fe-31172ee6a948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.164118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e44ae3-10cf-422e-8888-0f57ac295bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:24.165591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e44ae3-10cf-422e-8888-0f57ac295bf2 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:24.174083 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-f29b8a72-4ae6-492f-93fe-31172ee6a948 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:24.175348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f29b8a72-4ae6-492f-93fe-31172ee6a948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-d6e44ae3-10cf-422e-8888-0f57ac295bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:24.184796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:24.185880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:24.186769 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:24.186769 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:24.186769 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:24.186769 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:24.186769 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 329/660] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:24.187049 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e44ae3-10cf-422e-8888-0f57ac295bf2 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:24.247269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 332/661] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:24.248070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8a72-4ae6-492f-93fe-31172ee6a948 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:24.292864 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e44ae3-10cf-422e-8888-0f57ac295bf2 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:24.327077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12227b-6a55-4b94-8c9f-043d4a5b0ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:24.327899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12227b-6a55-4b94-8c9f-043d4a5b0ba5 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.328175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12227b-6a55-4b94-8c9f-043d4a5b0ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.328471 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12227b-6a55-4b94-8c9f-043d4a5b0ba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.338714 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12227b-6a55-4b94-8c9f-043d4a5b0ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:24.340233 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12227b-6a55-4b94-8c9f-043d4a5b0ba5 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:24.357096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b8a72-4ae6-492f-93fe-31172ee6a948 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-dd12227b-6a55-4b94-8c9f-043d4a5b0ba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:24.358202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:24.359043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:24.359965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:24.359965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:24.359965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:24.359965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:24.359965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 330/662] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:24.360246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12227b-6a55-4b94-8c9f-043d4a5b0ba5 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:24.394393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bfeb-02d7-4ea3-9429-edd2ff0e6273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:24.395193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bfeb-02d7-4ea3-9429-edd2ff0e6273 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.395501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bfeb-02d7-4ea3-9429-edd2ff0e6273 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.395775 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bfeb-02d7-4ea3-9429-edd2ff0e6273 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.402814 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8bfeb-02d7-4ea3-9429-edd2ff0e6273 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:24.404993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8bfeb-02d7-4ea3-9429-edd2ff0e6273 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-a5e8bfeb-02d7-4ea3-9429-edd2ff0e6273 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:24.419260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:24.421027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:24.421988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:24.421988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:24.421988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:24.421988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:24.421988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:24.421988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:24.421988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:24.421988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:24.421988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 13:35:24.421988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:24.421988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 333/663] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:24.421988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bfeb-02d7-4ea3-9429-edd2ff0e6273 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:24.463135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12227b-6a55-4b94-8c9f-043d4a5b0ba5 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:24.497041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d559e0-b028-4318-922b-b3f63887b9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:24.497696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d559e0-b028-4318-922b-b3f63887b9b0 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.498021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d559e0-b028-4318-922b-b3f63887b9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.498296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d559e0-b028-4318-922b-b3f63887b9b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.499011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d559e0-b028-4318-922b-b3f63887b9b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:24.499343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d559e0-b028-4318-922b-b3f63887b9b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:24.500699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d559e0-b028-4318-922b-b3f63887b9b0 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:24.511790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 331/664] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:24.512681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d559e0-b028-4318-922b-b3f63887b9b0 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:24.528792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bfeb-02d7-4ea3-9429-edd2ff0e6273 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:24.563777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53864fc5-f45e-4f2f-af74-fea1e3b0eddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:24.564575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53864fc5-f45e-4f2f-af74-fea1e3b0eddf None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.564857 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53864fc5-f45e-4f2f-af74-fea1e3b0eddf None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.565129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53864fc5-f45e-4f2f-af74-fea1e3b0eddf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.575439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53864fc5-f45e-4f2f-af74-fea1e3b0eddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-53864fc5-f45e-4f2f-af74-fea1e3b0eddf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:24.583700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:24.584649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:24.585517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 334/665] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:24.586205 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53864fc5-f45e-4f2f-af74-fea1e3b0eddf None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:24.613295 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d559e0-b028-4318-922b-b3f63887b9b0 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:24.645121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485279bf-1501-41ad-aa13-e8e25c55956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:24.645777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485279bf-1501-41ad-aa13-e8e25c55956b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.646063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485279bf-1501-41ad-aa13-e8e25c55956b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.646339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485279bf-1501-41ad-aa13-e8e25c55956b None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.647051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485279bf-1501-41ad-aa13-e8e25c55956b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:24.647386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485279bf-1501-41ad-aa13-e8e25c55956b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:24.648742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485279bf-1501-41ad-aa13-e8e25c55956b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:24.665179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 332/666] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:24.665179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485279bf-1501-41ad-aa13-e8e25c55956b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:24.687913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53864fc5-f45e-4f2f-af74-fea1e3b0eddf None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:24.724107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccd4b2-958d-4d23-a6be-c4538ab5a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:24.724932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccd4b2-958d-4d23-a6be-c4538ab5a988 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.725208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccd4b2-958d-4d23-a6be-c4538ab5a988 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.725953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccd4b2-958d-4d23-a6be-c4538ab5a988 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.727057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccd4b2-958d-4d23-a6be-c4538ab5a988 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:24.727399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccd4b2-958d-4d23-a6be-c4538ab5a988 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:24.729763 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccd4b2-958d-4d23-a6be-c4538ab5a988 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:24.755173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 335/667] 10.222.0.73 () {56 vars in 1139 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:24.755898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccd4b2-958d-4d23-a6be-c4538ab5a988 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:24.762916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485279bf-1501-41ad-aa13-e8e25c55956b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:24.796815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fb2d6-0480-4764-ab53-3ff9435b61f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:24.797613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fb2d6-0480-4764-ab53-3ff9435b61f1 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.797895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fb2d6-0480-4764-ab53-3ff9435b61f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.798169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fb2d6-0480-4764-ab53-3ff9435b61f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.805073 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fb2d6-0480-4764-ab53-3ff9435b61f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:24.806525 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fb2d6-0480-4764-ab53-3ff9435b61f1 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-191fb2d6-0480-4764-ab53-3ff9435b61f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:24.819829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:24.820984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:24.821970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:24.821970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:24.821970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:24.821970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:24.821970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:24.821970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:24.821970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:24.821970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:24.821970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 333/668] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:24.822465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fb2d6-0480-4764-ab53-3ff9435b61f1 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:24.860928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccd4b2-958d-4d23-a6be-c4538ab5a988 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:24.897256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35105c-c555-4692-82c4-874ce6ab2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:24.898323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35105c-c555-4692-82c4-874ce6ab2042 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.898608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35105c-c555-4692-82c4-874ce6ab2042 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.898878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35105c-c555-4692-82c4-874ce6ab2042 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.899684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35105c-c555-4692-82c4-874ce6ab2042 None admin] RBAC: Adding query filter params (name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:24.899960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35105c-c555-4692-82c4-874ce6ab2042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:24.901304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35105c-c555-4692-82c4-874ce6ab2042 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:24.915498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 336/669] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:24.915498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35105c-c555-4692-82c4-874ce6ab2042 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:24.922469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fb2d6-0480-4764-ab53-3ff9435b61f1 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:24.956358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8a8e0-3436-48f2-9406-7d5a0a5cfabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:24.957504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8a8e0-3436-48f2-9406-7d5a0a5cfabc None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:24.957996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8a8e0-3436-48f2-9406-7d5a0a5cfabc None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:24.958485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8a8e0-3436-48f2-9406-7d5a0a5cfabc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:24.965729 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8a8e0-3436-48f2-9406-7d5a0a5cfabc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:24.967177 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8a8e0-3436-48f2-9406-7d5a0a5cfabc None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-63e8a8e0-3436-48f2-9406-7d5a0a5cfabc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:24.981330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:24.982251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:24.983157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:24.983157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:24.983157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:24.983157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:24.983157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:24.983157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:24.983157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:24.983157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:24.989679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 334/670] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:24.990858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8a8e0-3436-48f2-9406-7d5a0a5cfabc None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:25.016212 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35105c-c555-4692-82c4-874ce6ab2042 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:25.057604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9d0bc-c65c-4171-998d-f23b9608414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:25.058274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9d0bc-c65c-4171-998d-f23b9608414e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.058769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9d0bc-c65c-4171-998d-f23b9608414e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.059309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9d0bc-c65c-4171-998d-f23b9608414e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.087661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8a8e0-3436-48f2-9406-7d5a0a5cfabc None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:25.119579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3c427-d6ef-4a8e-ad5b-823130296d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:25.120240 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3c427-d6ef-4a8e-ad5b-823130296d05 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.120524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3c427-d6ef-4a8e-ad5b-823130296d05 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.120796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3c427-d6ef-4a8e-ad5b-823130296d05 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.121580 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3c427-d6ef-4a8e-ad5b-823130296d05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:25.121888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3c427-d6ef-4a8e-ad5b-823130296d05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:25.123854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3c427-d6ef-4a8e-ad5b-823130296d05 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:25.132497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9d0bc-c65c-4171-998d-f23b9608414e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:25.134206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9d0bc-c65c-4171-998d-f23b9608414e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:25.135276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 335/671] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:25.135955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3c427-d6ef-4a8e-ad5b-823130296d05 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:25.240023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 337/672] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:25.240023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9d0bc-c65c-4171-998d-f23b9608414e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:25.240256 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3c427-d6ef-4a8e-ad5b-823130296d05 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:25.271712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc21e74-68ca-47b8-a75f-26a6fca90921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:25.272502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc21e74-68ca-47b8-a75f-26a6fca90921 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.272782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc21e74-68ca-47b8-a75f-26a6fca90921 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.273056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc21e74-68ca-47b8-a75f-26a6fca90921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.283189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc21e74-68ca-47b8-a75f-26a6fca90921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:25.284643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc21e74-68ca-47b8-a75f-26a6fca90921 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-3cc21e74-68ca-47b8-a75f-26a6fca90921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:25.301770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:25.302724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:25.303770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:25.303770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:25.303770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:25.303770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:25.303770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 336/673] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:25.304615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc21e74-68ca-47b8-a75f-26a6fca90921 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:25.341691 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9d0bc-c65c-4171-998d-f23b9608414e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:25.374517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362e566-7e97-4cfd-87ce-afeeb3b8f65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:25.375167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362e566-7e97-4cfd-87ce-afeeb3b8f65b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.375478 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362e566-7e97-4cfd-87ce-afeeb3b8f65b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.375751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362e566-7e97-4cfd-87ce-afeeb3b8f65b None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.376531 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362e566-7e97-4cfd-87ce-afeeb3b8f65b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:25.376834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362e566-7e97-4cfd-87ce-afeeb3b8f65b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:25.378238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362e566-7e97-4cfd-87ce-afeeb3b8f65b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:25.389175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 338/674] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:25.389948 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362e566-7e97-4cfd-87ce-afeeb3b8f65b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:25.398942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc21e74-68ca-47b8-a75f-26a6fca90921 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:25.430894 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b09af-97e2-4722-a0ad-a1aac5098c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:25.431586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b09af-97e2-4722-a0ad-a1aac5098c6e None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.431870 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b09af-97e2-4722-a0ad-a1aac5098c6e None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.432147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b09af-97e2-4722-a0ad-a1aac5098c6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.432991 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b09af-97e2-4722-a0ad-a1aac5098c6e None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=bbf2b88cc78d4defa7cefb7bf0ae6144) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:25.433301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b09af-97e2-4722-a0ad-a1aac5098c6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:25.434742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b09af-97e2-4722-a0ad-a1aac5098c6e None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:25.441728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 337/675] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:25 2022] GET /identity/v3/role_assignments?user.id=bbf2b88cc78d4defa7cefb7bf0ae6144&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:25.442133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b09af-97e2-4722-a0ad-a1aac5098c6e None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:25.490716 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362e566-7e97-4cfd-87ce-afeeb3b8f65b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:25.525449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b81da-158b-432b-914d-ed5bf8282fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:25.526264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b81da-158b-432b-914d-ed5bf8282fba None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.526550 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b81da-158b-432b-914d-ed5bf8282fba None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.526816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b81da-158b-432b-914d-ed5bf8282fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.537997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b81da-158b-432b-914d-ed5bf8282fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:25.539544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b81da-158b-432b-914d-ed5bf8282fba None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:25.549929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b09af-97e2-4722-a0ad-a1aac5098c6e None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-fa5b81da-158b-432b-914d-ed5bf8282fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:25.557792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:25.558755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:25.559720 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:25.559720 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:25.559720 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:25.559720 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:25.563586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 339/676] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:25.565047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ff06-26de-4fdc-a94a-2ca5473af2fa None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.565337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ff06-26de-4fdc-a94a-2ca5473af2fa None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.565613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ff06-26de-4fdc-a94a-2ca5473af2fa None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.566965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 340/677] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:25.567723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ff06-26de-4fdc-a94a-2ca5473af2fa None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:25.594072 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51008d2c-6daa-4d92-94ab-c2a9b7afd516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:25.594746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51008d2c-6daa-4d92-94ab-c2a9b7afd516 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.595028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51008d2c-6daa-4d92-94ab-c2a9b7afd516 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.595337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51008d2c-6daa-4d92-94ab-c2a9b7afd516 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.596068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51008d2c-6daa-4d92-94ab-c2a9b7afd516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:25.596374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51008d2c-6daa-4d92-94ab-c2a9b7afd516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:25.597750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51008d2c-6daa-4d92-94ab-c2a9b7afd516 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:25.616268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 338/678] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:25.616268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51008d2c-6daa-4d92-94ab-c2a9b7afd516 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:25.673592 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ff06-26de-4fdc-a94a-2ca5473af2fa None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:25.710792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75ff2c-cff0-4079-9fb3-96dbb8855697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:25.711485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75ff2c-cff0-4079-9fb3-96dbb8855697 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.711785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75ff2c-cff0-4079-9fb3-96dbb8855697 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.712031 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75ff2c-cff0-4079-9fb3-96dbb8855697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.712865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75ff2c-cff0-4079-9fb3-96dbb8855697 None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=962dca9381254a08b18ea171183190d0) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:25.713175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75ff2c-cff0-4079-9fb3-96dbb8855697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:25.714588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75ff2c-cff0-4079-9fb3-96dbb8855697 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:25.721086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 341/679] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:25 2022] GET /identity/v3/role_assignments?user.id=962dca9381254a08b18ea171183190d0&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:25.722156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece16ee-ef3b-446c-ac6a-27eff57c43ea None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.722448 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece16ee-ef3b-446c-ac6a-27eff57c43ea None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.722723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece16ee-ef3b-446c-ac6a-27eff57c43ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.731325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51008d2c-6daa-4d92-94ab-c2a9b7afd516 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:25.744072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-1ece16ee-ef3b-446c-ac6a-27eff57c43ea None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:25.745350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1ece16ee-ef3b-446c-ac6a-27eff57c43ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:25.775774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681f0c5-3500-4641-bdd8-50bd3cda5b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:25.777027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f0c5-3500-4641-bdd8-50bd3cda5b82 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.777795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f0c5-3500-4641-bdd8-50bd3cda5b82 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.778401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681f0c5-3500-4641-bdd8-50bd3cda5b82 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.780124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681f0c5-3500-4641-bdd8-50bd3cda5b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:25.780590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681f0c5-3500-4641-bdd8-50bd3cda5b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:25.782169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681f0c5-3500-4641-bdd8-50bd3cda5b82 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:25.796065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 339/680] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:25.797229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681f0c5-3500-4641-bdd8-50bd3cda5b82 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:25.833923 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 342/681] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:25.835105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece16ee-ef3b-446c-ac6a-27eff57c43ea None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:25.923116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681f0c5-3500-4641-bdd8-50bd3cda5b82 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:25.942272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece16ee-ef3b-446c-ac6a-27eff57c43ea None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:25.957942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e39ef-308c-44a2-9cbc-0b9cd243dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:25.958892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e39ef-308c-44a2-9cbc-0b9cd243dbba None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.959244 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e39ef-308c-44a2-9cbc-0b9cd243dbba None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.959528 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e39ef-308c-44a2-9cbc-0b9cd243dbba None admin] PATH_INFO: `/v3/users/swift` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.967931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e39ef-308c-44a2-9cbc-0b9cd243dbba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:25.969362 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e39ef-308c-44a2-9cbc-0b9cd243dbba None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:25.980160 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8d1fd-aef1-4e8f-80b1-7a7910ae0a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:25.980950 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8d1fd-aef1-4e8f-80b1-7a7910ae0a90 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:25.981227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8d1fd-aef1-4e8f-80b1-7a7910ae0a90 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:25.981496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8d1fd-aef1-4e8f-80b1-7a7910ae0a90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-6e3e39ef-308c-44a2-9cbc-0b9cd243dbba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:25.985467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:25.986393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:25.987475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:25.987475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:25.987475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:25.987475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:25.987475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:25.987475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:25.987475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:25.987475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:25.987475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 13:35:25.987475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:25.988038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 340/682] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:25.989039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e39ef-308c-44a2-9cbc-0b9cd243dbba None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:25.989180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8d1fd-aef1-4e8f-80b1-7a7910ae0a90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:25.990218 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8d1fd-aef1-4e8f-80b1-7a7910ae0a90 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-d0a8d1fd-aef1-4e8f-80b1-7a7910ae0a90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:26.004240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:26.005317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:26.006440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:26.006440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:26.006440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:26.006440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:26.006440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:26.006440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:26.006440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:26.006440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:26.006440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 343/683] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:26.006954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8d1fd-aef1-4e8f-80b1-7a7910ae0a90 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:26.090280 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e39ef-308c-44a2-9cbc-0b9cd243dbba None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:26.105834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8d1fd-aef1-4e8f-80b1-7a7910ae0a90 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:26.123917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca90251-1053-40a6-adba-1145c75eeef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:26.124975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90251-1053-40a6-adba-1145c75eeef4 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:26.125398 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90251-1053-40a6-adba-1145c75eeef4 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:26.125810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90251-1053-40a6-adba-1145c75eeef4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:26.136316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca90251-1053-40a6-adba-1145c75eeef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:26.139252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a8b8b-1d41-4e50-9341-91bce15841dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:26.139920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a8b8b-1d41-4e50-9341-91bce15841dd None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:26.140200 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a8b8b-1d41-4e50-9341-91bce15841dd None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:26.140472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a8b8b-1d41-4e50-9341-91bce15841dd None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:26.141311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a8b8b-1d41-4e50-9341-91bce15841dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:26.141617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a8b8b-1d41-4e50-9341-91bce15841dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:26.143012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a8b8b-1d41-4e50-9341-91bce15841dd None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-3ca90251-1053-40a6-adba-1145c75eeef4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:26.146174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:26.147327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:26.148267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:26.148267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:26.148267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:26.148267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:26.148267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:26.148267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:26.148267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:26.148267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:26.148267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:26.148267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:26.148267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:26.148267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:26.155543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 341/684] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:26.156563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca90251-1053-40a6-adba-1145c75eeef4 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:26.161576 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 344/685] 10.222.0.73 () {56 vars in 1135 bytes} [Wed May 4 13:35:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:26.162667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a8b8b-1d41-4e50-9341-91bce15841dd None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:26.255661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca90251-1053-40a6-adba-1145c75eeef4 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:26.261559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a8b8b-1d41-4e50-9341-91bce15841dd None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:26.289682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83112548-461c-4221-878f-9f64787374b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:26.290608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83112548-461c-4221-878f-9f64787374b8 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:26.291032 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83112548-461c-4221-878f-9f64787374b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:26.291505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83112548-461c-4221-878f-9f64787374b8 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:26.292471 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83112548-461c-4221-878f-9f64787374b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:26.292951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83112548-461c-4221-878f-9f64787374b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:26.294559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83112548-461c-4221-878f-9f64787374b8 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:26.303417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d01225-d6fb-4a58-a87c-671b9a66d2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:26.304086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d01225-d6fb-4a58-a87c-671b9a66d2be None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:26.304362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d01225-d6fb-4a58-a87c-671b9a66d2be None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:26.304631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d01225-d6fb-4a58-a87c-671b9a66d2be None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:26.305459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d01225-d6fb-4a58-a87c-671b9a66d2be None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:26.305669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d01225-d6fb-4a58-a87c-671b9a66d2be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:26.307016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d01225-d6fb-4a58-a87c-671b9a66d2be None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:26.309308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 342/686] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:26.310483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83112548-461c-4221-878f-9f64787374b8 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:26.321794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 345/687] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:26.321794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d01225-d6fb-4a58-a87c-671b9a66d2be None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:26.415582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83112548-461c-4221-878f-9f64787374b8 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:26.423219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d01225-d6fb-4a58-a87c-671b9a66d2be None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:26.451550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe46d1b-8402-4d25-90be-4741622d6f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:26.452470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe46d1b-8402-4d25-90be-4741622d6f66 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:26.452900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe46d1b-8402-4d25-90be-4741622d6f66 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:26.453323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe46d1b-8402-4d25-90be-4741622d6f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:26.458536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482385-3d3b-4f9e-8703-f95643ef1fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:26.459294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482385-3d3b-4f9e-8703-f95643ef1fe7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:26.459619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482385-3d3b-4f9e-8703-f95643ef1fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:26.461314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60482385-3d3b-4f9e-8703-f95643ef1fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:26.461314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60482385-3d3b-4f9e-8703-f95643ef1fe7 None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=963a38e769674dbba95a231e47a7191f) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:26.461314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60482385-3d3b-4f9e-8703-f95643ef1fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:26.462853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60482385-3d3b-4f9e-8703-f95643ef1fe7 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:26.469987 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 346/688] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:26 2022] GET /identity/v3/role_assignments?user.id=963a38e769674dbba95a231e47a7191f&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:26.471285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482385-3d3b-4f9e-8703-f95643ef1fe7 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:26.549565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe46d1b-8402-4d25-90be-4741622d6f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:26.551462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe46d1b-8402-4d25-90be-4741622d6f66 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:26.582973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60482385-3d3b-4f9e-8703-f95643ef1fe7 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:26.618191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2d03-b27a-42cb-9595-d89b08304fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:26.619443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2d03-b27a-42cb-9595-d89b08304fef None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:26.619953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2d03-b27a-42cb-9595-d89b08304fef None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:26.620484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d2d03-b27a-42cb-9595-d89b08304fef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:26.633021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d2d03-b27a-42cb-9595-d89b08304fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:26.634796 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d2d03-b27a-42cb-9595-d89b08304fef None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-bf2d2d03-b27a-42cb-9595-d89b08304fef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:26.653678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:26.654695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:26.655623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:26.655623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:26.655623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:26.655623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:26.657680 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 347/689] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:26.675987 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2d03-b27a-42cb-9595-d89b08304fef None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:26.679731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 343/690] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:26.686995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe46d1b-8402-4d25-90be-4741622d6f66 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:26.799118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe46d1b-8402-4d25-90be-4741622d6f66 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:26.836271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d2d03-b27a-42cb-9595-d89b08304fef None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:26.866715 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ed537-3c06-4b0d-8d75-7744bd079e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:26.868699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ed537-3c06-4b0d-8d75-7744bd079e8d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:26.868699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ed537-3c06-4b0d-8d75-7744bd079e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:26.868699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ed537-3c06-4b0d-8d75-7744bd079e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:26.882573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ed537-3c06-4b0d-8d75-7744bd079e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:26.884263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ed537-3c06-4b0d-8d75-7744bd079e8d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:26.891726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0615c2-88b4-4c06-8dc7-11e628f74a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:26.893308 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0615c2-88b4-4c06-8dc7-11e628f74a11 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:26.893910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0615c2-88b4-4c06-8dc7-11e628f74a11 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:26.894394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0615c2-88b4-4c06-8dc7-11e628f74a11 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:26.895736 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0615c2-88b4-4c06-8dc7-11e628f74a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:26.896535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0615c2-88b4-4c06-8dc7-11e628f74a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:26.899036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0615c2-88b4-4c06-8dc7-11e628f74a11 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-6f8ed537-3c06-4b0d-8d75-7744bd079e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:26.904364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:26.906290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:26.908180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:26.908180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:26.908180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:26.908180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:26.908180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 344/691] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:26.910071 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ed537-3c06-4b0d-8d75-7744bd079e8d None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:26.930556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 348/692] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:26.932206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0615c2-88b4-4c06-8dc7-11e628f74a11 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:27.010773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ed537-3c06-4b0d-8d75-7744bd079e8d None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:27.034993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0615c2-88b4-4c06-8dc7-11e628f74a11 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:27.052151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e157eb9-97bc-4eb2-abe2-f84e8b6dfd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:27.053058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e157eb9-97bc-4eb2-abe2-f84e8b6dfd66 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:27.053344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e157eb9-97bc-4eb2-abe2-f84e8b6dfd66 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:27.053622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e157eb9-97bc-4eb2-abe2-f84e8b6dfd66 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:27.054823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e157eb9-97bc-4eb2-abe2-f84e8b6dfd66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:27.055272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e157eb9-97bc-4eb2-abe2-f84e8b6dfd66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:27.057196 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e157eb9-97bc-4eb2-abe2-f84e8b6dfd66 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:27.069769 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 345/693] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:27.074660 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a7ea7-5a8b-4d69-9532-d81d37ecffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:27.075287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e157eb9-97bc-4eb2-abe2-f84e8b6dfd66 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:27.076151 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a7ea7-5a8b-4d69-9532-d81d37ecffa8 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:27.076705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a7ea7-5a8b-4d69-9532-d81d37ecffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:27.077193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a7ea7-5a8b-4d69-9532-d81d37ecffa8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:27.085406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a7ea7-5a8b-4d69-9532-d81d37ecffa8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:27.087350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a7ea7-5a8b-4d69-9532-d81d37ecffa8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-b35a7ea7-5a8b-4d69-9532-d81d37ecffa8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:27.103679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:27.104687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:27.105649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:27.105649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:27.105649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:27.105649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:27.105649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:27.105649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:27.105649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:27.105649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:27.105649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:35:27.105649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:27.113124 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 349/694] 10.222.0.73 () {56 vars in 1093 bytes} [Wed May 4 13:35:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:27.114625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a7ea7-5a8b-4d69-9532-d81d37ecffa8 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:27.175962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e157eb9-97bc-4eb2-abe2-f84e8b6dfd66 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:27.209011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7b5ed-c61f-424a-bd96-be9a0a2fe27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:27.209843 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7b5ed-c61f-424a-bd96-be9a0a2fe27e None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:27.215466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7b5ed-c61f-424a-bd96-be9a0a2fe27e None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:27.215466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7b5ed-c61f-424a-bd96-be9a0a2fe27e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:27.223350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7b5ed-c61f-424a-bd96-be9a0a2fe27e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:27.225026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7b5ed-c61f-424a-bd96-be9a0a2fe27e None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-d5a7b5ed-c61f-424a-bd96-be9a0a2fe27e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:27.251970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:27.253854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:27.255802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:27.255802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:27.255802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:27.255802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:27.255802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:27.255802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:27.255802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:27.255802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:27.255802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 346/695] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:27.274391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7b5ed-c61f-424a-bd96-be9a0a2fe27e None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:27.305189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a7ea7-5a8b-4d69-9532-d81d37ecffa8 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:27.396890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07a7bc-6223-4436-8d07-aa4df360cba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:27.397491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07a7bc-6223-4436-8d07-aa4df360cba8 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:27.397770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07a7bc-6223-4436-8d07-aa4df360cba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:27.398043 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07a7bc-6223-4436-8d07-aa4df360cba8 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:27.398879 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07a7bc-6223-4436-8d07-aa4df360cba8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:27.399183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07a7bc-6223-4436-8d07-aa4df360cba8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:27.400147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7b5ed-c61f-424a-bd96-be9a0a2fe27e None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:27.400628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07a7bc-6223-4436-8d07-aa4df360cba8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:27.418539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 350/696] 10.222.0.73 () {56 vars in 1133 bytes} [Wed May 4 13:35:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:27.428247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07a7bc-6223-4436-8d07-aa4df360cba8 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:27.443215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612162-db9a-47af-a177-7d87f84a74a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:27.443939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612162-db9a-47af-a177-7d87f84a74a3 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:27.444272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612162-db9a-47af-a177-7d87f84a74a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:27.444547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22612162-db9a-47af-a177-7d87f84a74a3 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:27.448542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612162-db9a-47af-a177-7d87f84a74a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:27.448859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612162-db9a-47af-a177-7d87f84a74a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:27.452326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22612162-db9a-47af-a177-7d87f84a74a3 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:27.477138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 347/697] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:27.494166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612162-db9a-47af-a177-7d87f84a74a3 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:27.580832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07a7bc-6223-4436-8d07-aa4df360cba8 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:27.623307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bc968-891d-4969-998b-bdc3cd85589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:27.623964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bc968-891d-4969-998b-bdc3cd85589d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:27.624242 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bc968-891d-4969-998b-bdc3cd85589d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:27.624513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bc968-891d-4969-998b-bdc3cd85589d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:27.683722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22612162-db9a-47af-a177-7d87f84a74a3 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:27.723276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c62f2-d6e3-42de-aa08-a66e859e64d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:27.723941 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c62f2-d6e3-42de-aa08-a66e859e64d4 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:27.724220 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c62f2-d6e3-42de-aa08-a66e859e64d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:27.724497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c62f2-d6e3-42de-aa08-a66e859e64d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:27.725325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c62f2-d6e3-42de-aa08-a66e859e64d4 None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=773a01334f8a41d4bf94c5aa205d70ea) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:27.725635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c62f2-d6e3-42de-aa08-a66e859e64d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:27.727050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c62f2-d6e3-42de-aa08-a66e859e64d4 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:27.744601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 348/698] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:27 2022] GET /identity/v3/role_assignments?user.id=773a01334f8a41d4bf94c5aa205d70ea&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:27.768455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bc968-891d-4969-998b-bdc3cd85589d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:27.770072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bc968-891d-4969-998b-bdc3cd85589d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:27.884812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 351/699] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:27.891069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c62f2-d6e3-42de-aa08-a66e859e64d4 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:28.020964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c62f2-d6e3-42de-aa08-a66e859e64d4 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:28.056107 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0f38f-05bf-4171-85cd-35bd10049f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:28.056904 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0f38f-05bf-4171-85cd-35bd10049f66 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:28.057183 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0f38f-05bf-4171-85cd-35bd10049f66 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:28.057454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0f38f-05bf-4171-85cd-35bd10049f66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:28.068397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0f38f-05bf-4171-85cd-35bd10049f66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:28.069843 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0f38f-05bf-4171-85cd-35bd10049f66 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:28.078710 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12cfb4-1809-4e31-939c-ea8423821529 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:28.079063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12cfb4-1809-4e31-939c-ea8423821529 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:28.079382 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12cfb4-1809-4e31-939c-ea8423821529 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:28.080983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 352/700] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-5cc0f38f-05bf-4171-85cd-35bd10049f66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:28.087361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:28.089255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:28.090383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:28.090383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:28.090383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:28.090383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:28.090383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 349/701] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:28.090735 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d6dbd-d951-4b32-96a7-eb6503acd5f5 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:28.090735 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d6dbd-d951-4b32-96a7-eb6503acd5f5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:28.091123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d6dbd-d951-4b32-96a7-eb6503acd5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:28.096804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0f38f-05bf-4171-85cd-35bd10049f66 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:28.120047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-302d6dbd-d951-4b32-96a7-eb6503acd5f5 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:28.121507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-302d6dbd-d951-4b32-96a7-eb6503acd5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:28.195711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 353/702] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:28.204889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0f38f-05bf-4171-85cd-35bd10049f66 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:28.222161 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d6dbd-d951-4b32-96a7-eb6503acd5f5 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:28.240123 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6b925-9ef5-4372-a8a7-a123880be7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:28.241147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6b925-9ef5-4372-a8a7-a123880be7e6 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:28.241643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6b925-9ef5-4372-a8a7-a123880be7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:28.242116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6b925-9ef5-4372-a8a7-a123880be7e6 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:28.243105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6b925-9ef5-4372-a8a7-a123880be7e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:28.243584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6b925-9ef5-4372-a8a7-a123880be7e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:28.245183 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6b925-9ef5-4372-a8a7-a123880be7e6 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:28.259532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 350/703] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:28.277184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6b925-9ef5-4372-a8a7-a123880be7e6 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:28.342061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d6dbd-d951-4b32-96a7-eb6503acd5f5 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:28.377917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c342-3bd0-4caa-8e56-0bb53fe38436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:28.378872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c342-3bd0-4caa-8e56-0bb53fe38436 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:28.379386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c342-3bd0-4caa-8e56-0bb53fe38436 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:28.379687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c342-3bd0-4caa-8e56-0bb53fe38436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:28.385113 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6b925-9ef5-4372-a8a7-a123880be7e6 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:28.390217 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4c342-3bd0-4caa-8e56-0bb53fe38436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:28.391842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4c342-3bd0-4caa-8e56-0bb53fe38436 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-0cd4c342-3bd0-4caa-8e56-0bb53fe38436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:28.409927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:28.411026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:28.411960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:28.411960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:28.411960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:28.411960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:28.412294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 354/704] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:28.417908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c342-3bd0-4caa-8e56-0bb53fe38436 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:28.437742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52b039-a4c1-4134-accc-ce631aa4802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:28.438542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52b039-a4c1-4134-accc-ce631aa4802a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:28.438823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52b039-a4c1-4134-accc-ce631aa4802a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:28.439096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52b039-a4c1-4134-accc-ce631aa4802a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:28.454598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52b039-a4c1-4134-accc-ce631aa4802a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:28.458135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52b039-a4c1-4134-accc-ce631aa4802a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-6d52b039-a4c1-4134-accc-ce631aa4802a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:28.491490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:28.492441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:28.493343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:28.493343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:28.493343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:28.493343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:28.493343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:28.493343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:28.493343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:28.493343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:28.499615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 351/705] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:28.516431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52b039-a4c1-4134-accc-ce631aa4802a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:28.581567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c342-3bd0-4caa-8e56-0bb53fe38436 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:28.622253 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52b039-a4c1-4134-accc-ce631aa4802a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:28.635615 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8261acc-7a23-4467-b7e3-f685e6724897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:28.636738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8261acc-7a23-4467-b7e3-f685e6724897 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:28.637175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8261acc-7a23-4467-b7e3-f685e6724897 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:28.637601 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8261acc-7a23-4467-b7e3-f685e6724897 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:28.639479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8261acc-7a23-4467-b7e3-f685e6724897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:28.639970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8261acc-7a23-4467-b7e3-f685e6724897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:28.643074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8261acc-7a23-4467-b7e3-f685e6724897 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:28.660595 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880401d-fc15-4cff-afe0-07c58e3c2254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:28.661538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880401d-fc15-4cff-afe0-07c58e3c2254 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:28.662050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 355/706] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:28.662414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880401d-fc15-4cff-afe0-07c58e3c2254 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:28.662914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880401d-fc15-4cff-afe0-07c58e3c2254 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:28.663538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215b52c-6d98-49a1-8c2c-1617c6fffc66 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:28.663834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215b52c-6d98-49a1-8c2c-1617c6fffc66 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:28.664114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215b52c-6d98-49a1-8c2c-1617c6fffc66 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:28.664678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880401d-fc15-4cff-afe0-07c58e3c2254 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:28.665475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880401d-fc15-4cff-afe0-07c58e3c2254 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:28.665706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 356/707] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:28.668346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880401d-fc15-4cff-afe0-07c58e3c2254 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:28.672149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0156d8-7a42-48d5-a4dd-e59090f8f803 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:28.672440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0156d8-7a42-48d5-a4dd-e59090f8f803 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:28.672719 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0156d8-7a42-48d5-a4dd-e59090f8f803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:28.685771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 352/708] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:28.686892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880401d-fc15-4cff-afe0-07c58e3c2254 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:28.691188 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-9c0156d8-7a42-48d5-a4dd-e59090f8f803 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:28.691796 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-9c0156d8-7a42-48d5-a4dd-e59090f8f803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:28.759538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 357/709] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:28.760514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0156d8-7a42-48d5-a4dd-e59090f8f803 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:28.797517 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880401d-fc15-4cff-afe0-07c58e3c2254 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:28.833215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd885f-5be4-4c48-8cce-e97d22e3f320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:28.834212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd885f-5be4-4c48-8cce-e97d22e3f320 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:28.834747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd885f-5be4-4c48-8cce-e97d22e3f320 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:28.835279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd885f-5be4-4c48-8cce-e97d22e3f320 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:28.836207 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd885f-5be4-4c48-8cce-e97d22e3f320 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:28.837852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd885f-5be4-4c48-8cce-e97d22e3f320 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:28.862176 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0156d8-7a42-48d5-a4dd-e59090f8f803 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:28.862948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 353/710] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:35:28 2022] POST /identity/v3/users => generated 254 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:28.864290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd885f-5be4-4c48-8cce-e97d22e3f320 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:28.905997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b7ab4-afcf-4f1c-a801-77dde456f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:28.906572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b7ab4-afcf-4f1c-a801-77dde456f30e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:28.906815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b7ab4-afcf-4f1c-a801-77dde456f30e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:28.907032 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b7ab4-afcf-4f1c-a801-77dde456f30e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:28.907942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b7ab4-afcf-4f1c-a801-77dde456f30e None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=10d07b370370461a90cab0b182938292) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:28.908214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b7ab4-afcf-4f1c-a801-77dde456f30e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:28.909628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b7ab4-afcf-4f1c-a801-77dde456f30e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:28.923494 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 358/711] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:28 2022] GET /identity/v3/role_assignments?user.id=10d07b370370461a90cab0b182938292&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=70e67f35994843ae942d4f1703d5619e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:28.995500 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd885f-5be4-4c48-8cce-e97d22e3f320 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:29.041437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035cb9a-e50d-4010-a5cb-a4f51a9876ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:29.042861 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035cb9a-e50d-4010-a5cb-a4f51a9876ed None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:29.043416 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035cb9a-e50d-4010-a5cb-a4f51a9876ed None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:29.043919 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035cb9a-e50d-4010-a5cb-a4f51a9876ed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:29.044897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035cb9a-e50d-4010-a5cb-a4f51a9876ed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:29.046537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035cb9a-e50d-4010-a5cb-a4f51a9876ed None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-b035cb9a-e50d-4010-a5cb-a4f51a9876ed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:29.062065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:29.063131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:35:29.064029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:29.067141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 354/712] 10.222.0.73 () {56 vars in 1129 bytes} [Wed May 4 13:35:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:29.073710 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b7ab4-afcf-4f1c-a801-77dde456f30e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:29.189995 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b7ab4-afcf-4f1c-a801-77dde456f30e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:29.227244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99bac-35d4-4e5c-a51c-0526abeaac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:29.228293 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99bac-35d4-4e5c-a51c-0526abeaac39 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:29.228782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99bac-35d4-4e5c-a51c-0526abeaac39 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:29.229277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99bac-35d4-4e5c-a51c-0526abeaac39 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:29.230180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99bac-35d4-4e5c-a51c-0526abeaac39 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:29.230694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99bac-35d4-4e5c-a51c-0526abeaac39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:29.232291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99bac-35d4-4e5c-a51c-0526abeaac39 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:29.237338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 359/713] 10.222.0.73 () {56 vars in 1124 bytes} [Wed May 4 13:35:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:29.243024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035cb9a-e50d-4010-a5cb-a4f51a9876ed None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:29.356635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035cb9a-e50d-4010-a5cb-a4f51a9876ed None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:29.378723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08a309-4716-4253-a44f-58901d5af38e None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:29.379045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08a309-4716-4253-a44f-58901d5af38e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:29.379585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08a309-4716-4253-a44f-58901d5af38e None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:29.381681 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 360/714] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:29.386722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bb744-6680-475d-b87f-4435484b6d24 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:29.387011 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bb744-6680-475d-b87f-4435484b6d24 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:29.387317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bb744-6680-475d-b87f-4435484b6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:29.398533 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d372196-305c-40e9-a027-11711abecec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:29.399276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d372196-305c-40e9-a027-11711abecec4 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:29.399620 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d372196-305c-40e9-a027-11711abecec4 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:29.399908 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d372196-305c-40e9-a027-11711abecec4 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:29.400628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d372196-305c-40e9-a027-11711abecec4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:29.400935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d372196-305c-40e9-a027-11711abecec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:29.402334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d372196-305c-40e9-a027-11711abecec4 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:29.405284 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-469bb744-6680-475d-b87f-4435484b6d24 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:29.406462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-469bb744-6680-475d-b87f-4435484b6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:29.408353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 355/715] 10.222.0.73 () {56 vars in 1124 bytes} [Wed May 4 13:35:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:29.502149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 361/716] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:35:29.524466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d372196-305c-40e9-a027-11711abecec4 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:29.666547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d372196-305c-40e9-a027-11711abecec4 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:29.702120 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e774c70-6195-4c93-a600-dfab13aff9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:29.702924 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e774c70-6195-4c93-a600-dfab13aff9c4 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:29.703222 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e774c70-6195-4c93-a600-dfab13aff9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:29.703503 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e774c70-6195-4c93-a600-dfab13aff9c4 None admin] PATH_INFO: `/v3/services/network` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:29.704155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e774c70-6195-4c93-a600-dfab13aff9c4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:29.705520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e774c70-6195-4c93-a600-dfab13aff9c4 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-1e774c70-6195-4c93-a600-dfab13aff9c4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:29.718872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:29.719932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:29.720798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 356/717] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:29 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:29.728308 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bb744-6680-475d-b87f-4435484b6d24 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:29.834689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bb744-6680-475d-b87f-4435484b6d24 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:29.872607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f159b-5e04-40ab-a68c-7cc27e66e79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:29.873317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f159b-5e04-40ab-a68c-7cc27e66e79c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:29.873597 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f159b-5e04-40ab-a68c-7cc27e66e79c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:29.873874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f159b-5e04-40ab-a68c-7cc27e66e79c None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:29.874588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f159b-5e04-40ab-a68c-7cc27e66e79c None admin] RBAC: Adding query filter params (name=network) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:29.874902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f159b-5e04-40ab-a68c-7cc27e66e79c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:29.876302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f159b-5e04-40ab-a68c-7cc27e66e79c None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:29.881184 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 362/718] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:35:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:29.886579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e774c70-6195-4c93-a600-dfab13aff9c4 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:30.007065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e774c70-6195-4c93-a600-dfab13aff9c4 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:30.041621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859e0f7-de66-4237-9c8f-7b67206667cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:30.042290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859e0f7-de66-4237-9c8f-7b67206667cf None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:30.042568 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859e0f7-de66-4237-9c8f-7b67206667cf None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:30.042841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859e0f7-de66-4237-9c8f-7b67206667cf None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:30.043578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859e0f7-de66-4237-9c8f-7b67206667cf None admin] RBAC: Adding query filter params (type=network) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:30.043887 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859e0f7-de66-4237-9c8f-7b67206667cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:30.045284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859e0f7-de66-4237-9c8f-7b67206667cf None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:30.050375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 357/719] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:35:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:30.726378 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa1393-b5a4-475f-944a-87c3e9aed321 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:30.726903 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa1393-b5a4-475f-944a-87c3e9aed321 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:30.726903 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa1393-b5a4-475f-944a-87c3e9aed321 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:30.728485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 363/720] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:30.744701 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf188-978c-4bdb-ad44-e23d0cddadc0 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:30.745002 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf188-978c-4bdb-ad44-e23d0cddadc0 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:30.745271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddf188-978c-4bdb-ad44-e23d0cddadc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:30.762576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-e6ddf188-978c-4bdb-ad44-e23d0cddadc0 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:30.763818 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e6ddf188-978c-4bdb-ad44-e23d0cddadc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:30.849080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 358/721] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:30.885900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa1393-b5a4-475f-944a-87c3e9aed321 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:31.007737 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa1393-b5a4-475f-944a-87c3e9aed321 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:31.054582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0e692-4e0f-4422-98b5-28a859306ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:31.055413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0e692-4e0f-4422-98b5-28a859306ce5 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:31.055696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0e692-4e0f-4422-98b5-28a859306ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:31.055969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0e692-4e0f-4422-98b5-28a859306ce5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:31.066652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0e692-4e0f-4422-98b5-28a859306ce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-09a0e692-4e0f-4422-98b5-28a859306ce5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:31.082968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:31.084022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:31.084868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 364/722] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:31.090283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddf188-978c-4bdb-ad44-e23d0cddadc0 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:31.208954 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddf188-978c-4bdb-ad44-e23d0cddadc0 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:31.251271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18199f9f-5734-4c08-8dda-022d13fa2c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:31.251955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18199f9f-5734-4c08-8dda-022d13fa2c38 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:31.252236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18199f9f-5734-4c08-8dda-022d13fa2c38 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:31.252509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18199f9f-5734-4c08-8dda-022d13fa2c38 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:31.253257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18199f9f-5734-4c08-8dda-022d13fa2c38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:31.253561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18199f9f-5734-4c08-8dda-022d13fa2c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:31.254923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18199f9f-5734-4c08-8dda-022d13fa2c38 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:31.263764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 359/723] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:31.268977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0e692-4e0f-4422-98b5-28a859306ce5 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:31.399943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0e692-4e0f-4422-98b5-28a859306ce5 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:31.439061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f3388-7529-4899-a4ca-b1d403d6aafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:31.439887 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f3388-7529-4899-a4ca-b1d403d6aafc None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:31.440166 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f3388-7529-4899-a4ca-b1d403d6aafc None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:31.440442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f3388-7529-4899-a4ca-b1d403d6aafc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:31.451563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f3388-7529-4899-a4ca-b1d403d6aafc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:31.453007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f3388-7529-4899-a4ca-b1d403d6aafc None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-721f3388-7529-4899-a4ca-b1d403d6aafc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:31.474552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:31.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:31.476405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:31.476405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:31.476405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:31.476405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:31.476405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 365/724] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:31.481578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18199f9f-5734-4c08-8dda-022d13fa2c38 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:31.626513 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18199f9f-5734-4c08-8dda-022d13fa2c38 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:31.664429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0022-fb54-45c4-94b1-44355c8cd59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:31.665157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0022-fb54-45c4-94b1-44355c8cd59d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:31.665441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0022-fb54-45c4-94b1-44355c8cd59d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:31.665716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0022-fb54-45c4-94b1-44355c8cd59d None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:31.666439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc0022-fb54-45c4-94b1-44355c8cd59d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:31.666742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc0022-fb54-45c4-94b1-44355c8cd59d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:31.668137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc0022-fb54-45c4-94b1-44355c8cd59d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:31.684782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 360/725] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:31.692283 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f3388-7529-4899-a4ca-b1d403d6aafc None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:31.810246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f3388-7529-4899-a4ca-b1d403d6aafc None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:31.850856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9c0f4-b661-4dd4-b338-e6b58fc74b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:31.851727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9c0f4-b661-4dd4-b338-e6b58fc74b9d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:31.852014 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9c0f4-b661-4dd4-b338-e6b58fc74b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:31.852292 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9c0f4-b661-4dd4-b338-e6b58fc74b9d None admin] PATH_INFO: `/v3/users/swift` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:31.862091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9c0f4-b661-4dd4-b338-e6b58fc74b9d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:31.863636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9c0f4-b661-4dd4-b338-e6b58fc74b9d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-d0e9c0f4-b661-4dd4-b338-e6b58fc74b9d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:31.880631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:31.882853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:31.885115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:31.885115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:31.885115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:31.885115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:31.885115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:31.885115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:31.885115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:31.885115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:31.885115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 13:35:31.885115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:31.885115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 366/726] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:31.895242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0022-fb54-45c4-94b1-44355c8cd59d None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:31.979803 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d11c62-7bd0-4bdc-b999-7a73ba187469 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:31.980159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d11c62-7bd0-4bdc-b999-7a73ba187469 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:31.980362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d11c62-7bd0-4bdc-b999-7a73ba187469 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:31.981954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 367/727] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:31.987691 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052652c-b68b-43f0-bf65-33d0ba8f4d8c None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:31.987980 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052652c-b68b-43f0-bf65-33d0ba8f4d8c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:31.988256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052652c-b68b-43f0-bf65-33d0ba8f4d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.022885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-3052652c-b68b-43f0-bf65-33d0ba8f4d8c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:32.024094 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3052652c-b68b-43f0-bf65-33d0ba8f4d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:32.041951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0022-fb54-45c4-94b1-44355c8cd59d None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:32.076329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad12a1-f0be-45ca-8dc0-27fa3de44873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:32.076999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad12a1-f0be-45ca-8dc0-27fa3de44873 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:32.077276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad12a1-f0be-45ca-8dc0-27fa3de44873 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:32.077546 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad12a1-f0be-45ca-8dc0-27fa3de44873 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.078383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad12a1-f0be-45ca-8dc0-27fa3de44873 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:32.078688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad12a1-f0be-45ca-8dc0-27fa3de44873 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:32.080147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad12a1-f0be-45ca-8dc0-27fa3de44873 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:32.098039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 361/728] 10.222.0.73 () {56 vars in 1135 bytes} [Wed May 4 13:35:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:32.099360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d828-8298-4e77-8ae2-13ea61e9b5ae None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:32.099648 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d828-8298-4e77-8ae2-13ea61e9b5ae None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:32.099922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596d828-8298-4e77-8ae2-13ea61e9b5ae None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.101279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 362/729] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:32.102190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826afa0-da74-44f9-a626-ac31c3933064 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:32.102476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826afa0-da74-44f9-a626-ac31c3933064 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:32.102746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826afa0-da74-44f9-a626-ac31c3933064 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.103964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 363/730] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:32.105033 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826afa0-da74-44f9-a626-ac31c3933064 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:32.116624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 368/731] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 13:35:32.118579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cfb2a-4c6c-4eef-a0ac-4104dbd97435 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:32.119492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cfb2a-4c6c-4eef-a0ac-4104dbd97435 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:32.119999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cfb2a-4c6c-4eef-a0ac-4104dbd97435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.144851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-0e2cfb2a-4c6c-4eef-a0ac-4104dbd97435 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:32.145949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0e2cfb2a-4c6c-4eef-a0ac-4104dbd97435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:32.210272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 369/732] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:32.212054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826afa0-da74-44f9-a626-ac31c3933064 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:32.217162 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e28f-cfbd-4444-b32e-04466259683c None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:32.217668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e28f-cfbd-4444-b32e-04466259683c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:32.218199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154e28f-cfbd-4444-b32e-04466259683c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.239139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-5154e28f-cfbd-4444-b32e-04466259683c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:32.240827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5154e28f-cfbd-4444-b32e-04466259683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:32.245755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e511e-e0a3-4ea1-9404-664dfab61b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:32.246397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e511e-e0a3-4ea1-9404-664dfab61b0a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:32.246677 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e511e-e0a3-4ea1-9404-664dfab61b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:32.246949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e511e-e0a3-4ea1-9404-664dfab61b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.314938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 370/733] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:32.316166 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154e28f-cfbd-4444-b32e-04466259683c None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:32.331265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e511e-e0a3-4ea1-9404-664dfab61b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:32.331265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e511e-e0a3-4ea1-9404-664dfab61b0a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:32.415277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154e28f-cfbd-4444-b32e-04466259683c None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:32.424591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 364/734] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 13:35:32.425415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e511e-e0a3-4ea1-9404-664dfab61b0a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:32.452969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abea50-594d-4189-b815-7803ee0fae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:32.453765 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abea50-594d-4189-b815-7803ee0fae2a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:32.454044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abea50-594d-4189-b815-7803ee0fae2a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:32.454316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abea50-594d-4189-b815-7803ee0fae2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.464890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abea50-594d-4189-b815-7803ee0fae2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-51abea50-594d-4189-b815-7803ee0fae2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:32.472586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:32.473602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:32.474444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 371/735] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:32.475157 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abea50-594d-4189-b815-7803ee0fae2a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:32.526854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e511e-e0a3-4ea1-9404-664dfab61b0a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:32.559310 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28fcb1-033d-42b6-aaae-1c135f1c7005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:32.559966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28fcb1-033d-42b6-aaae-1c135f1c7005 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:32.560745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28fcb1-033d-42b6-aaae-1c135f1c7005 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:32.561077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28fcb1-033d-42b6-aaae-1c135f1c7005 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.561794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28fcb1-033d-42b6-aaae-1c135f1c7005 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:32.563186 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28fcb1-033d-42b6-aaae-1c135f1c7005 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:32.575333 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abea50-594d-4189-b815-7803ee0fae2a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:32.580458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 365/736] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:35:32 2022] POST /identity/v3/services => generated 251 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:32.581103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28fcb1-033d-42b6-aaae-1c135f1c7005 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:32.634370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684d4f8-37b3-4be8-a71b-7b1043fdd776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:32.635694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684d4f8-37b3-4be8-a71b-7b1043fdd776 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:32.636249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684d4f8-37b3-4be8-a71b-7b1043fdd776 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:32.636733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684d4f8-37b3-4be8-a71b-7b1043fdd776 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.651076 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684d4f8-37b3-4be8-a71b-7b1043fdd776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-1684d4f8-37b3-4be8-a71b-7b1043fdd776 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:32.660163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:32.661185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:32.662099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:32.662099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:32.662099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:32.662099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:32.662099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:32.662099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:32.662099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:32.662099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:32.662099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:32.662099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:32.662099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:32.662099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:32.670992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 372/737] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:32.672270 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684d4f8-37b3-4be8-a71b-7b1043fdd776 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:32.691931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28fcb1-033d-42b6-aaae-1c135f1c7005 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:32.728821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bfdc8-d07b-4b5d-8af1-fb165cce74ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:32.729626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bfdc8-d07b-4b5d-8af1-fb165cce74ff None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:32.730124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bfdc8-d07b-4b5d-8af1-fb165cce74ff None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:32.730309 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bfdc8-d07b-4b5d-8af1-fb165cce74ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.742575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bfdc8-d07b-4b5d-8af1-fb165cce74ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:32.744113 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bfdc8-d07b-4b5d-8af1-fb165cce74ff None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-d69bfdc8-d07b-4b5d-8af1-fb165cce74ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:32.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:32.764592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:32.765506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:32.765506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:32.765506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:32.765506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:32.769418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 366/738] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:32.770307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bfdc8-d07b-4b5d-8af1-fb165cce74ff None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:32.789567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684d4f8-37b3-4be8-a71b-7b1043fdd776 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:32.831334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8efde-7bfb-4bfe-b5d2-9be68b22cfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:32.832132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8efde-7bfb-4bfe-b5d2-9be68b22cfa6 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:32.832341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8efde-7bfb-4bfe-b5d2-9be68b22cfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:32.832618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8efde-7bfb-4bfe-b5d2-9be68b22cfa6 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.833368 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8efde-7bfb-4bfe-b5d2-9be68b22cfa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:32.833673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8efde-7bfb-4bfe-b5d2-9be68b22cfa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:32.835032 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8efde-7bfb-4bfe-b5d2-9be68b22cfa6 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:32.847139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 373/739] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:32.848078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8efde-7bfb-4bfe-b5d2-9be68b22cfa6 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:32.886472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bfdc8-d07b-4b5d-8af1-fb165cce74ff None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:32.928204 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca4047-f5c7-4375-94b7-8165cb8d9d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:32.929343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca4047-f5c7-4375-94b7-8165cb8d9d0b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:32.930299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca4047-f5c7-4375-94b7-8165cb8d9d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:32.930790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca4047-f5c7-4375-94b7-8165cb8d9d0b None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:32.932012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca4047-f5c7-4375-94b7-8165cb8d9d0b None admin] RBAC: Adding query filter params (name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:32.932505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca4047-f5c7-4375-94b7-8165cb8d9d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:32.934989 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca4047-f5c7-4375-94b7-8165cb8d9d0b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:32.945917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 367/740] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:32.947165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca4047-f5c7-4375-94b7-8165cb8d9d0b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:32.969792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8efde-7bfb-4bfe-b5d2-9be68b22cfa6 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:33.011356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cf77a-e5d2-41fb-84f9-a34af5a4a11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:33.012213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cf77a-e5d2-41fb-84f9-a34af5a4a11e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:33.012614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cf77a-e5d2-41fb-84f9-a34af5a4a11e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:33.012990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cf77a-e5d2-41fb-84f9-a34af5a4a11e None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:33.014308 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cf77a-e5d2-41fb-84f9-a34af5a4a11e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:33.014718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cf77a-e5d2-41fb-84f9-a34af5a4a11e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:33.016422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cf77a-e5d2-41fb-84f9-a34af5a4a11e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:33.067700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca4047-f5c7-4375-94b7-8165cb8d9d0b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:33.101839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8728-519a-46ed-9d90-a473767f4ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:33.102654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8728-519a-46ed-9d90-a473767f4ed8 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:33.102924 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8728-519a-46ed-9d90-a473767f4ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:33.103197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8728-519a-46ed-9d90-a473767f4ed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:33.115254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f8728-519a-46ed-9d90-a473767f4ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:33.116737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f8728-519a-46ed-9d90-a473767f4ed8 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-279f8728-519a-46ed-9d90-a473767f4ed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:33.135126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:33.136127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:33.137029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:33.137029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:33.137029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:33.137029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:33.137029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 368/741] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:33.137815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8728-519a-46ed-9d90-a473767f4ed8 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:33.163978 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 374/742] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:33.165635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97766336-d482-4639-b47c-40f99c520f8b None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:33.165995 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97766336-d482-4639-b47c-40f99c520f8b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:33.166340 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97766336-d482-4639-b47c-40f99c520f8b None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:33.167798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 375/743] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:33.168406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97766336-d482-4639-b47c-40f99c520f8b None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:33.242977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8728-519a-46ed-9d90-a473767f4ed8 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:33.272103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97766336-d482-4639-b47c-40f99c520f8b None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:33.275700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d720ad-f0f9-46dd-8a8d-a9c061351760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:33.276561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d720ad-f0f9-46dd-8a8d-a9c061351760 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:33.276914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d720ad-f0f9-46dd-8a8d-a9c061351760 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:33.277332 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d720ad-f0f9-46dd-8a8d-a9c061351760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:33.287804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d720ad-f0f9-46dd-8a8d-a9c061351760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:33.289333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d720ad-f0f9-46dd-8a8d-a9c061351760 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-b3d720ad-f0f9-46dd-8a8d-a9c061351760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:33.307777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:33.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:33.309761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:33.309761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:33.309761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:33.309761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:33.309761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 369/744] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:33.313776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d720ad-f0f9-46dd-8a8d-a9c061351760 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:33.316105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7a342-c31e-42c3-8bdd-a1ad9b91b631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:33.316224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7a342-c31e-42c3-8bdd-a1ad9b91b631 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:33.316492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7a342-c31e-42c3-8bdd-a1ad9b91b631 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:33.316759 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7a342-c31e-42c3-8bdd-a1ad9b91b631 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:33.317484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7a342-c31e-42c3-8bdd-a1ad9b91b631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:33.317786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7a342-c31e-42c3-8bdd-a1ad9b91b631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:33.319150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7a342-c31e-42c3-8bdd-a1ad9b91b631 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:33.331440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 376/745] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:33.337164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0c2a-d9bd-444b-a807-0928a301f281 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:33.337481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0c2a-d9bd-444b-a807-0928a301f281 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:33.337784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0c2a-d9bd-444b-a807-0928a301f281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:33.359391 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-777e0c2a-d9bd-444b-a807-0928a301f281 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:33.360575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-777e0c2a-d9bd-444b-a807-0928a301f281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:33.417797 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d720ad-f0f9-46dd-8a8d-a9c061351760 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:33.424690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 377/746] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 13:35:33.425547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e0c2a-d9bd-444b-a807-0928a301f281 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:33.472673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3e57c-b6a3-4889-bb8d-d11c3b2528c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:33.473473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3e57c-b6a3-4889-bb8d-d11c3b2528c5 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:33.473759 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3e57c-b6a3-4889-bb8d-d11c3b2528c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:33.474040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3e57c-b6a3-4889-bb8d-d11c3b2528c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:33.480733 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3e57c-b6a3-4889-bb8d-d11c3b2528c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:33.482690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3e57c-b6a3-4889-bb8d-d11c3b2528c5 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-7ad3e57c-b6a3-4889-bb8d-d11c3b2528c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:33.496602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:33.497524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:33.499647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:33.499647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:33.499647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:33.499647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:33.499647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:33.499647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:33.499647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:33.499647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:33.499647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 370/747] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:33.499647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3e57c-b6a3-4889-bb8d-d11c3b2528c5 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:33.529432 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e0c2a-d9bd-444b-a807-0928a301f281 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:33.567681 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d03dc-5628-4c9f-8e7e-ae3ca7288970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:33.568348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d03dc-5628-4c9f-8e7e-ae3ca7288970 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:33.568630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d03dc-5628-4c9f-8e7e-ae3ca7288970 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:33.568904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d03dc-5628-4c9f-8e7e-ae3ca7288970 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:33.569622 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d03dc-5628-4c9f-8e7e-ae3ca7288970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:33.569929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d03dc-5628-4c9f-8e7e-ae3ca7288970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:33.571557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d03dc-5628-4c9f-8e7e-ae3ca7288970 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:33.582684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 378/748] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:33.583476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d03dc-5628-4c9f-8e7e-ae3ca7288970 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:33.604324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3e57c-b6a3-4889-bb8d-d11c3b2528c5 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:33.646278 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6785d95-e789-468d-a5a9-ed3d2eec5705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:33.647480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6785d95-e789-468d-a5a9-ed3d2eec5705 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:33.647915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6785d95-e789-468d-a5a9-ed3d2eec5705 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:33.648815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6785d95-e789-468d-a5a9-ed3d2eec5705 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:33.657458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6785d95-e789-468d-a5a9-ed3d2eec5705 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:33.659551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6785d95-e789-468d-a5a9-ed3d2eec5705 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-c6785d95-e789-468d-a5a9-ed3d2eec5705 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:33.675168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:33.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:33.677691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:33.677691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:33.677691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:33.677691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:33.677691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:33.677691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:33.677691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:33.677691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:33.677691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:35:33.677691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:33.681189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 371/749] 10.222.0.73 () {56 vars in 1093 bytes} [Wed May 4 13:35:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:33.681821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6785d95-e789-468d-a5a9-ed3d2eec5705 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:33.683526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d03dc-5628-4c9f-8e7e-ae3ca7288970 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:33.717177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527151c2-7da6-412c-a5e6-689f1e4ca3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:33.717839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527151c2-7da6-412c-a5e6-689f1e4ca3a1 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:33.718121 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527151c2-7da6-412c-a5e6-689f1e4ca3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:33.718392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527151c2-7da6-412c-a5e6-689f1e4ca3a1 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:33.719116 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527151c2-7da6-412c-a5e6-689f1e4ca3a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:33.720495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527151c2-7da6-412c-a5e6-689f1e4ca3a1 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:33.735601 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 379/750] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:35:33 2022] POST /identity/v3/services => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:33.736622 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527151c2-7da6-412c-a5e6-689f1e4ca3a1 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:33.792119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6785d95-e789-468d-a5a9-ed3d2eec5705 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:33.837360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6d2a6-a75f-455b-91a1-70f15179716d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:33.838399 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6d2a6-a75f-455b-91a1-70f15179716d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:33.838868 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6d2a6-a75f-455b-91a1-70f15179716d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:33.839361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6d2a6-a75f-455b-91a1-70f15179716d None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:33.840430 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6d2a6-a75f-455b-91a1-70f15179716d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:33.840970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6d2a6-a75f-455b-91a1-70f15179716d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:33.842758 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6d2a6-a75f-455b-91a1-70f15179716d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:33.850725 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527151c2-7da6-412c-a5e6-689f1e4ca3a1 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:33.856716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 372/751] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:33.858581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6d2a6-a75f-455b-91a1-70f15179716d None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:33.892751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bd703-16eb-4344-a5fa-0d87d32a5718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:33.893320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bd703-16eb-4344-a5fa-0d87d32a5718 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:33.893600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bd703-16eb-4344-a5fa-0d87d32a5718 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:33.893928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bd703-16eb-4344-a5fa-0d87d32a5718 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:33.903127 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bd703-16eb-4344-a5fa-0d87d32a5718 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:33.905148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bd703-16eb-4344-a5fa-0d87d32a5718 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-357bd703-16eb-4344-a5fa-0d87d32a5718 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:33.921064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:33.922081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:33.923010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:33.923010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:33.923010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:33.923010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:33.923010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:33.923010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:33.923010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:33.923010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:33.923010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:35:33.923010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:33.926932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 380/752] 10.222.0.73 () {56 vars in 1117 bytes} [Wed May 4 13:35:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:33.927890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bd703-16eb-4344-a5fa-0d87d32a5718 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:33.973600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6d2a6-a75f-455b-91a1-70f15179716d None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:34.012927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71e926-4236-44e1-9054-f0408620a02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:34.013629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71e926-4236-44e1-9054-f0408620a02a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:34.013900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71e926-4236-44e1-9054-f0408620a02a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:34.014168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71e926-4236-44e1-9054-f0408620a02a None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:34.015006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71e926-4236-44e1-9054-f0408620a02a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:34.015335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71e926-4236-44e1-9054-f0408620a02a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:34.016756 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71e926-4236-44e1-9054-f0408620a02a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:34.036630 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 373/753] 10.222.0.73 () {56 vars in 1133 bytes} [Wed May 4 13:35:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:34.041609 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71e926-4236-44e1-9054-f0408620a02a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:34.048773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bd703-16eb-4344-a5fa-0d87d32a5718 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:34.082188 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991238f-27da-4e81-8f8a-22375e47c179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:34.082883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991238f-27da-4e81-8f8a-22375e47c179 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:34.083164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991238f-27da-4e81-8f8a-22375e47c179 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:34.083458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991238f-27da-4e81-8f8a-22375e47c179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:34.084285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991238f-27da-4e81-8f8a-22375e47c179 None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=773a01334f8a41d4bf94c5aa205d70ea) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:34.084589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991238f-27da-4e81-8f8a-22375e47c179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:34.085973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991238f-27da-4e81-8f8a-22375e47c179 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:34.092378 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 381/754] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:33 2022] GET /identity/v3/role_assignments?user.id=773a01334f8a41d4bf94c5aa205d70ea&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=70e67f35994843ae942d4f1703d5619e => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:34.093176 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991238f-27da-4e81-8f8a-22375e47c179 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:34.206364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991238f-27da-4e81-8f8a-22375e47c179 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:34.210737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71e926-4236-44e1-9054-f0408620a02a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:34.242774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f26df9-a681-404f-bc8b-955d4a12e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:34.243597 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f26df9-a681-404f-bc8b-955d4a12e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:34.243871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f26df9-a681-404f-bc8b-955d4a12e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:34.244137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f26df9-a681-404f-bc8b-955d4a12e5b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:34.265506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f26df9-a681-404f-bc8b-955d4a12e5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:34.266954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f26df9-a681-404f-bc8b-955d4a12e5b0 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:34.290195 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7ac76-9424-4696-ac35-c44a91ba9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:34.290911 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7ac76-9424-4696-ac35-c44a91ba9a07 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:34.291194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7ac76-9424-4696-ac35-c44a91ba9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:34.291486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7ac76-9424-4696-ac35-c44a91ba9a07 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:34.292744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7ac76-9424-4696-ac35-c44a91ba9a07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:34.293055 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7ac76-9424-4696-ac35-c44a91ba9a07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:34.298388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7ac76-9424-4696-ac35-c44a91ba9a07 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-44f26df9-a681-404f-bc8b-955d4a12e5b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:34.304365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:34.305248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:34.306137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:34.306137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:34.306137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:34.306137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:34.306137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 382/755] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:34.313753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f26df9-a681-404f-bc8b-955d4a12e5b0 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:34.335022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 374/756] 10.222.0.73 () {56 vars in 1149 bytes} [Wed May 4 13:35:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:34.340893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7ac76-9424-4696-ac35-c44a91ba9a07 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:34.432422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f26df9-a681-404f-bc8b-955d4a12e5b0 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:34.454127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7ac76-9424-4696-ac35-c44a91ba9a07 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:34.477850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832645c-5bc7-4236-a4d5-84e3ed54b6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:34.478679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832645c-5bc7-4236-a4d5-84e3ed54b6f0 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:34.479057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832645c-5bc7-4236-a4d5-84e3ed54b6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:34.479662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832645c-5bc7-4236-a4d5-84e3ed54b6f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:34.480266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832645c-5bc7-4236-a4d5-84e3ed54b6f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:34.480662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832645c-5bc7-4236-a4d5-84e3ed54b6f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:34.482137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832645c-5bc7-4236-a4d5-84e3ed54b6f0 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:34.490575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5625db2-35b9-417f-a34c-be1dec85b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:34.491484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5625db2-35b9-417f-a34c-be1dec85b6fe None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:34.491914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5625db2-35b9-417f-a34c-be1dec85b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:34.492355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5625db2-35b9-417f-a34c-be1dec85b6fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:34.494994 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 383/757] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:34.501517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832645c-5bc7-4236-a4d5-84e3ed54b6f0 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:34.619181 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832645c-5bc7-4236-a4d5-84e3ed54b6f0 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:34.652694 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5625db2-35b9-417f-a34c-be1dec85b6fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:34.655315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5625db2-35b9-417f-a34c-be1dec85b6fe None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:34.673163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2f065-e1fa-41e3-b05e-6f22f8334909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:34.674124 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2f065-e1fa-41e3-b05e-6f22f8334909 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:34.674502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2f065-e1fa-41e3-b05e-6f22f8334909 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:34.674922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2f065-e1fa-41e3-b05e-6f22f8334909 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:34.686558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2f065-e1fa-41e3-b05e-6f22f8334909 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:34.689503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2f065-e1fa-41e3-b05e-6f22f8334909 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-51f2f065-e1fa-41e3-b05e-6f22f8334909 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:34.715932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:34.717581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:34.718773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:34.718773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:34.718773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:34.718773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:34.718773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:34.718773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:34.718773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:34.718773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:34.726038 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 384/758] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:34.731861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2f065-e1fa-41e3-b05e-6f22f8334909 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:34.840072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2f065-e1fa-41e3-b05e-6f22f8334909 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:34.873850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ff43c-7173-411e-b797-523fd9738588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:34.874473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ff43c-7173-411e-b797-523fd9738588 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:34.874729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ff43c-7173-411e-b797-523fd9738588 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:34.874957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ff43c-7173-411e-b797-523fd9738588 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:34.875770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ff43c-7173-411e-b797-523fd9738588 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:34.876071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ff43c-7173-411e-b797-523fd9738588 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:34.877477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ff43c-7173-411e-b797-523fd9738588 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:34.890439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 385/759] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:34.896051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ff43c-7173-411e-b797-523fd9738588 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:34.896854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 375/760] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:35:34.905984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5625db2-35b9-417f-a34c-be1dec85b6fe None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:35.040953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ff43c-7173-411e-b797-523fd9738588 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:35.051528 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5625db2-35b9-417f-a34c-be1dec85b6fe None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:35.076508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44369f-3239-4838-a8a2-b539925c1de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:35.077465 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44369f-3239-4838-a8a2-b539925c1de9 None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:35.077749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44369f-3239-4838-a8a2-b539925c1de9 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:35.078017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44369f-3239-4838-a8a2-b539925c1de9 None admin] PATH_INFO: `/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/10d07b370370461a90cab0b182938292/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:35.080149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44369f-3239-4838-a8a2-b539925c1de9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbace3b0d2f54a408012ccc368865c82, user_id=10d07b370370461a90cab0b182938292, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:35.081713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44369f-3239-4838-a8a2-b539925c1de9 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:35.107505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 386/761] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:35:34 2022] PUT /identity/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/10d07b370370461a90cab0b182938292/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:35:35.107505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6b208-ba70-4b76-9dc2-7ecc2a3c7bcd None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:35.107505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6b208-ba70-4b76-9dc2-7ecc2a3c7bcd None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:35.107505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6b208-ba70-4b76-9dc2-7ecc2a3c7bcd None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:35.107505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 387/762] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:35.116050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f6047-d4dd-48be-80a7-e444f5e0a68f None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:35.116570 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f6047-d4dd-48be-80a7-e444f5e0a68f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:35.117454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f6047-d4dd-48be-80a7-e444f5e0a68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:35.120398 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494e98c-7779-4239-abc1-5ec7d2066f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:35.121491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e98c-7779-4239-abc1-5ec7d2066f2f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:35.122405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e98c-7779-4239-abc1-5ec7d2066f2f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:35.124261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494e98c-7779-4239-abc1-5ec7d2066f2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:35.143661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494e98c-7779-4239-abc1-5ec7d2066f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:35.146980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494e98c-7779-4239-abc1-5ec7d2066f2f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:35.155521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b56f6047-d4dd-48be-80a7-e444f5e0a68f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:35.156734 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b56f6047-d4dd-48be-80a7-e444f5e0a68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-3494e98c-7779-4239-abc1-5ec7d2066f2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:35.186802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:35.187994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:35.189057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:35.189057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:35.189057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:35.189057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:35.189057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 376/763] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:35.193985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494e98c-7779-4239-abc1-5ec7d2066f2f None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:35.303160 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 388/764] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:35.334658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f6047-d4dd-48be-80a7-e444f5e0a68f None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:35.353095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494e98c-7779-4239-abc1-5ec7d2066f2f None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:35.392690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba9e0d-0447-4108-b2ea-cc723e550a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:35.393280 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9e0d-0447-4108-b2ea-cc723e550a8d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:35.393561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9e0d-0447-4108-b2ea-cc723e550a8d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:35.393840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9e0d-0447-4108-b2ea-cc723e550a8d None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:35.394573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba9e0d-0447-4108-b2ea-cc723e550a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:35.394879 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba9e0d-0447-4108-b2ea-cc723e550a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:35.396294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba9e0d-0447-4108-b2ea-cc723e550a8d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:35.422840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 377/765] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:35.428359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba9e0d-0447-4108-b2ea-cc723e550a8d None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:35.550571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f6047-d4dd-48be-80a7-e444f5e0a68f None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:35.601339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba9e0d-0447-4108-b2ea-cc723e550a8d None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:35.617447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564638aa-11a3-4825-9612-cf1fd0828264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:35.618314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564638aa-11a3-4825-9612-cf1fd0828264 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:35.618596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564638aa-11a3-4825-9612-cf1fd0828264 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:35.618914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564638aa-11a3-4825-9612-cf1fd0828264 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:35.620436 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564638aa-11a3-4825-9612-cf1fd0828264 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:35.621298 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564638aa-11a3-4825-9612-cf1fd0828264 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-564638aa-11a3-4825-9612-cf1fd0828264 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:35.639231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:35.640183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:35:35.641030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:35.647286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 389/766] 10.222.0.73 () {56 vars in 1129 bytes} [Wed May 4 13:35:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:35.647286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564638aa-11a3-4825-9612-cf1fd0828264 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:35.672501 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ec6d4-4156-4baa-842a-30aabc5fcc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:35.673298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ec6d4-4156-4baa-842a-30aabc5fcc5b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:35.674388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ec6d4-4156-4baa-842a-30aabc5fcc5b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:35.674657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ec6d4-4156-4baa-842a-30aabc5fcc5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:35.689920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ec6d4-4156-4baa-842a-30aabc5fcc5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:35.691789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ec6d4-4156-4baa-842a-30aabc5fcc5b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-4f2ec6d4-4156-4baa-842a-30aabc5fcc5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:35.711681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:35.712635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:35.713530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:35.713530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:35.713530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:35.713530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:35.713530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:35.713530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:35.713530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:35.713530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:35.717591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 378/767] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:35.718767 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ec6d4-4156-4baa-842a-30aabc5fcc5b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:35.802277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564638aa-11a3-4825-9612-cf1fd0828264 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:35.817871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ec6d4-4156-4baa-842a-30aabc5fcc5b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:35.836139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32086d19-542c-4105-9f3b-4fb561bdd693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:35.836810 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32086d19-542c-4105-9f3b-4fb561bdd693 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:35.837090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32086d19-542c-4105-9f3b-4fb561bdd693 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:35.837364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32086d19-542c-4105-9f3b-4fb561bdd693 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:35.838081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32086d19-542c-4105-9f3b-4fb561bdd693 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:35.838384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32086d19-542c-4105-9f3b-4fb561bdd693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:35.839769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32086d19-542c-4105-9f3b-4fb561bdd693 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:35.844661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 390/768] 10.222.0.73 () {56 vars in 1124 bytes} [Wed May 4 13:35:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:35.850303 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32086d19-542c-4105-9f3b-4fb561bdd693 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:35.852751 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fedde-973e-4d39-bdf8-92e0b191301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:35.853415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fedde-973e-4d39-bdf8-92e0b191301c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:35.853750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fedde-973e-4d39-bdf8-92e0b191301c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:35.854035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fedde-973e-4d39-bdf8-92e0b191301c None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:35.854879 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fedde-973e-4d39-bdf8-92e0b191301c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:35.855194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fedde-973e-4d39-bdf8-92e0b191301c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:35.856662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fedde-973e-4d39-bdf8-92e0b191301c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:35.874673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 379/769] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:35.875984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fedde-973e-4d39-bdf8-92e0b191301c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:35.959764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32086d19-542c-4105-9f3b-4fb561bdd693 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:35.977271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fedde-973e-4d39-bdf8-92e0b191301c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:35.995647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c7dd5-55b8-4efc-9a06-5338b38df439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:35.996314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c7dd5-55b8-4efc-9a06-5338b38df439 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:35.996598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c7dd5-55b8-4efc-9a06-5338b38df439 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:35.996868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c7dd5-55b8-4efc-9a06-5338b38df439 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:35.997635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c7dd5-55b8-4efc-9a06-5338b38df439 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:35.998503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c7dd5-55b8-4efc-9a06-5338b38df439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:35.999890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c7dd5-55b8-4efc-9a06-5338b38df439 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:36.006164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 391/770] 10.222.0.73 () {56 vars in 1124 bytes} [Wed May 4 13:35:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:36.011850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c7dd5-55b8-4efc-9a06-5338b38df439 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:36.014324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bbfe9-cfed-478c-bf24-bf2071113aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:36.014986 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bbfe9-cfed-478c-bf24-bf2071113aae None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:36.015297 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bbfe9-cfed-478c-bf24-bf2071113aae None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:36.015635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bbfe9-cfed-478c-bf24-bf2071113aae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:36.016477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bbfe9-cfed-478c-bf24-bf2071113aae None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=631d619317354b76bf1535550a207b0d) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:36.016830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bbfe9-cfed-478c-bf24-bf2071113aae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:36.018295 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bbfe9-cfed-478c-bf24-bf2071113aae None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:36.031384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 380/771] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:35 2022] GET /identity/v3/role_assignments?user.id=631d619317354b76bf1535550a207b0d&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:36.163236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c7dd5-55b8-4efc-9a06-5338b38df439 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:36.198985 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7445470-bbd2-46e9-80f8-9ec545a68f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:36.199690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7445470-bbd2-46e9-80f8-9ec545a68f95 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:36.199970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7445470-bbd2-46e9-80f8-9ec545a68f95 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:36.200244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7445470-bbd2-46e9-80f8-9ec545a68f95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:36.201089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7445470-bbd2-46e9-80f8-9ec545a68f95 None admin] RBAC: Adding query filter params (interface=public, service_id=b347d4863fe84b878f0ac52eea2f2d0a, region_id=RegionOne) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:36.201403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7445470-bbd2-46e9-80f8-9ec545a68f95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:36.202828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7445470-bbd2-46e9-80f8-9ec545a68f95 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:36.211083 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 392/772] 10.222.0.73 () {56 vars in 1251 bytes} [Wed May 4 13:35:36 2022] GET /identity/v3/endpoints?service_id=b347d4863fe84b878f0ac52eea2f2d0a&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:36.219682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bbfe9-cfed-478c-bf24-bf2071113aae None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:36.361427 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bbfe9-cfed-478c-bf24-bf2071113aae None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:36.401905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03fce1-671e-4ead-a627-ce2b09514715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:36.403140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03fce1-671e-4ead-a627-ce2b09514715 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:36.403454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03fce1-671e-4ead-a627-ce2b09514715 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:36.403734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03fce1-671e-4ead-a627-ce2b09514715 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:36.404977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03fce1-671e-4ead-a627-ce2b09514715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:36.406357 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03fce1-671e-4ead-a627-ce2b09514715 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:36.418215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 381/773] 10.222.0.73 () {56 vars in 1087 bytes} [Wed May 4 13:35:36 2022] GET /identity/v3/services => generated 772 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:36.437450 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8506c0-f5ce-4b79-afc0-73c1521a9c6d None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:36.437450 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8506c0-f5ce-4b79-afc0-73c1521a9c6d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:36.437450 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8506c0-f5ce-4b79-afc0-73c1521a9c6d None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:36.437450 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 393/774] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:36.443968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330e79-b995-4644-9057-ba80e2ea581e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:36.444288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330e79-b995-4644-9057-ba80e2ea581e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:36.444530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330e79-b995-4644-9057-ba80e2ea581e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:36.468576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-60330e79-b995-4644-9057-ba80e2ea581e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:36.469751 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-60330e79-b995-4644-9057-ba80e2ea581e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:36.557660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 382/775] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:36.590403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8506c0-f5ce-4b79-afc0-73c1521a9c6d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:36.737980 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8506c0-f5ce-4b79-afc0-73c1521a9c6d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:36.775607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5595f4-57ff-468c-990c-f875c161376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:36.776421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5595f4-57ff-468c-990c-f875c161376f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:36.776705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5595f4-57ff-468c-990c-f875c161376f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:36.776977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5595f4-57ff-468c-990c-f875c161376f None admin] PATH_INFO: `/v3/services/network` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:36.777785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5595f4-57ff-468c-990c-f875c161376f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:36.779756 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5595f4-57ff-468c-990c-f875c161376f None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-eb5595f4-57ff-468c-990c-f875c161376f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:36.792213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:36.793234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:36.794142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 394/776] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:36 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:36.802549 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60330e79-b995-4644-9057-ba80e2ea581e None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:36.911651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60330e79-b995-4644-9057-ba80e2ea581e None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:36.946309 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20decd48-ff40-4dbf-a6ff-95b20cc81a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:36.946546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b089d-9044-4a7e-9f30-01e4f3c3c55f None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:36.946842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b089d-9044-4a7e-9f30-01e4f3c3c55f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:36.947014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20decd48-ff40-4dbf-a6ff-95b20cc81a81 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:36.947108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b089d-9044-4a7e-9f30-01e4f3c3c55f None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:36.947320 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20decd48-ff40-4dbf-a6ff-95b20cc81a81 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:36.947545 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20decd48-ff40-4dbf-a6ff-95b20cc81a81 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:36.948321 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20decd48-ff40-4dbf-a6ff-95b20cc81a81 None admin] RBAC: Adding query filter params (name=network) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:36.948627 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20decd48-ff40-4dbf-a6ff-95b20cc81a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:36.949877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 395/777] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:36.949987 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20decd48-ff40-4dbf-a6ff-95b20cc81a81 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:36.954678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ea760-696b-4ddd-93f6-4131a0e693ef None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:36.954966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ea760-696b-4ddd-93f6-4131a0e693ef None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:36.955272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ea760-696b-4ddd-93f6-4131a0e693ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:36.955794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 383/778] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:35:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:36.964184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20decd48-ff40-4dbf-a6ff-95b20cc81a81 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:36.972305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-bb1ea760-696b-4ddd-93f6-4131a0e693ef None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:36.973480 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-bb1ea760-696b-4ddd-93f6-4131a0e693ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:37.050674 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 396/779] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:35:37.087918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ea760-696b-4ddd-93f6-4131a0e693ef None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:37.137353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20decd48-ff40-4dbf-a6ff-95b20cc81a81 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:37.206162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2e998-af07-4866-be6a-f79669521447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:37.206831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2e998-af07-4866-be6a-f79669521447 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:37.207114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2e998-af07-4866-be6a-f79669521447 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:37.207418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2e998-af07-4866-be6a-f79669521447 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:37.208192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2e998-af07-4866-be6a-f79669521447 None admin] RBAC: Adding query filter params (type=network) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:37.208500 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2e998-af07-4866-be6a-f79669521447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:37.210106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2e998-af07-4866-be6a-f79669521447 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:37.217802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 384/780] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:35:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:37.223442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2e998-af07-4866-be6a-f79669521447 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:37.229304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ea760-696b-4ddd-93f6-4131a0e693ef None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:37.309537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2713b8b-d45c-40ff-8416-26095ab7a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:37.310887 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2713b8b-d45c-40ff-8416-26095ab7a236 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:37.311173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2713b8b-d45c-40ff-8416-26095ab7a236 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:37.311472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2713b8b-d45c-40ff-8416-26095ab7a236 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:37.333616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2713b8b-d45c-40ff-8416-26095ab7a236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-c2713b8b-d45c-40ff-8416-26095ab7a236 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:37.343695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:37.344625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:37.345457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:37.345457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:37.345457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:37.345457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:37.345457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:37.345457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:37.345457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:37.345457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:37.345457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:37.345457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:37.345457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:37.345457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:37.350173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 397/781] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:37.351408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2713b8b-d45c-40ff-8416-26095ab7a236 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:37.361306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2e998-af07-4866-be6a-f79669521447 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:37.435082 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cdd12-e05a-4d52-9b0f-c6b83e0a427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:37.435940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cdd12-e05a-4d52-9b0f-c6b83e0a427f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:37.436142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cdd12-e05a-4d52-9b0f-c6b83e0a427f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:37.436421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cdd12-e05a-4d52-9b0f-c6b83e0a427f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:37.437287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cdd12-e05a-4d52-9b0f-c6b83e0a427f None admin] RBAC: Adding query filter params (interface=public, service_id=607a2cd998e947bc837d2566ce501181, region_id=RegionOne) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:37.437605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cdd12-e05a-4d52-9b0f-c6b83e0a427f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:37.438981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cdd12-e05a-4d52-9b0f-c6b83e0a427f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:37.454525 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 385/782] 10.222.0.73 () {56 vars in 1251 bytes} [Wed May 4 13:35:37 2022] GET /identity/v3/endpoints?service_id=607a2cd998e947bc837d2566ce501181&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:37.461464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cdd12-e05a-4d52-9b0f-c6b83e0a427f None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:37.542808 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2713b8b-d45c-40ff-8416-26095ab7a236 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:37.563112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cdd12-e05a-4d52-9b0f-c6b83e0a427f None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:37.602401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1afd-059b-40dd-bf2b-7e83b807b704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:37.603087 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1afd-059b-40dd-bf2b-7e83b807b704 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:37.603411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1afd-059b-40dd-bf2b-7e83b807b704 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:37.603697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd1afd-059b-40dd-bf2b-7e83b807b704 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:37.604398 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd1afd-059b-40dd-bf2b-7e83b807b704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:37.605830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd1afd-059b-40dd-bf2b-7e83b807b704 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:37.612170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 386/783] 10.222.0.73 () {56 vars in 1087 bytes} [Wed May 4 13:35:37 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:37.620745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75e3ad-0746-4e29-b687-babd8d653f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:37.621598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e3ad-0746-4e29-b687-babd8d653f0d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:37.621993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e3ad-0746-4e29-b687-babd8d653f0d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:37.622379 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e3ad-0746-4e29-b687-babd8d653f0d None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:37.623862 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75e3ad-0746-4e29-b687-babd8d653f0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:37.624273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75e3ad-0746-4e29-b687-babd8d653f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:37.625759 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75e3ad-0746-4e29-b687-babd8d653f0d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:37.639402 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 398/784] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:37.642746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1afd-059b-40dd-bf2b-7e83b807b704 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:37.906210 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd1afd-059b-40dd-bf2b-7e83b807b704 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:37.917086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15390d2f-4d27-48df-91be-a7ffe45dbdb2 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:37.917415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15390d2f-4d27-48df-91be-a7ffe45dbdb2 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:37.917658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15390d2f-4d27-48df-91be-a7ffe45dbdb2 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:37.921623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 399/785] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:37.925878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767f317-58c9-44df-a8c3-abebae5b41d2 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:37.926172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767f317-58c9-44df-a8c3-abebae5b41d2 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:37.926456 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767f317-58c9-44df-a8c3-abebae5b41d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:37.944731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-1767f317-58c9-44df-a8c3-abebae5b41d2 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:37.946185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1767f317-58c9-44df-a8c3-abebae5b41d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:37.946437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c29da-3357-4f8d-9722-9a987e2b837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:37.947481 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c29da-3357-4f8d-9722-9a987e2b837f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:37.948000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c29da-3357-4f8d-9722-9a987e2b837f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:37.948645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c29da-3357-4f8d-9722-9a987e2b837f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:37.961345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c29da-3357-4f8d-9722-9a987e2b837f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:37.963687 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c29da-3357-4f8d-9722-9a987e2b837f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-8b5c29da-3357-4f8d-9722-9a987e2b837f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:37.987486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:37.988439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:37.989334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:37.989334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:37.989334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:37.989334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:37.989334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 387/786] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:37.994560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c29da-3357-4f8d-9722-9a987e2b837f None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:38.038731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 400/787] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:35:38.064543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767f317-58c9-44df-a8c3-abebae5b41d2 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:38.168050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c29da-3357-4f8d-9722-9a987e2b837f None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:38.229913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767f317-58c9-44df-a8c3-abebae5b41d2 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:38.268499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3e12c-3bcf-455c-9541-9ca8d772dce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:38.269302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3e12c-3bcf-455c-9541-9ca8d772dce4 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:38.269583 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3e12c-3bcf-455c-9541-9ca8d772dce4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:38.269858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3e12c-3bcf-455c-9541-9ca8d772dce4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:38.270396 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73dc40-8894-4253-912a-97ef70014482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:38.271062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73dc40-8894-4253-912a-97ef70014482 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:38.271364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73dc40-8894-4253-912a-97ef70014482 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:38.271636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73dc40-8894-4253-912a-97ef70014482 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:38.272361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73dc40-8894-4253-912a-97ef70014482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:38.272665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73dc40-8894-4253-912a-97ef70014482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:38.274031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73dc40-8894-4253-912a-97ef70014482 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:38.293842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3e12c-3bcf-455c-9541-9ca8d772dce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-8fa3e12c-3bcf-455c-9541-9ca8d772dce4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:38.301960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:38.302900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:38.303865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:38.303865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:38.303865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:38.303865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:38.303865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:38.303865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:38.303865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:38.303865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:38.303865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:38.303865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:38.303865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:38.303865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:38.304507 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 388/789] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:38.308772 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 401/789] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:38.313665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73dc40-8894-4253-912a-97ef70014482 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:38.314946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3e12c-3bcf-455c-9541-9ca8d772dce4 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:38.479999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73dc40-8894-4253-912a-97ef70014482 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:38.516541 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e7980-53a3-4d6c-aa8c-4f4370dad5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:38.517341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e7980-53a3-4d6c-aa8c-4f4370dad5c7 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:38.518111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e7980-53a3-4d6c-aa8c-4f4370dad5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:38.518395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e7980-53a3-4d6c-aa8c-4f4370dad5c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:38.531701 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e7980-53a3-4d6c-aa8c-4f4370dad5c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:38.533138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e7980-53a3-4d6c-aa8c-4f4370dad5c7 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:38.538754 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3e12c-3bcf-455c-9541-9ca8d772dce4 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-e07e7980-53a3-4d6c-aa8c-4f4370dad5c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:38.548813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:38.549810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:38.550742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:38.550742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:38.550742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:38.550742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:38.550742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:38.550742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:38.550742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:38.550742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:38.550742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 13:35:38.550742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:38.555130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 389/790] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:38.556760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e7980-53a3-4d6c-aa8c-4f4370dad5c7 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:38.651955 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788427e-15a3-4d5b-9fd7-f53749b60894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:38.652647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788427e-15a3-4d5b-9fd7-f53749b60894 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:38.652928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788427e-15a3-4d5b-9fd7-f53749b60894 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:38.653205 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788427e-15a3-4d5b-9fd7-f53749b60894 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:38.654069 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788427e-15a3-4d5b-9fd7-f53749b60894 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:38.654376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788427e-15a3-4d5b-9fd7-f53749b60894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:38.655770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788427e-15a3-4d5b-9fd7-f53749b60894 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:38.668061 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e7980-53a3-4d6c-aa8c-4f4370dad5c7 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:38.673497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 402/791] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:38.688675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788427e-15a3-4d5b-9fd7-f53749b60894 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:38.709783 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4185f51-8c26-43d3-871f-ac312aa5eec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:38.710459 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4185f51-8c26-43d3-871f-ac312aa5eec0 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:38.710784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4185f51-8c26-43d3-871f-ac312aa5eec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:38.711081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4185f51-8c26-43d3-871f-ac312aa5eec0 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:38.712475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4185f51-8c26-43d3-871f-ac312aa5eec0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:38.712783 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4185f51-8c26-43d3-871f-ac312aa5eec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:38.714275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4185f51-8c26-43d3-871f-ac312aa5eec0 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:38.738096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 390/792] 10.222.0.73 () {56 vars in 1135 bytes} [Wed May 4 13:35:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:38.740238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4185f51-8c26-43d3-871f-ac312aa5eec0 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:38.854480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4185f51-8c26-43d3-871f-ac312aa5eec0 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:38.870353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788427e-15a3-4d5b-9fd7-f53749b60894 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:38.889509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc000773-3a18-4993-b900-75cff0f78825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:38.890294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc000773-3a18-4993-b900-75cff0f78825 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:38.890572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc000773-3a18-4993-b900-75cff0f78825 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:38.890840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc000773-3a18-4993-b900-75cff0f78825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:38.900766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc000773-3a18-4993-b900-75cff0f78825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:38.902201 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc000773-3a18-4993-b900-75cff0f78825 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:38.910810 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2eb90-6c99-4bdd-ab4e-a1cb02143b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:38.911936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2eb90-6c99-4bdd-ab4e-a1cb02143b9d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:38.912225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2eb90-6c99-4bdd-ab4e-a1cb02143b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:38.912491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2eb90-6c99-4bdd-ab4e-a1cb02143b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-bc000773-3a18-4993-b900-75cff0f78825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:38.920053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:38.922150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:38.924413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:38.924413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:38.924413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:38.924413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:38.924413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 391/793] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:38.924413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940eb11-7720-4c9c-8db3-2d82dc502d0a None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:38.924413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940eb11-7720-4c9c-8db3-2d82dc502d0a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:38.924413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940eb11-7720-4c9c-8db3-2d82dc502d0a None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:38.925481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2eb90-6c99-4bdd-ab4e-a1cb02143b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:38.925481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2eb90-6c99-4bdd-ab4e-a1cb02143b9d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:38.928559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 392/794] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:38.929914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787bf68-3707-4701-8f88-cef8be846d37 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:38.930381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787bf68-3707-4701-8f88-cef8be846d37 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:38.930835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787bf68-3707-4701-8f88-cef8be846d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:38.948152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b787bf68-3707-4701-8f88-cef8be846d37 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:38.949584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b787bf68-3707-4701-8f88-cef8be846d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-c6c2eb90-6c99-4bdd-ab4e-a1cb02143b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:38.952084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:38.952966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:38.953881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:38.953881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:38.953881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:38.953881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:38.953881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 403/795] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:38.955688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2eb90-6c99-4bdd-ab4e-a1cb02143b9d None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:39.022015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 393/796] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:39.022918 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787bf68-3707-4701-8f88-cef8be846d37 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:39.059315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2eb90-6c99-4bdd-ab4e-a1cb02143b9d None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:39.095664 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1188e-92e2-4f48-a418-7ea8c8ed21e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:39.096484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1188e-92e2-4f48-a418-7ea8c8ed21e8 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.096866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1188e-92e2-4f48-a418-7ea8c8ed21e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.097239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1188e-92e2-4f48-a418-7ea8c8ed21e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.098067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1188e-92e2-4f48-a418-7ea8c8ed21e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:39.098474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1188e-92e2-4f48-a418-7ea8c8ed21e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:39.099941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1188e-92e2-4f48-a418-7ea8c8ed21e8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:39.112788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 404/797] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:39.113519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1188e-92e2-4f48-a418-7ea8c8ed21e8 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:39.134372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787bf68-3707-4701-8f88-cef8be846d37 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:39.180937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69998d4-b7e4-479e-9de2-a8c2306465ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:39.181940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69998d4-b7e4-479e-9de2-a8c2306465ff None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.182410 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69998d4-b7e4-479e-9de2-a8c2306465ff None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.182851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69998d4-b7e4-479e-9de2-a8c2306465ff None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.183766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69998d4-b7e4-479e-9de2-a8c2306465ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:39.184369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69998d4-b7e4-479e-9de2-a8c2306465ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:39.186716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69998d4-b7e4-479e-9de2-a8c2306465ff None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:39.206067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 394/798] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:39.206067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69998d4-b7e4-479e-9de2-a8c2306465ff None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:39.229045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1188e-92e2-4f48-a418-7ea8c8ed21e8 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:39.273315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8e0d7-2f7a-4d00-833f-9f7aad3a96c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:39.274640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8e0d7-2f7a-4d00-833f-9f7aad3a96c5 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.275278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8e0d7-2f7a-4d00-833f-9f7aad3a96c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.276473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8e0d7-2f7a-4d00-833f-9f7aad3a96c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.289277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8e0d7-2f7a-4d00-833f-9f7aad3a96c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-9bf8e0d7-2f7a-4d00-833f-9f7aad3a96c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:39.300828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:39.301847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 405/799] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:39.302683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8e0d7-2f7a-4d00-833f-9f7aad3a96c5 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:39.312426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69998d4-b7e4-479e-9de2-a8c2306465ff None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:39.345081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85480a0-fc91-48d2-806f-363d9223e528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:39.345873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85480a0-fc91-48d2-806f-363d9223e528 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.346152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85480a0-fc91-48d2-806f-363d9223e528 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.346421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85480a0-fc91-48d2-806f-363d9223e528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.352925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85480a0-fc91-48d2-806f-363d9223e528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:39.354347 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85480a0-fc91-48d2-806f-363d9223e528 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-e85480a0-fc91-48d2-806f-363d9223e528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:39.368632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:39.369674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:39.370570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:39.370570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:39.370570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:39.370570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:39.370570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:39.370570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:39.370570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:39.370570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:39.370570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 395/800] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:39.371052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e8ed3-cffb-451c-8cb8-0e4f25f1fdcf None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.371246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e8ed3-cffb-451c-8cb8-0e4f25f1fdcf None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.371526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e8ed3-cffb-451c-8cb8-0e4f25f1fdcf None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.372945 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 396/801] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:39.373481 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e8ed3-cffb-451c-8cb8-0e4f25f1fdcf None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:39.412567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8e0d7-2f7a-4d00-833f-9f7aad3a96c5 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:39.445694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ebfd6-db7c-4d15-ba49-5607c4ccc02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:39.446738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ebfd6-db7c-4d15-ba49-5607c4ccc02c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.447248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ebfd6-db7c-4d15-ba49-5607c4ccc02c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.447695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ebfd6-db7c-4d15-ba49-5607c4ccc02c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.455280 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ebfd6-db7c-4d15-ba49-5607c4ccc02c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:39.456841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ebfd6-db7c-4d15-ba49-5607c4ccc02c None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-900ebfd6-db7c-4d15-ba49-5607c4ccc02c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:39.471143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:39.472264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:39.473390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:39.473390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:39.473390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:39.473390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:39.473390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:39.473390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:39.473390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:39.473390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:39.473390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:35:39.473390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:39.474719 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e8ed3-cffb-451c-8cb8-0e4f25f1fdcf None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:39.475541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 406/802] 10.222.0.73 () {56 vars in 1093 bytes} [Wed May 4 13:35:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:39.476444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ebfd6-db7c-4d15-ba49-5607c4ccc02c None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:39.512553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24126654-2316-45b4-8512-45f2f9b84818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:39.513767 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24126654-2316-45b4-8512-45f2f9b84818 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.514035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24126654-2316-45b4-8512-45f2f9b84818 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.514312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24126654-2316-45b4-8512-45f2f9b84818 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.515164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24126654-2316-45b4-8512-45f2f9b84818 None admin] RBAC: Adding query filter params (name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:39.515388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24126654-2316-45b4-8512-45f2f9b84818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:39.516752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24126654-2316-45b4-8512-45f2f9b84818 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:39.529936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 397/803] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:39.531122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af0d20-bd6d-4354-a5f7-4f0a2d27ed3d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.531449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af0d20-bd6d-4354-a5f7-4f0a2d27ed3d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.531729 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af0d20-bd6d-4354-a5f7-4f0a2d27ed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.552728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-58af0d20-bd6d-4354-a5f7-4f0a2d27ed3d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:39.554327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-58af0d20-bd6d-4354-a5f7-4f0a2d27ed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:39.583623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ebfd6-db7c-4d15-ba49-5607c4ccc02c None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:39.617047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36bba7-0dee-40a1-b356-40a8a5f2eac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:39.617705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36bba7-0dee-40a1-b356-40a8a5f2eac8 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.617986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36bba7-0dee-40a1-b356-40a8a5f2eac8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.618258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36bba7-0dee-40a1-b356-40a8a5f2eac8 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.619044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36bba7-0dee-40a1-b356-40a8a5f2eac8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:39.619386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36bba7-0dee-40a1-b356-40a8a5f2eac8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:39.631370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 398/804] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:39.631370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af0d20-bd6d-4354-a5f7-4f0a2d27ed3d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:39.631613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36bba7-0dee-40a1-b356-40a8a5f2eac8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:39.643070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 407/805] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:39.648127 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36bba7-0dee-40a1-b356-40a8a5f2eac8 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:39.728259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af0d20-bd6d-4354-a5f7-4f0a2d27ed3d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:39.746035 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36bba7-0dee-40a1-b356-40a8a5f2eac8 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:39.759804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0d8b5-1623-4846-8bb0-112410ffcf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:39.760475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0d8b5-1623-4846-8bb0-112410ffcf3a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.760743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0d8b5-1623-4846-8bb0-112410ffcf3a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.761011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0d8b5-1623-4846-8bb0-112410ffcf3a None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.761832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0d8b5-1623-4846-8bb0-112410ffcf3a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:39.762136 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0d8b5-1623-4846-8bb0-112410ffcf3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:39.764066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0d8b5-1623-4846-8bb0-112410ffcf3a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:39.780088 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594e2f9-9e55-4469-85c6-b132f36fb422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:39.780881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e2f9-9e55-4469-85c6-b132f36fb422 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.781098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e2f9-9e55-4469-85c6-b132f36fb422 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.781409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 399/806] 10.222.0.73 () {56 vars in 1133 bytes} [Wed May 4 13:35:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:39.782226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0d8b5-1623-4846-8bb0-112410ffcf3a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:39.785776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e2f9-9e55-4469-85c6-b132f36fb422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.795998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594e2f9-9e55-4469-85c6-b132f36fb422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:39.797426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594e2f9-9e55-4469-85c6-b132f36fb422 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-e594e2f9-9e55-4469-85c6-b132f36fb422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:39.814532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:39.815581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:39.816509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:39.816509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:39.816509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:39.816509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:39.816509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 408/807] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:39.816509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594e2f9-9e55-4469-85c6-b132f36fb422 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:39.881452 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0d8b5-1623-4846-8bb0-112410ffcf3a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:39.916684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbf0f3-04d7-4254-bf34-43ce5e683e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:39.917485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbf0f3-04d7-4254-bf34-43ce5e683e43 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.917594 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594e2f9-9e55-4469-85c6-b132f36fb422 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:39.917787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbf0f3-04d7-4254-bf34-43ce5e683e43 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.918026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbf0f3-04d7-4254-bf34-43ce5e683e43 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.918665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbf0f3-04d7-4254-bf34-43ce5e683e43 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:39.920081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbf0f3-04d7-4254-bf34-43ce5e683e43 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-15cbf0f3-04d7-4254-bf34-43ce5e683e43 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:39.931700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:39.932757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 13:35:39.933651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:39.938252 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 400/808] 10.222.0.73 () {56 vars in 1129 bytes} [Wed May 4 13:35:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:39.939081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbf0f3-04d7-4254-bf34-43ce5e683e43 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:39.955142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fdd46-0805-4b45-9815-394e28c4720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:39.956052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fdd46-0805-4b45-9815-394e28c4720e None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:39.956337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fdd46-0805-4b45-9815-394e28c4720e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:39.956610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fdd46-0805-4b45-9815-394e28c4720e None admin] PATH_INFO: `/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/773a01334f8a41d4bf94c5aa205d70ea/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:39.958575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fdd46-0805-4b45-9815-394e28c4720e None admin] RBAC: Authorizing `identity:create_grant(project_id=fbace3b0d2f54a408012ccc368865c82, user_id=773a01334f8a41d4bf94c5aa205d70ea, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:39.960011 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fdd46-0805-4b45-9815-394e28c4720e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:39.973557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 409/809] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:35:39 2022] PUT /identity/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/773a01334f8a41d4bf94c5aa205d70ea/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:35:39.974355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fdd46-0805-4b45-9815-394e28c4720e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:40.059658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbf0f3-04d7-4254-bf34-43ce5e683e43 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:40.083639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fdd46-0805-4b45-9815-394e28c4720e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:40.102253 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c63416-849d-42c3-923d-e89c247d3075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:40.103442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c63416-849d-42c3-923d-e89c247d3075 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:40.103940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c63416-849d-42c3-923d-e89c247d3075 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:40.104426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c63416-849d-42c3-923d-e89c247d3075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:40.124661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2b154-ed9d-44e4-807c-b88496d5791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:40.125351 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2b154-ed9d-44e4-807c-b88496d5791e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:40.125630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2b154-ed9d-44e4-807c-b88496d5791e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:40.125904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2b154-ed9d-44e4-807c-b88496d5791e None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:40.126750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2b154-ed9d-44e4-807c-b88496d5791e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:40.126998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2b154-ed9d-44e4-807c-b88496d5791e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:40.128388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2b154-ed9d-44e4-807c-b88496d5791e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:40.141607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 410/810] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:40.142487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2b154-ed9d-44e4-807c-b88496d5791e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:40.188516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c63416-849d-42c3-923d-e89c247d3075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:40.190309 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c63416-849d-42c3-923d-e89c247d3075 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:40.246480 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2b154-ed9d-44e4-807c-b88496d5791e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:40.281279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d7b6e-4e7f-40f3-8e27-de822a8bbc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:40.282301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d7b6e-4e7f-40f3-8e27-de822a8bbc15 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:40.282808 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d7b6e-4e7f-40f3-8e27-de822a8bbc15 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:40.283335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d7b6e-4e7f-40f3-8e27-de822a8bbc15 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:40.284250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d7b6e-4e7f-40f3-8e27-de822a8bbc15 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:40.284822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d7b6e-4e7f-40f3-8e27-de822a8bbc15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:40.286373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d7b6e-4e7f-40f3-8e27-de822a8bbc15 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:40.291568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 411/811] 10.222.0.73 () {56 vars in 1124 bytes} [Wed May 4 13:35:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:40.292670 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d7b6e-4e7f-40f3-8e27-de822a8bbc15 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:40.297565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 401/812] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:35:40.299689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c63416-849d-42c3-923d-e89c247d3075 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:40.400931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c63416-849d-42c3-923d-e89c247d3075 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:40.404180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d7b6e-4e7f-40f3-8e27-de822a8bbc15 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:40.434426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c7d70-a4e7-4375-9857-dbb7745e94e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:40.435744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7d70-a4e7-4375-9857-dbb7745e94e5 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:40.436025 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7d70-a4e7-4375-9857-dbb7745e94e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:40.436358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7d70-a4e7-4375-9857-dbb7745e94e5 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:40.437056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c7d70-a4e7-4375-9857-dbb7745e94e5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:40.437359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c7d70-a4e7-4375-9857-dbb7745e94e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:40.438762 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c7d70-a4e7-4375-9857-dbb7745e94e5 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:40.440940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53e854-724d-47a2-ac82-fa390dbcade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:40.441752 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53e854-724d-47a2-ac82-fa390dbcade1 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:40.442055 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53e854-724d-47a2-ac82-fa390dbcade1 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:40.442301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53e854-724d-47a2-ac82-fa390dbcade1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:40.449393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 402/813] 10.222.0.73 () {56 vars in 1124 bytes} [Wed May 4 13:35:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:40.449393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c723d6-545b-4a21-a1da-87b6887366c5 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:40.449393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c723d6-545b-4a21-a1da-87b6887366c5 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:40.449393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c723d6-545b-4a21-a1da-87b6887366c5 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:40.449393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 403/814] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:40.449393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c723d6-545b-4a21-a1da-87b6887366c5 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:40.457174 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53e854-724d-47a2-ac82-fa390dbcade1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:40.458593 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53e854-724d-47a2-ac82-fa390dbcade1 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-5d53e854-724d-47a2-ac82-fa390dbcade1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:40.473780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:40.474715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:40.476098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:40.476098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:40.476098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:40.476098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:40.476098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:40.476098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:40.476098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:40.476098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:40.476098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:35:40.476098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:40.476098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 412/815] 10.222.0.73 () {56 vars in 1117 bytes} [Wed May 4 13:35:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:40.476098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54e271-5030-444b-91b5-93fd548b4cd8 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:40.476773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54e271-5030-444b-91b5-93fd548b4cd8 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:40.476773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54e271-5030-444b-91b5-93fd548b4cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:40.493298 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-7f54e271-5030-444b-91b5-93fd548b4cd8 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:40.494489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7f54e271-5030-444b-91b5-93fd548b4cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:40.551570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c723d6-545b-4a21-a1da-87b6887366c5 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:40.563266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 413/816] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:40.563266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54e271-5030-444b-91b5-93fd548b4cd8 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:40.595579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5a128-b154-416e-a6d0-36b3f1aed6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:40.596293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5a128-b154-416e-a6d0-36b3f1aed6fc None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:40.596579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5a128-b154-416e-a6d0-36b3f1aed6fc None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:40.596850 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5a128-b154-416e-a6d0-36b3f1aed6fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:40.606386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5a128-b154-416e-a6d0-36b3f1aed6fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:40.608356 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5a128-b154-416e-a6d0-36b3f1aed6fc None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-c0c5a128-b154-416e-a6d0-36b3f1aed6fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:40.625915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:40.626814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:40.628433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:40.628433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:40.628433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:40.628433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:40.628433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 404/817] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:40.628433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5a128-b154-416e-a6d0-36b3f1aed6fc None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:40.672587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54e271-5030-444b-91b5-93fd548b4cd8 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:40.707525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f61069-830e-447a-a946-81b8cec83fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:40.708394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f61069-830e-447a-a946-81b8cec83fef None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:40.709423 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f61069-830e-447a-a946-81b8cec83fef None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:40.709906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f61069-830e-447a-a946-81b8cec83fef None admin] PATH_INFO: `/v3/endpoints` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:40.711315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f61069-830e-447a-a946-81b8cec83fef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:40.713151 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f61069-830e-447a-a946-81b8cec83fef None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:40.735641 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5a128-b154-416e-a6d0-36b3f1aed6fc None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:40.751565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 414/818] 10.222.0.73 () {60 vars in 1144 bytes} [Wed May 4 13:35:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:40.752486 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f61069-830e-447a-a946-81b8cec83fef None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:40.785991 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280584b-3f3e-43d3-b257-cc3787e16950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:40.787324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280584b-3f3e-43d3-b257-cc3787e16950 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:40.788214 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280584b-3f3e-43d3-b257-cc3787e16950 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:40.788982 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280584b-3f3e-43d3-b257-cc3787e16950 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:40.790293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280584b-3f3e-43d3-b257-cc3787e16950 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:40.791163 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280584b-3f3e-43d3-b257-cc3787e16950 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:40.793125 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280584b-3f3e-43d3-b257-cc3787e16950 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:40.818475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 405/819] 10.222.0.73 () {56 vars in 1149 bytes} [Wed May 4 13:35:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:40.820253 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280584b-3f3e-43d3-b257-cc3787e16950 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:40.875027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f61069-830e-447a-a946-81b8cec83fef None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:40.912858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b630e0-b9fd-4380-98b2-fdd6fd9009f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:40.914046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b630e0-b9fd-4380-98b2-fdd6fd9009f3 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:40.914534 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b630e0-b9fd-4380-98b2-fdd6fd9009f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:40.915035 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b630e0-b9fd-4380-98b2-fdd6fd9009f3 None admin] PATH_INFO: `/v3/services/network` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:40.915934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b630e0-b9fd-4380-98b2-fdd6fd9009f3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:40.917531 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b630e0-b9fd-4380-98b2-fdd6fd9009f3 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-06b630e0-b9fd-4380-98b2-fdd6fd9009f3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:40.931190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:40.932273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 13:35:40.933168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:40.936189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 415/820] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:40 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:40.937264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b630e0-b9fd-4380-98b2-fdd6fd9009f3 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:40.940409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280584b-3f3e-43d3-b257-cc3787e16950 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:40.976091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd07342-a701-4baf-a4db-9099a3f39e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:40.976480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd07342-a701-4baf-a4db-9099a3f39e2a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:40.976759 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd07342-a701-4baf-a4db-9099a3f39e2a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:40.977032 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd07342-a701-4baf-a4db-9099a3f39e2a None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:40.978992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd07342-a701-4baf-a4db-9099a3f39e2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:40.978992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd07342-a701-4baf-a4db-9099a3f39e2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:40.980383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd07342-a701-4baf-a4db-9099a3f39e2a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:40.993328 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 406/821] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:40.994099 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd07342-a701-4baf-a4db-9099a3f39e2a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:41.045272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b630e0-b9fd-4380-98b2-fdd6fd9009f3 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:41.079543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c40fbc-e6f3-49e5-bfb1-93410e737d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:41.080339 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c40fbc-e6f3-49e5-bfb1-93410e737d84 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:41.080635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c40fbc-e6f3-49e5-bfb1-93410e737d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:41.080984 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c40fbc-e6f3-49e5-bfb1-93410e737d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:41.092641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c40fbc-e6f3-49e5-bfb1-93410e737d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:41.094082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c40fbc-e6f3-49e5-bfb1-93410e737d84 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:41.104787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd07342-a701-4baf-a4db-9099a3f39e2a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-c9c40fbc-e6f3-49e5-bfb1-93410e737d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:41.111169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:41.112084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:41.112974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:41.112974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:41.112974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:41.112974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:41.112974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 416/822] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:41.113694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c40fbc-e6f3-49e5-bfb1-93410e737d84 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:41.155462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c97ca4-734c-4dea-9d73-5bddd60c3667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:41.156104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97ca4-734c-4dea-9d73-5bddd60c3667 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:41.156408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97ca4-734c-4dea-9d73-5bddd60c3667 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:41.156836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97ca4-734c-4dea-9d73-5bddd60c3667 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:41.157951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c97ca4-734c-4dea-9d73-5bddd60c3667 None admin] RBAC: Adding query filter params (name=network) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:41.158455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c97ca4-734c-4dea-9d73-5bddd60c3667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:41.160648 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c97ca4-734c-4dea-9d73-5bddd60c3667 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:41.174980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 407/823] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:35:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:41.176041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c97ca4-734c-4dea-9d73-5bddd60c3667 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:41.218762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c40fbc-e6f3-49e5-bfb1-93410e737d84 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:41.252371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523424e8-4cf9-4d54-a47d-e5fb866e8240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:41.253168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523424e8-4cf9-4d54-a47d-e5fb866e8240 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:41.253448 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523424e8-4cf9-4d54-a47d-e5fb866e8240 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:41.253722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523424e8-4cf9-4d54-a47d-e5fb866e8240 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:41.260622 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523424e8-4cf9-4d54-a47d-e5fb866e8240 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:41.262048 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523424e8-4cf9-4d54-a47d-e5fb866e8240 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-523424e8-4cf9-4d54-a47d-e5fb866e8240 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:41.276859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:41.279427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:41.281564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:41.281564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:41.281564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:41.281564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:41.281564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:41.281564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:41.281564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:41.281564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:41.281564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 417/824] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:41.287254 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523424e8-4cf9-4d54-a47d-e5fb866e8240 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:41.288509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c97ca4-734c-4dea-9d73-5bddd60c3667 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:41.332996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d32969-7c2c-4d55-96f7-54c9389f62c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:41.333653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d32969-7c2c-4d55-96f7-54c9389f62c9 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:41.333937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d32969-7c2c-4d55-96f7-54c9389f62c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:41.334213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d32969-7c2c-4d55-96f7-54c9389f62c9 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:41.335036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d32969-7c2c-4d55-96f7-54c9389f62c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:41.335303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d32969-7c2c-4d55-96f7-54c9389f62c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:41.336722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d32969-7c2c-4d55-96f7-54c9389f62c9 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:41.353531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 408/825] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:41.354393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d32969-7c2c-4d55-96f7-54c9389f62c9 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:41.392097 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523424e8-4cf9-4d54-a47d-e5fb866e8240 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:41.427667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff466148-5476-4909-be1c-63942655a9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:41.428556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff466148-5476-4909-be1c-63942655a9af None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:41.429010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff466148-5476-4909-be1c-63942655a9af None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:41.429430 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff466148-5476-4909-be1c-63942655a9af None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:41.430282 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff466148-5476-4909-be1c-63942655a9af None admin] RBAC: Adding query filter params (type=network) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:41.430732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff466148-5476-4909-be1c-63942655a9af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:41.432264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff466148-5476-4909-be1c-63942655a9af None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:41.438138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 418/826] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:35:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:41.439084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff466148-5476-4909-be1c-63942655a9af None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:41.459563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d32969-7c2c-4d55-96f7-54c9389f62c9 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:41.496310 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3907eb-9f11-4055-9ef7-ba0a53a71c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:41.497378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3907eb-9f11-4055-9ef7-ba0a53a71c87 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:41.498266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3907eb-9f11-4055-9ef7-ba0a53a71c87 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:41.498679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3907eb-9f11-4055-9ef7-ba0a53a71c87 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:41.500067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3907eb-9f11-4055-9ef7-ba0a53a71c87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:41.500539 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3907eb-9f11-4055-9ef7-ba0a53a71c87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:41.502766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3907eb-9f11-4055-9ef7-ba0a53a71c87 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:41.521583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 409/827] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:41.522376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3907eb-9f11-4055-9ef7-ba0a53a71c87 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:41.542128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff466148-5476-4909-be1c-63942655a9af None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:41.578235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51bc26-b02d-4899-a661-3e56d988f8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:41.579312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51bc26-b02d-4899-a661-3e56d988f8c2 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:41.579769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51bc26-b02d-4899-a661-3e56d988f8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:41.580189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51bc26-b02d-4899-a661-3e56d988f8c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:41.587402 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51bc26-b02d-4899-a661-3e56d988f8c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:41.589000 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51bc26-b02d-4899-a661-3e56d988f8c2 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-cc51bc26-b02d-4899-a661-3e56d988f8c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:41.603273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:41.604387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:41.605541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:41.605541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:41.605541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:41.605541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:41.605541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:41.605541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:41.605541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:41.605541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:41.607598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 419/828] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:41.608589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51bc26-b02d-4899-a661-3e56d988f8c2 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:41.634287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3907eb-9f11-4055-9ef7-ba0a53a71c87 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:41.668518 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243c36e-ed35-40b1-926e-82237de69403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:41.669177 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243c36e-ed35-40b1-926e-82237de69403 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:41.669494 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243c36e-ed35-40b1-926e-82237de69403 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:41.669769 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243c36e-ed35-40b1-926e-82237de69403 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:41.670512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243c36e-ed35-40b1-926e-82237de69403 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:41.671906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243c36e-ed35-40b1-926e-82237de69403 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:41.700265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 410/829] 10.222.0.73 () {60 vars in 1144 bytes} [Wed May 4 13:35:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:41.702077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243c36e-ed35-40b1-926e-82237de69403 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:41.716675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51bc26-b02d-4899-a661-3e56d988f8c2 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:41.762575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c543-116d-47c2-abf3-908cab7687a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:41.763588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c543-116d-47c2-abf3-908cab7687a4 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:41.764018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c543-116d-47c2-abf3-908cab7687a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:41.764433 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c543-116d-47c2-abf3-908cab7687a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:41.765449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178c543-116d-47c2-abf3-908cab7687a4 None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=10d07b370370461a90cab0b182938292) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:41.765908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178c543-116d-47c2-abf3-908cab7687a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:41.767533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178c543-116d-47c2-abf3-908cab7687a4 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:41.774552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 420/830] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:41 2022] GET /identity/v3/role_assignments?user.id=10d07b370370461a90cab0b182938292&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=70e67f35994843ae942d4f1703d5619e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:41.915899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243c36e-ed35-40b1-926e-82237de69403 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:41.961589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70179ef8-d15a-4098-be0f-1b35c557d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:41.962181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179ef8-d15a-4098-be0f-1b35c557d73c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:41.962467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179ef8-d15a-4098-be0f-1b35c557d73c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:41.962741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179ef8-d15a-4098-be0f-1b35c557d73c None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:41.963576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70179ef8-d15a-4098-be0f-1b35c557d73c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:41.963889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70179ef8-d15a-4098-be0f-1b35c557d73c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:41.965355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70179ef8-d15a-4098-be0f-1b35c557d73c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:41.979531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 411/831] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:41.985820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c543-116d-47c2-abf3-908cab7687a4 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:42.116097 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c543-116d-47c2-abf3-908cab7687a4 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:42.149471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befa6fe-1b93-4bc1-8938-7647f49dbd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:42.150353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befa6fe-1b93-4bc1-8938-7647f49dbd49 None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:42.150626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befa6fe-1b93-4bc1-8938-7647f49dbd49 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:42.150896 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befa6fe-1b93-4bc1-8938-7647f49dbd49 None admin] PATH_INFO: `/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/631d619317354b76bf1535550a207b0d/roles/bf0187c127ce4dcd9e2606d8dc4810ef` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:42.165434 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befa6fe-1b93-4bc1-8938-7647f49dbd49 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbace3b0d2f54a408012ccc368865c82, user_id=631d619317354b76bf1535550a207b0d, role_id=bf0187c127ce4dcd9e2606d8dc4810ef)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:42.166839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befa6fe-1b93-4bc1-8938-7647f49dbd49 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:42.182606 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 421/832] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:35:41 2022] PUT /identity/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/631d619317354b76bf1535550a207b0d/roles/bf0187c127ce4dcd9e2606d8dc4810ef => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:35:42.448147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392171e-bad3-41b2-9cc7-4ca2367c1348 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:42.448825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392171e-bad3-41b2-9cc7-4ca2367c1348 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:42.449364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392171e-bad3-41b2-9cc7-4ca2367c1348 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:42.451724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 412/833] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:42.457190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780c750-6719-4bb2-9c8d-d18370947ac9 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:42.457769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780c750-6719-4bb2-9c8d-d18370947ac9 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:42.458250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780c750-6719-4bb2-9c8d-d18370947ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:42.474974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-5780c750-6719-4bb2-9c8d-d18370947ac9 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:42.476483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5780c750-6719-4bb2-9c8d-d18370947ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:42.542109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 422/834] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:42.567268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392171e-bad3-41b2-9cc7-4ca2367c1348 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:42.672557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392171e-bad3-41b2-9cc7-4ca2367c1348 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:42.708001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db9e3-3282-40fb-a4a0-bce9e27e119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:42.709147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db9e3-3282-40fb-a4a0-bce9e27e119b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:42.709631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db9e3-3282-40fb-a4a0-bce9e27e119b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:42.710103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db9e3-3282-40fb-a4a0-bce9e27e119b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:42.720709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714db9e3-3282-40fb-a4a0-bce9e27e119b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-714db9e3-3282-40fb-a4a0-bce9e27e119b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:42.728659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:42.729589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:42.730444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:42.730444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:42.730444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:42.730444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:42.730444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:42.730444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:42.730444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:42.730444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:42.730444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:42.730444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:42.730444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:35:42.730444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:42.733670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 413/835] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:42.739663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780c750-6719-4bb2-9c8d-d18370947ac9 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:42.836883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780c750-6719-4bb2-9c8d-d18370947ac9 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:42.870798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3694e9d-b79d-4d96-8ae6-13ab1cbfb7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:42.871865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694e9d-b79d-4d96-8ae6-13ab1cbfb7ad None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:42.872350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694e9d-b79d-4d96-8ae6-13ab1cbfb7ad None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:42.873383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694e9d-b79d-4d96-8ae6-13ab1cbfb7ad None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:42.874327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3694e9d-b79d-4d96-8ae6-13ab1cbfb7ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:42.874851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3694e9d-b79d-4d96-8ae6-13ab1cbfb7ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:42.876432 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3694e9d-b79d-4d96-8ae6-13ab1cbfb7ad None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:42.885156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 423/836] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:42.891450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db9e3-3282-40fb-a4a0-bce9e27e119b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:43.007788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db9e3-3282-40fb-a4a0-bce9e27e119b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:43.042007 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84718e-e89f-41ea-83ce-89df7f234b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:43.043160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84718e-e89f-41ea-83ce-89df7f234b2c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:43.043685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84718e-e89f-41ea-83ce-89df7f234b2c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:43.044158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84718e-e89f-41ea-83ce-89df7f234b2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:43.055951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84718e-e89f-41ea-83ce-89df7f234b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:43.057673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84718e-e89f-41ea-83ce-89df7f234b2c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-9a84718e-e89f-41ea-83ce-89df7f234b2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:43.074944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:43.075968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:43.076902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:43.076902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:43.076902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:43.076902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:43.079105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 414/837] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:43.084999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3694e9d-b79d-4d96-8ae6-13ab1cbfb7ad None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:43.148788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c6297-a16f-4c9c-a6a2-b5d02662b2f6 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:43.149083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c6297-a16f-4c9c-a6a2-b5d02662b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:43.149277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c6297-a16f-4c9c-a6a2-b5d02662b2f6 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:43.150874 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 415/838] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:43.156126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d4916-6095-4b8a-9c2d-3d588ee34a5c None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:43.156410 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d4916-6095-4b8a-9c2d-3d588ee34a5c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:43.156685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d4916-6095-4b8a-9c2d-3d588ee34a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:43.173634 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f68d4916-6095-4b8a-9c2d-3d588ee34a5c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:43.174805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f68d4916-6095-4b8a-9c2d-3d588ee34a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:43.196936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3694e9d-b79d-4d96-8ae6-13ab1cbfb7ad None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:43.231635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923cf3e-eb2a-4811-a7fe-29f2bfda088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:43.232866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923cf3e-eb2a-4811-a7fe-29f2bfda088b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:43.233147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923cf3e-eb2a-4811-a7fe-29f2bfda088b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:43.233416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923cf3e-eb2a-4811-a7fe-29f2bfda088b None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:43.234193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923cf3e-eb2a-4811-a7fe-29f2bfda088b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:43.234496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923cf3e-eb2a-4811-a7fe-29f2bfda088b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:43.235922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923cf3e-eb2a-4811-a7fe-29f2bfda088b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:43.246279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 416/839] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:35:43.256101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 424/840] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:43.261492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d4916-6095-4b8a-9c2d-3d588ee34a5c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:43.278741 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923cf3e-eb2a-4811-a7fe-29f2bfda088b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:43.373912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d4916-6095-4b8a-9c2d-3d588ee34a5c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:43.394349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923cf3e-eb2a-4811-a7fe-29f2bfda088b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:43.408709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8003f91-b114-49b2-a4cf-2c138a4b7cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:43.409438 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8003f91-b114-49b2-a4cf-2c138a4b7cd2 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:43.409721 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8003f91-b114-49b2-a4cf-2c138a4b7cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:43.410000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8003f91-b114-49b2-a4cf-2c138a4b7cd2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:43.417083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8003f91-b114-49b2-a4cf-2c138a4b7cd2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:43.418524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8003f91-b114-49b2-a4cf-2c138a4b7cd2 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:43.428265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bb9b0-d5c8-4359-8f5d-84ff84a324cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:43.429055 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bb9b0-d5c8-4359-8f5d-84ff84a324cc None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:43.429334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bb9b0-d5c8-4359-8f5d-84ff84a324cc None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:43.429609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bb9b0-d5c8-4359-8f5d-84ff84a324cc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:43.430264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bb9b0-d5c8-4359-8f5d-84ff84a324cc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:43.431648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bb9b0-d5c8-4359-8f5d-84ff84a324cc None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-b8003f91-b114-49b2-a4cf-2c138a4b7cd2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:43.433366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:43.434299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:43.435303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:43.435303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:43.435303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:43.435303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:43.435303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:43.435303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:43.435303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:43.435303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:43.435303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 13:35:43.435303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:43.435303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 417/841] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:35:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:43.442900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8003f91-b114-49b2-a4cf-2c138a4b7cd2 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-a78bb9b0-d5c8-4359-8f5d-84ff84a324cc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:43.443910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:43.444898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:43.445997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 425/842] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:35:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:43.452023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bb9b0-d5c8-4359-8f5d-84ff84a324cc None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:43.547653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8003f91-b114-49b2-a4cf-2c138a4b7cd2 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:43.551301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bb9b0-d5c8-4359-8f5d-84ff84a324cc None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:43.582315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5e9e1-0b9f-40ef-8905-632e1c93d52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:43.583651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5e9e1-0b9f-40ef-8905-632e1c93d52d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:43.584258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5e9e1-0b9f-40ef-8905-632e1c93d52d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:43.584824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5e9e1-0b9f-40ef-8905-632e1c93d52d None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:43.585132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c207f6-1763-40c7-a767-b01ba3f438a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:43.585795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c207f6-1763-40c7-a767-b01ba3f438a7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:43.586077 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c207f6-1763-40c7-a767-b01ba3f438a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:43.586351 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c207f6-1763-40c7-a767-b01ba3f438a7 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:43.586815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5e9e1-0b9f-40ef-8905-632e1c93d52d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:43.587052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c207f6-1763-40c7-a767-b01ba3f438a7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:43.587399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c207f6-1763-40c7-a767-b01ba3f438a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:43.587773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5e9e1-0b9f-40ef-8905-632e1c93d52d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:43.588757 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c207f6-1763-40c7-a767-b01ba3f438a7 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:43.589607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5e9e1-0b9f-40ef-8905-632e1c93d52d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:43.594554 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 426/843] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:35:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:43.599978 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c207f6-1763-40c7-a767-b01ba3f438a7 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:43.613908 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 418/844] 10.222.0.73 () {56 vars in 1135 bytes} [Wed May 4 13:35:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:43.615412 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5e9e1-0b9f-40ef-8905-632e1c93d52d None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:43.715334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c207f6-1763-40c7-a767-b01ba3f438a7 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:43.724330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5e9e1-0b9f-40ef-8905-632e1c93d52d None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:43.749228 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624cd9-6fcd-42a0-bf20-17f94f0bf63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:43.749897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624cd9-6fcd-42a0-bf20-17f94f0bf63a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:43.750179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624cd9-6fcd-42a0-bf20-17f94f0bf63a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:43.750454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85624cd9-6fcd-42a0-bf20-17f94f0bf63a None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:43.751163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624cd9-6fcd-42a0-bf20-17f94f0bf63a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:43.751498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624cd9-6fcd-42a0-bf20-17f94f0bf63a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:43.752856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85624cd9-6fcd-42a0-bf20-17f94f0bf63a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:43.759070 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7312a6-ee72-415d-92fa-6a690720cf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:43.759753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7312a6-ee72-415d-92fa-6a690720cf89 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:43.760030 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7312a6-ee72-415d-92fa-6a690720cf89 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:43.760347 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7312a6-ee72-415d-92fa-6a690720cf89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:43.764088 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 427/845] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:35:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:43.836182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7312a6-ee72-415d-92fa-6a690720cf89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:43.837645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7312a6-ee72-415d-92fa-6a690720cf89 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:43.942857 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 419/846] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:43 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:35:43.949417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624cd9-6fcd-42a0-bf20-17f94f0bf63a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:44.051396 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85624cd9-6fcd-42a0-bf20-17f94f0bf63a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:44.085591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd983da-a57b-4f5e-aeeb-e20d8bcee5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:44.086385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd983da-a57b-4f5e-aeeb-e20d8bcee5ed None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:44.086666 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd983da-a57b-4f5e-aeeb-e20d8bcee5ed None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:44.086941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd983da-a57b-4f5e-aeeb-e20d8bcee5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:44.097609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd983da-a57b-4f5e-aeeb-e20d8bcee5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:44.099049 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd983da-a57b-4f5e-aeeb-e20d8bcee5ed None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-bdd983da-a57b-4f5e-aeeb-e20d8bcee5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:44.116850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:44.117801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:44.118690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:44.118690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:44.118690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:44.118690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:44.118690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 428/847] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:44.126311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7312a6-ee72-415d-92fa-6a690720cf89 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:44.227824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7312a6-ee72-415d-92fa-6a690720cf89 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:44.267238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a813d-96b5-4a0a-b526-fb4f7724549b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:44.267917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a813d-96b5-4a0a-b526-fb4f7724549b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:44.268194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a813d-96b5-4a0a-b526-fb4f7724549b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:44.268465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a813d-96b5-4a0a-b526-fb4f7724549b None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:44.269231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a813d-96b5-4a0a-b526-fb4f7724549b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:44.269542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a813d-96b5-4a0a-b526-fb4f7724549b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:44.270941 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a813d-96b5-4a0a-b526-fb4f7724549b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:44.282486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 420/848] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:44.288265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd983da-a57b-4f5e-aeeb-e20d8bcee5ed None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:44.398829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd983da-a57b-4f5e-aeeb-e20d8bcee5ed None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:44.408869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd408946-de3e-450e-b4a2-d21e01ebb834 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:44.409165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd408946-de3e-450e-b4a2-d21e01ebb834 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:44.409449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd408946-de3e-450e-b4a2-d21e01ebb834 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:44.411045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 421/849] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:44.415863 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123faed-ad55-4c88-9317-96a8de5bc9bf None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:44.416152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123faed-ad55-4c88-9317-96a8de5bc9bf None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:44.416428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123faed-ad55-4c88-9317-96a8de5bc9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:44.433874 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-7123faed-ad55-4c88-9317-96a8de5bc9bf None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:44.435082 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7123faed-ad55-4c88-9317-96a8de5bc9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:44.439093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c417635-3a58-4afd-a11b-2dd62fa64cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:44.440108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c417635-3a58-4afd-a11b-2dd62fa64cb8 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:44.440553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c417635-3a58-4afd-a11b-2dd62fa64cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:44.440967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c417635-3a58-4afd-a11b-2dd62fa64cb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:44.450472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c417635-3a58-4afd-a11b-2dd62fa64cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:44.452404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c417635-3a58-4afd-a11b-2dd62fa64cb8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-1c417635-3a58-4afd-a11b-2dd62fa64cb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:44.471983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:44.473089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:44.474148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:44.474148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:44.474148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:44.474148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:44.474148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:44.474148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:44.474148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:44.474148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:44.476635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 429/850] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:44.482581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c417635-3a58-4afd-a11b-2dd62fa64cb8 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:44.503685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 422/851] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:35:44.525474 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123faed-ad55-4c88-9317-96a8de5bc9bf None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:44.594287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c417635-3a58-4afd-a11b-2dd62fa64cb8 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:44.627706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b644fe-9b4e-40bd-a1a9-c2055112e9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:44.628363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b644fe-9b4e-40bd-a1a9-c2055112e9cd None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:44.628640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b644fe-9b4e-40bd-a1a9-c2055112e9cd None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:44.628910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b644fe-9b4e-40bd-a1a9-c2055112e9cd None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:44.629131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123faed-ad55-4c88-9317-96a8de5bc9bf None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:44.629688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b644fe-9b4e-40bd-a1a9-c2055112e9cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:44.629989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b644fe-9b4e-40bd-a1a9-c2055112e9cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:44.631444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b644fe-9b4e-40bd-a1a9-c2055112e9cd None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:44.643500 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 430/852] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:44.644824 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fb953-1506-4fd7-a1ec-4d675b8a7a88 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:44.645108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fb953-1506-4fd7-a1ec-4d675b8a7a88 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:44.645381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fb953-1506-4fd7-a1ec-4d675b8a7a88 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:44.647247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 431/853] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:44.649146 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fb953-1506-4fd7-a1ec-4d675b8a7a88 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:44.678273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c743b-14f5-4866-993f-2e80a365cbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:44.679302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c743b-14f5-4866-993f-2e80a365cbe1 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:44.679819 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c743b-14f5-4866-993f-2e80a365cbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:44.679928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c743b-14f5-4866-993f-2e80a365cbe1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:44.680503 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c743b-14f5-4866-993f-2e80a365cbe1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:44.681858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c743b-14f5-4866-993f-2e80a365cbe1 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-761c743b-14f5-4866-993f-2e80a365cbe1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:44.693830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:44.694995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:44.696274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 423/854] 10.222.0.73 () {56 vars in 1132 bytes} [Wed May 4 13:35:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:44.697108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d980a-7082-4d00-a6ed-ee3a76a7fa00 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:44.697108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d980a-7082-4d00-a6ed-ee3a76a7fa00 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:44.697381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d980a-7082-4d00-a6ed-ee3a76a7fa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:44.716906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-629d980a-7082-4d00-a6ed-ee3a76a7fa00 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:44.718071 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-629d980a-7082-4d00-a6ed-ee3a76a7fa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:44.757322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fb953-1506-4fd7-a1ec-4d675b8a7a88 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:44.784436 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 424/855] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:44.785282 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d980a-7082-4d00-a6ed-ee3a76a7fa00 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:44.800807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c67cb6-a86f-4fb7-a301-b4994f8841fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:44.801924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c67cb6-a86f-4fb7-a301-b4994f8841fe None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:44.802672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c67cb6-a86f-4fb7-a301-b4994f8841fe None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:44.803198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c67cb6-a86f-4fb7-a301-b4994f8841fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:44.804281 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c67cb6-a86f-4fb7-a301-b4994f8841fe None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=773a01334f8a41d4bf94c5aa205d70ea) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:44.804797 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c67cb6-a86f-4fb7-a301-b4994f8841fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:44.807175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c67cb6-a86f-4fb7-a301-b4994f8841fe None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:44.814289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 432/856] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:44 2022] GET /identity/v3/role_assignments?user.id=773a01334f8a41d4bf94c5aa205d70ea&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=70e67f35994843ae942d4f1703d5619e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:44.815153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c67cb6-a86f-4fb7-a301-b4994f8841fe None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:44.897579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d980a-7082-4d00-a6ed-ee3a76a7fa00 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:44.926609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c67cb6-a86f-4fb7-a301-b4994f8841fe None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:44.936349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2af14c-3fa1-499a-8fff-be4e9355741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:44.937612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2af14c-3fa1-499a-8fff-be4e9355741c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:44.938130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2af14c-3fa1-499a-8fff-be4e9355741c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:44.938608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2af14c-3fa1-499a-8fff-be4e9355741c None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:44.939585 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2af14c-3fa1-499a-8fff-be4e9355741c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:44.940104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2af14c-3fa1-499a-8fff-be4e9355741c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:44.941703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2af14c-3fa1-499a-8fff-be4e9355741c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:44.947652 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 425/857] 10.222.0.73 () {56 vars in 1126 bytes} [Wed May 4 13:35:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:44.953268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2af14c-3fa1-499a-8fff-be4e9355741c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:44.972481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01a848-5f18-4122-b0ae-b582fdee3e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:44.974369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01a848-5f18-4122-b0ae-b582fdee3e16 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:44.975399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01a848-5f18-4122-b0ae-b582fdee3e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:44.976049 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01a848-5f18-4122-b0ae-b582fdee3e16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:44.999506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01a848-5f18-4122-b0ae-b582fdee3e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-be01a848-5f18-4122-b0ae-b582fdee3e16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:45.010323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:45.011598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:45.012647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:45.012647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:45.012647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:45.012647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:45.012647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:45.012647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:45.012647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:45.012647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:45.012647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:45.012647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:45.012647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:35:45.012647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:45.016166 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 433/858] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:35:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:45.022854 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01a848-5f18-4122-b0ae-b582fdee3e16 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:45.080733 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2af14c-3fa1-499a-8fff-be4e9355741c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:45.123289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732992c7-2bb9-4804-8ae6-224f1c1cc380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:45.124015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732992c7-2bb9-4804-8ae6-224f1c1cc380 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:45.124296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732992c7-2bb9-4804-8ae6-224f1c1cc380 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:45.124711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732992c7-2bb9-4804-8ae6-224f1c1cc380 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:45.125556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732992c7-2bb9-4804-8ae6-224f1c1cc380 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:45.125860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732992c7-2bb9-4804-8ae6-224f1c1cc380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:45.127420 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732992c7-2bb9-4804-8ae6-224f1c1cc380 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:45.133203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 426/859] 10.222.0.73 () {56 vars in 1126 bytes} [Wed May 4 13:35:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:45.149047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01a848-5f18-4122-b0ae-b582fdee3e16 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:45.187857 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf8f92-facd-4ea7-8fcc-4d563271162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:45.188861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf8f92-facd-4ea7-8fcc-4d563271162d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:45.189331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf8f92-facd-4ea7-8fcc-4d563271162d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:45.189821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf8f92-facd-4ea7-8fcc-4d563271162d None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:45.190780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf8f92-facd-4ea7-8fcc-4d563271162d None admin] RBAC: Adding query filter params (name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:45.191312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf8f92-facd-4ea7-8fcc-4d563271162d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:45.192984 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf8f92-facd-4ea7-8fcc-4d563271162d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:45.208363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 434/860] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:35:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:45.210057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732992c7-2bb9-4804-8ae6-224f1c1cc380 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:45.326692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732992c7-2bb9-4804-8ae6-224f1c1cc380 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:45.361590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dcb2e-fe3c-46a7-a069-a4d74aa11114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:45.362374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dcb2e-fe3c-46a7-a069-a4d74aa11114 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:45.362650 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dcb2e-fe3c-46a7-a069-a4d74aa11114 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:45.362922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dcb2e-fe3c-46a7-a069-a4d74aa11114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:45.373265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502dcb2e-fe3c-46a7-a069-a4d74aa11114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:45.374681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502dcb2e-fe3c-46a7-a069-a4d74aa11114 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-502dcb2e-fe3c-46a7-a069-a4d74aa11114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:45.392290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:45.393231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:45.394296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:45.394296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:45.394296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:45.394296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:45.394296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 427/861] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:45.400532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf8f92-facd-4ea7-8fcc-4d563271162d None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:45.509843 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf8f92-facd-4ea7-8fcc-4d563271162d None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:45.545314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2923288-4c3b-43b5-a699-c0a04ae112e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:45.546456 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2923288-4c3b-43b5-a699-c0a04ae112e2 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:45.546957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2923288-4c3b-43b5-a699-c0a04ae112e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:45.547457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2923288-4c3b-43b5-a699-c0a04ae112e2 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:45.548387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2923288-4c3b-43b5-a699-c0a04ae112e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:45.548897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2923288-4c3b-43b5-a699-c0a04ae112e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:45.550575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2923288-4c3b-43b5-a699-c0a04ae112e2 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:45.567328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 435/862] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:45.569754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dcb2e-fe3c-46a7-a069-a4d74aa11114 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:45.671583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dcb2e-fe3c-46a7-a069-a4d74aa11114 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:45.707038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d5235-0691-4ac9-8de4-504b49bafb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:45.708303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d5235-0691-4ac9-8de4-504b49bafb69 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:45.708798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d5235-0691-4ac9-8de4-504b49bafb69 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:45.709276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d5235-0691-4ac9-8de4-504b49bafb69 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:45.717518 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d5235-0691-4ac9-8de4-504b49bafb69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:45.719269 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d5235-0691-4ac9-8de4-504b49bafb69 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-ee1d5235-0691-4ac9-8de4-504b49bafb69 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:45.734629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:45.735611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:45.736588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:45.736588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:45.736588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:45.736588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:45.736588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:45.736588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:45.736588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:45.736588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:45.736588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:35:45.736588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:45.742966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 428/863] 10.222.0.73 () {56 vars in 1117 bytes} [Wed May 4 13:35:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:45.745060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2923288-4c3b-43b5-a699-c0a04ae112e2 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:45.847582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2923288-4c3b-43b5-a699-c0a04ae112e2 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:45.883814 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a043c-0e32-457e-b048-32ca24993dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:45.884927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a043c-0e32-457e-b048-32ca24993dfa None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:45.885424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a043c-0e32-457e-b048-32ca24993dfa None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:45.885909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a043c-0e32-457e-b048-32ca24993dfa None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:45.887035 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a043c-0e32-457e-b048-32ca24993dfa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:45.887604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a043c-0e32-457e-b048-32ca24993dfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:45.889997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a043c-0e32-457e-b048-32ca24993dfa None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:45.915326 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 436/864] 10.222.0.73 () {56 vars in 1149 bytes} [Wed May 4 13:35:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:45.917082 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d5235-0691-4ac9-8de4-504b49bafb69 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:46.028495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d5235-0691-4ac9-8de4-504b49bafb69 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:46.064228 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72d269-3614-448c-bdab-f8bb9c20c874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:46.065294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72d269-3614-448c-bdab-f8bb9c20c874 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:46.065784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72d269-3614-448c-bdab-f8bb9c20c874 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:46.066266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72d269-3614-448c-bdab-f8bb9c20c874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:46.074808 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469107-89b9-41b3-b049-5c8123102372 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:46.075098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469107-89b9-41b3-b049-5c8123102372 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:46.076325 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469107-89b9-41b3-b049-5c8123102372 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:46.077899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 437/865] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:46.083067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0575-cd28-4e1a-8f76-e40ead900668 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:46.083404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0575-cd28-4e1a-8f76-e40ead900668 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:46.084044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0575-cd28-4e1a-8f76-e40ead900668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:46.101956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-810f0575-cd28-4e1a-8f76-e40ead900668 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:46.103101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-810f0575-cd28-4e1a-8f76-e40ead900668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:46.149929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72d269-3614-448c-bdab-f8bb9c20c874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:46.152224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72d269-3614-448c-bdab-f8bb9c20c874 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:46.175539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 438/866] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:46.191726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f0575-cd28-4e1a-8f76-e40ead900668 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:46.264782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 429/867] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:35:46.266405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72d269-3614-448c-bdab-f8bb9c20c874 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:46.312518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f0575-cd28-4e1a-8f76-e40ead900668 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:46.349597 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e79d3-f2ae-4d62-980b-413e833c749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:46.350096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e79d3-f2ae-4d62-980b-413e833c749d None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:46.350376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e79d3-f2ae-4d62-980b-413e833c749d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:46.350649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e79d3-f2ae-4d62-980b-413e833c749d None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:46.351413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e79d3-f2ae-4d62-980b-413e833c749d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:46.352764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e79d3-f2ae-4d62-980b-413e833c749d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:46.369485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 439/868] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:35:46 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:46.394821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72d269-3614-448c-bdab-f8bb9c20c874 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:46.439529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05465fd9-225f-4d7e-ba5b-dfcc1869a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:46.440717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05465fd9-225f-4d7e-ba5b-dfcc1869a455 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:46.441200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05465fd9-225f-4d7e-ba5b-dfcc1869a455 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:46.441672 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05465fd9-225f-4d7e-ba5b-dfcc1869a455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:46.454206 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05465fd9-225f-4d7e-ba5b-dfcc1869a455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:46.456047 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05465fd9-225f-4d7e-ba5b-dfcc1869a455 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-05465fd9-225f-4d7e-ba5b-dfcc1869a455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:46.475776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:46.476746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:46.477685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:46.477685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:46.477685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:46.477685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:46.480077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 430/869] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:46.488403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e79d3-f2ae-4d62-980b-413e833c749d None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:46.598891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e79d3-f2ae-4d62-980b-413e833c749d None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:46.632703 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c94ef8-0d89-4dfc-8033-611ae0cd7e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:46.633373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c94ef8-0d89-4dfc-8033-611ae0cd7e71 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:46.633657 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c94ef8-0d89-4dfc-8033-611ae0cd7e71 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:46.633926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c94ef8-0d89-4dfc-8033-611ae0cd7e71 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:46.634647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c94ef8-0d89-4dfc-8033-611ae0cd7e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:46.634950 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c94ef8-0d89-4dfc-8033-611ae0cd7e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:46.636329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c94ef8-0d89-4dfc-8033-611ae0cd7e71 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:46.649198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 440/870] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:46.654597 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05465fd9-225f-4d7e-ba5b-dfcc1869a455 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:46.753746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05465fd9-225f-4d7e-ba5b-dfcc1869a455 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:46.787001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd3e19-85c5-44f1-9689-7bf1d6ef7375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:46.787864 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd3e19-85c5-44f1-9689-7bf1d6ef7375 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:46.788151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd3e19-85c5-44f1-9689-7bf1d6ef7375 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:46.788423 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd3e19-85c5-44f1-9689-7bf1d6ef7375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:46.795307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd3e19-85c5-44f1-9689-7bf1d6ef7375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:46.796746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd3e19-85c5-44f1-9689-7bf1d6ef7375 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-efcd3e19-85c5-44f1-9689-7bf1d6ef7375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:46.810853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:46.811823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:46.812707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:46.812707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:46.812707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:46.812707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:46.812707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:46.812707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:46.812707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:46.812707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:46.812707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 431/871] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:46.818252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c94ef8-0d89-4dfc-8033-611ae0cd7e71 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:46.919819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c94ef8-0d89-4dfc-8033-611ae0cd7e71 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:46.954443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b77db-8b55-408d-82e5-7f4fca8406d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:46.955113 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b77db-8b55-408d-82e5-7f4fca8406d6 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:46.955433 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b77db-8b55-408d-82e5-7f4fca8406d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:46.955713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b77db-8b55-408d-82e5-7f4fca8406d6 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:46.956507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b77db-8b55-408d-82e5-7f4fca8406d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:46.956884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b77db-8b55-408d-82e5-7f4fca8406d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:46.958312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b77db-8b55-408d-82e5-7f4fca8406d6 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:46.974954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 441/872] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:46.976325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd3e19-85c5-44f1-9689-7bf1d6ef7375 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:47.078866 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd3e19-85c5-44f1-9689-7bf1d6ef7375 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:47.116324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b58b4f-53ee-464d-85e6-11565d1b80f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:47.116973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b58b4f-53ee-464d-85e6-11565d1b80f2 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:47.117249 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b58b4f-53ee-464d-85e6-11565d1b80f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:47.117521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b58b4f-53ee-464d-85e6-11565d1b80f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:47.118341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b58b4f-53ee-464d-85e6-11565d1b80f2 None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=631d619317354b76bf1535550a207b0d) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:47.118647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b58b4f-53ee-464d-85e6-11565d1b80f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:47.120091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b58b4f-53ee-464d-85e6-11565d1b80f2 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:47.126846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 432/873] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:46 2022] GET /identity/v3/role_assignments?user.id=631d619317354b76bf1535550a207b0d&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:47.181981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1e089-601c-495f-8ff7-01dccc49fa5d None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:47.182626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1e089-601c-495f-8ff7-01dccc49fa5d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:47.183109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1e089-601c-495f-8ff7-01dccc49fa5d None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:47.185675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 442/874] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:47.191911 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd347b8-3c28-46ee-a08f-f9e1559df707 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:47.192545 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd347b8-3c28-46ee-a08f-f9e1559df707 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:47.193028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd347b8-3c28-46ee-a08f-f9e1559df707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:47.211312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6fd347b8-3c28-46ee-a08f-f9e1559df707 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:47.212879 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6fd347b8-3c28-46ee-a08f-f9e1559df707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:47.300830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 433/875] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:47.335082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1e089-601c-495f-8ff7-01dccc49fa5d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:47.477782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1e089-601c-495f-8ff7-01dccc49fa5d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:47.512326 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cb9b5-455d-4b9b-89b8-371e553e13ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:47.513255 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cb9b5-455d-4b9b-89b8-371e553e13ae None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:47.514062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cb9b5-455d-4b9b-89b8-371e553e13ae None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:47.514062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cb9b5-455d-4b9b-89b8-371e553e13ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:47.514360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cb9b5-455d-4b9b-89b8-371e553e13ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:47.515759 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cb9b5-455d-4b9b-89b8-371e553e13ae None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-341cb9b5-455d-4b9b-89b8-371e553e13ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:47.528206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:47.529816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:47.530873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 443/876] 10.222.0.73 () {56 vars in 1126 bytes} [Wed May 4 13:35:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:47.536213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd347b8-3c28-46ee-a08f-f9e1559df707 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:47.578694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bc376-a491-4442-bcab-32698c778925 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:47.578981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bc376-a491-4442-bcab-32698c778925 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:47.579289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bc376-a491-4442-bcab-32698c778925 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:47.580904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 444/877] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:47.585883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb9b53-d3c4-457b-9080-3b9ba6f54048 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:47.586180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb9b53-d3c4-457b-9080-3b9ba6f54048 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:47.586460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb9b53-d3c4-457b-9080-3b9ba6f54048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:47.620746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-81bb9b53-d3c4-457b-9080-3b9ba6f54048 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:47.621952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-81bb9b53-d3c4-457b-9080-3b9ba6f54048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:47.714683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 445/878] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:35:47.738332 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb9b53-d3c4-457b-9080-3b9ba6f54048 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:47.740069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd347b8-3c28-46ee-a08f-f9e1559df707 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:47.783450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a1ba1-4b2a-43c3-8832-16b78636fa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:47.784720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a1ba1-4b2a-43c3-8832-16b78636fa06 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:47.785400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a1ba1-4b2a-43c3-8832-16b78636fa06 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:47.785848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a1ba1-4b2a-43c3-8832-16b78636fa06 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:47.786862 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a1ba1-4b2a-43c3-8832-16b78636fa06 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:47.787660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a1ba1-4b2a-43c3-8832-16b78636fa06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:47.789179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a1ba1-4b2a-43c3-8832-16b78636fa06 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:47.796016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 434/879] 10.222.0.73 () {56 vars in 1122 bytes} [Wed May 4 13:35:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:47.801358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a1ba1-4b2a-43c3-8832-16b78636fa06 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:47.851761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb9b53-d3c4-457b-9080-3b9ba6f54048 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:47.886797 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cf013-67d3-40f1-8258-4f9e9277cc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:47.887495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cf013-67d3-40f1-8258-4f9e9277cc63 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:47.887846 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cf013-67d3-40f1-8258-4f9e9277cc63 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:47.888662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cf013-67d3-40f1-8258-4f9e9277cc63 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:47.889688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cf013-67d3-40f1-8258-4f9e9277cc63 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:47.890730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cf013-67d3-40f1-8258-4f9e9277cc63 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:47.911371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 446/880] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:35:47 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:35:47.926842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a1ba1-4b2a-43c3-8832-16b78636fa06 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:47.971409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc19b7-3dbf-4250-ad7b-8ffa21e02183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:47.972514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc19b7-3dbf-4250-ad7b-8ffa21e02183 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:47.973020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc19b7-3dbf-4250-ad7b-8ffa21e02183 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:47.973538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc19b7-3dbf-4250-ad7b-8ffa21e02183 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:47.974537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc19b7-3dbf-4250-ad7b-8ffa21e02183 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:47.975055 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc19b7-3dbf-4250-ad7b-8ffa21e02183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:47.976726 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc19b7-3dbf-4250-ad7b-8ffa21e02183 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:47.983369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 435/881] 10.222.0.73 () {56 vars in 1122 bytes} [Wed May 4 13:35:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:48.773904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e51d-cabb-47bd-9369-57268ce287e5 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:48.774459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e51d-cabb-47bd-9369-57268ce287e5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:48.774459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0e51d-cabb-47bd-9369-57268ce287e5 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:48.775956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 447/882] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:48.781917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd53aa-ff0c-4e01-b29a-beba25dab98a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:48.782476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd53aa-ff0c-4e01-b29a-beba25dab98a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:48.782967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd53aa-ff0c-4e01-b29a-beba25dab98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:48.799790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-3cdd53aa-ff0c-4e01-b29a-beba25dab98a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:48.801315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3cdd53aa-ff0c-4e01-b29a-beba25dab98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:48.867137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 436/883] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:48.892672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0e51d-cabb-47bd-9369-57268ce287e5 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:48.994187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0e51d-cabb-47bd-9369-57268ce287e5 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:49.029295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b3960-9d88-459d-92ce-faf48489a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:49.030485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b3960-9d88-459d-92ce-faf48489a7ec None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:49.030976 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b3960-9d88-459d-92ce-faf48489a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:49.031484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b3960-9d88-459d-92ce-faf48489a7ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:49.032337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b3960-9d88-459d-92ce-faf48489a7ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:49.033885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b3960-9d88-459d-92ce-faf48489a7ec None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-493b3960-9d88-459d-92ce-faf48489a7ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:49.046416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:49.047471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:35:49.048327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:49.051197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 448/884] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:35:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:49.057586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd53aa-ff0c-4e01-b29a-beba25dab98a None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:49.159245 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd53aa-ff0c-4e01-b29a-beba25dab98a None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:49.199137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa20c4-460f-4d1a-8b86-442fef7718cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:49.199839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa20c4-460f-4d1a-8b86-442fef7718cb None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:49.200119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa20c4-460f-4d1a-8b86-442fef7718cb None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:49.200394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa20c4-460f-4d1a-8b86-442fef7718cb None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:49.201651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa20c4-460f-4d1a-8b86-442fef7718cb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:49.201957 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa20c4-460f-4d1a-8b86-442fef7718cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:49.203339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa20c4-460f-4d1a-8b86-442fef7718cb None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:49.208372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 437/885] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:35:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:49.213859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b3960-9d88-459d-92ce-faf48489a7ec None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:49.314905 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b3960-9d88-459d-92ce-faf48489a7ec None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:49.348393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78b78b-1f48-458a-bf59-d40b9f66c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:49.349056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78b78b-1f48-458a-bf59-d40b9f66c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:49.349335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78b78b-1f48-458a-bf59-d40b9f66c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:49.349609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78b78b-1f48-458a-bf59-d40b9f66c3a6 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:49.350312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78b78b-1f48-458a-bf59-d40b9f66c3a6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:49.350617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78b78b-1f48-458a-bf59-d40b9f66c3a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:49.351985 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78b78b-1f48-458a-bf59-d40b9f66c3a6 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:49.357590 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 449/886] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:35:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:49.364287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa20c4-460f-4d1a-8b86-442fef7718cb None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:49.464533 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa20c4-460f-4d1a-8b86-442fef7718cb None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:49.502725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60301f-210e-49e6-b1fb-f30ca14103a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:49.503456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60301f-210e-49e6-b1fb-f30ca14103a3 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:49.503736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60301f-210e-49e6-b1fb-f30ca14103a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:49.504007 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60301f-210e-49e6-b1fb-f30ca14103a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:49.504820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60301f-210e-49e6-b1fb-f30ca14103a3 None admin] RBAC: Adding query filter params (interface=public, service_id=844da190b995423ca69d652bbd1eea39, region_id=RegionOne) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:49.505131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60301f-210e-49e6-b1fb-f30ca14103a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:49.506540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60301f-210e-49e6-b1fb-f30ca14103a3 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:49.512702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 438/887] 10.222.0.73 () {56 vars in 1251 bytes} [Wed May 4 13:35:49 2022] GET /identity/v3/endpoints?service_id=844da190b995423ca69d652bbd1eea39&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:49.518425 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78b78b-1f48-458a-bf59-d40b9f66c3a6 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:49.624295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78b78b-1f48-458a-bf59-d40b9f66c3a6 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:49.658647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f916e-0cc3-47b6-b74b-5185a7ee9a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:49.659344 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f916e-0cc3-47b6-b74b-5185a7ee9a26 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:49.659619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f916e-0cc3-47b6-b74b-5185a7ee9a26 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:49.659892 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f916e-0cc3-47b6-b74b-5185a7ee9a26 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:49.660569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f916e-0cc3-47b6-b74b-5185a7ee9a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:49.661907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f916e-0cc3-47b6-b74b-5185a7ee9a26 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:49.668070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 450/888] 10.222.0.73 () {56 vars in 1087 bytes} [Wed May 4 13:35:49 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:35:49.681054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616557f-fcba-4955-b070-a0123afd3f81 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:49.681411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616557f-fcba-4955-b070-a0123afd3f81 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:49.681614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616557f-fcba-4955-b070-a0123afd3f81 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:49.684450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 439/889] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:49.689353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517f23-b3eb-4ce4-92a1-f27bf08842b5 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:49.689653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517f23-b3eb-4ce4-92a1-f27bf08842b5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:49.689927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517f23-b3eb-4ce4-92a1-f27bf08842b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:49.708887 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-93517f23-b3eb-4ce4-92a1-f27bf08842b5 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:49.710108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-93517f23-b3eb-4ce4-92a1-f27bf08842b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:49.787428 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 451/890] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:49.811429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616557f-fcba-4955-b070-a0123afd3f81 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:49.921190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616557f-fcba-4955-b070-a0123afd3f81 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:49.955523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800774a0-1ac0-4f0f-8b51-d7a6824b0c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:49.956712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800774a0-1ac0-4f0f-8b51-d7a6824b0c77 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:49.957224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800774a0-1ac0-4f0f-8b51-d7a6824b0c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:49.957700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800774a0-1ac0-4f0f-8b51-d7a6824b0c77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:49.968786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800774a0-1ac0-4f0f-8b51-d7a6824b0c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-800774a0-1ac0-4f0f-8b51-d7a6824b0c77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:49.977372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:49.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:49.979158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:49.979158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:49.979158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:49.979158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:49.979158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:49.979158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:49.979158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:49.979158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:49.979158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:49.979158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:49.979158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:35:49.979158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:49.982479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 440/891] 10.222.0.73 () {56 vars in 1120 bytes} [Wed May 4 13:35:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:49.988339 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93517f23-b3eb-4ce4-92a1-f27bf08842b5 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:50.094033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93517f23-b3eb-4ce4-92a1-f27bf08842b5 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:50.131125 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb1bb4-77d4-4188-8076-f395c5ae9968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:50.131868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb1bb4-77d4-4188-8076-f395c5ae9968 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:50.132149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb1bb4-77d4-4188-8076-f395c5ae9968 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:50.132424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb1bb4-77d4-4188-8076-f395c5ae9968 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:50.133196 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb1bb4-77d4-4188-8076-f395c5ae9968 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:50.133501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb1bb4-77d4-4188-8076-f395c5ae9968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:50.134899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb1bb4-77d4-4188-8076-f395c5ae9968 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:50.144937 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 452/892] 10.222.0.73 () {56 vars in 1115 bytes} [Wed May 4 13:35:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:50.150354 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800774a0-1ac0-4f0f-8b51-d7a6824b0c77 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:50.258800 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800774a0-1ac0-4f0f-8b51-d7a6824b0c77 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:50.292885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033382e1-ad6e-439a-8948-89568aabf00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:50.293682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033382e1-ad6e-439a-8948-89568aabf00e None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:50.293964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033382e1-ad6e-439a-8948-89568aabf00e None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:50.299632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033382e1-ad6e-439a-8948-89568aabf00e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:50.313073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276538-e407-4d14-9055-af85830ce15f None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:50.313352 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276538-e407-4d14-9055-af85830ce15f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:50.313628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276538-e407-4d14-9055-af85830ce15f None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:50.315560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 453/893] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:50.316067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033382e1-ad6e-439a-8948-89568aabf00e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:50.317639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033382e1-ad6e-439a-8948-89568aabf00e None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:50.321410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a458d8-2547-4206-b986-411724789241 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:50.321699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a458d8-2547-4206-b986-411724789241 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:50.321980 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a458d8-2547-4206-b986-411724789241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-033382e1-ad6e-439a-8948-89568aabf00e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:50.336272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:50.338349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:50.340550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:50.340550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:50.340550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:50.340550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:50.341115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a3a458d8-2547-4206-b986-411724789241 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:50.347252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a3a458d8-2547-4206-b986-411724789241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:50.347476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 441/894] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:50.347476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033382e1-ad6e-439a-8948-89568aabf00e None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:50.414333 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 454/895] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:35:50.415860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aaa59-f972-45cb-bbe7-ebd2dbd8afb2 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:50.416150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aaa59-f972-45cb-bbe7-ebd2dbd8afb2 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:50.416423 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aaa59-f972-45cb-bbe7-ebd2dbd8afb2 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:50.417950 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 455/896] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:50.422778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1df49-192b-49ca-b45c-9af912be9fe9 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:50.423056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1df49-192b-49ca-b45c-9af912be9fe9 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:50.423359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1df49-192b-49ca-b45c-9af912be9fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:50.449161 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-4ea1df49-192b-49ca-b45c-9af912be9fe9 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:50.451483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4ea1df49-192b-49ca-b45c-9af912be9fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:50.457976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033382e1-ad6e-439a-8948-89568aabf00e None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:50.490109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd81110-85de-4973-8f77-7f16d0a694f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:50.490763 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd81110-85de-4973-8f77-7f16d0a694f6 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:50.491040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd81110-85de-4973-8f77-7f16d0a694f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:50.491339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd81110-85de-4973-8f77-7f16d0a694f6 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:50.492051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd81110-85de-4973-8f77-7f16d0a694f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:50.492350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd81110-85de-4973-8f77-7f16d0a694f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:50.493703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd81110-85de-4973-8f77-7f16d0a694f6 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:50.505611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 442/897] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:50.506397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd81110-85de-4973-8f77-7f16d0a694f6 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:50.524055 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 456/898] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:50.525194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1df49-192b-49ca-b45c-9af912be9fe9 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:50.615330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd81110-85de-4973-8f77-7f16d0a694f6 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:50.628053 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1df49-192b-49ca-b45c-9af912be9fe9 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:50.649536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5db66-5cc1-4411-9450-38e7e190adb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:50.650192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5db66-5cc1-4411-9450-38e7e190adb2 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:50.650471 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5db66-5cc1-4411-9450-38e7e190adb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:50.650738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5db66-5cc1-4411-9450-38e7e190adb2 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:50.651551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5db66-5cc1-4411-9450-38e7e190adb2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:50.652909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5db66-5cc1-4411-9450-38e7e190adb2 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:50.662796 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25db5ee-b2dc-41cd-adac-049a407b3643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:50.663856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25db5ee-b2dc-41cd-adac-049a407b3643 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:50.664404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25db5ee-b2dc-41cd-adac-049a407b3643 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:50.664874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25db5ee-b2dc-41cd-adac-049a407b3643 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:50.665791 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 443/899] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:35:50 2022] POST /identity/v3/services => generated 241 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:50.666560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5db66-5cc1-4411-9450-38e7e190adb2 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:50.673097 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25db5ee-b2dc-41cd-adac-049a407b3643 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:50.674561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25db5ee-b2dc-41cd-adac-049a407b3643 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-e25db5ee-b2dc-41cd-adac-049a407b3643 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:50.691685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:50.692745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:50.693732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:50.693732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:50.693732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:50.693732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:50.693732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:50.693732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:50.693732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:50.693732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:50.693732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:35:50.693732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:50.698053 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 457/900] 10.222.0.73 () {56 vars in 1117 bytes} [Wed May 4 13:35:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:50.699047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25db5ee-b2dc-41cd-adac-049a407b3643 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:50.806885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25db5ee-b2dc-41cd-adac-049a407b3643 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:50.825806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5db66-5cc1-4411-9450-38e7e190adb2 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:50.843396 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fe376-c715-4708-859b-fe62a68b6b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:50.844073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fe376-c715-4708-859b-fe62a68b6b29 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:50.844352 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fe376-c715-4708-859b-fe62a68b6b29 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:50.844621 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fe376-c715-4708-859b-fe62a68b6b29 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:50.845469 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fe376-c715-4708-859b-fe62a68b6b29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:50.845777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fe376-c715-4708-859b-fe62a68b6b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:50.847259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fe376-c715-4708-859b-fe62a68b6b29 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:50.863512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761a311-3ca2-4583-b92b-db9dc20eff78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:50.864708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761a311-3ca2-4583-b92b-db9dc20eff78 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:50.865212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761a311-3ca2-4583-b92b-db9dc20eff78 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:50.865689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761a311-3ca2-4583-b92b-db9dc20eff78 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:50.866584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761a311-3ca2-4583-b92b-db9dc20eff78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:50.868369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761a311-3ca2-4583-b92b-db9dc20eff78 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:50.871278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 458/901] 10.222.0.73 () {56 vars in 1149 bytes} [Wed May 4 13:35:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:50.872294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fe376-c715-4708-859b-fe62a68b6b29 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-a761a311-3ca2-4583-b92b-db9dc20eff78 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:50.883994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:50.885001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:35:50.885878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:50.889518 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 444/902] 10.222.0.73 () {56 vars in 1132 bytes} [Wed May 4 13:35:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:50.894759 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761a311-3ca2-4583-b92b-db9dc20eff78 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:50.975706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fe376-c715-4708-859b-fe62a68b6b29 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:51.011309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b8c41-9cc4-424c-a0b8-965df4b70d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:51.012198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b8c41-9cc4-424c-a0b8-965df4b70d2e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:51.012442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761a311-3ca2-4583-b92b-db9dc20eff78 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:51.012803 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b8c41-9cc4-424c-a0b8-965df4b70d2e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:51.013241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b8c41-9cc4-424c-a0b8-965df4b70d2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:51.047235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fd5cf-2b09-4166-b82a-9b81bb034140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:51.048114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd5cf-2b09-4166-b82a-9b81bb034140 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:51.048544 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd5cf-2b09-4166-b82a-9b81bb034140 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:51.048914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd5cf-2b09-4166-b82a-9b81bb034140 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:51.050481 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fd5cf-2b09-4166-b82a-9b81bb034140 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:51.050481 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fd5cf-2b09-4166-b82a-9b81bb034140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:51.051827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fd5cf-2b09-4166-b82a-9b81bb034140 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:51.057502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 445/903] 10.222.0.73 () {56 vars in 1126 bytes} [Wed May 4 13:35:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:51.063521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fd5cf-2b09-4166-b82a-9b81bb034140 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:51.085546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b8c41-9cc4-424c-a0b8-965df4b70d2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:51.087222 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b8c41-9cc4-424c-a0b8-965df4b70d2e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:51.164319 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fd5cf-2b09-4166-b82a-9b81bb034140 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:51.186193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 459/904] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:35:50 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:35:51.193182 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b8c41-9cc4-424c-a0b8-965df4b70d2e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:51.207168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76712eb-d345-4ad2-9ce0-65b353ba0833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:51.208287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76712eb-d345-4ad2-9ce0-65b353ba0833 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:51.209026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76712eb-d345-4ad2-9ce0-65b353ba0833 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:51.209538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76712eb-d345-4ad2-9ce0-65b353ba0833 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:51.210473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76712eb-d345-4ad2-9ce0-65b353ba0833 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:51.210978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76712eb-d345-4ad2-9ce0-65b353ba0833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:51.213239 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76712eb-d345-4ad2-9ce0-65b353ba0833 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:51.225334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 446/905] 10.222.0.73 () {56 vars in 1126 bytes} [Wed May 4 13:35:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:51.226350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76712eb-d345-4ad2-9ce0-65b353ba0833 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:51.300586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b8c41-9cc4-424c-a0b8-965df4b70d2e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:51.335588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6060541-c2b7-4056-92ad-9acee8923ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:51.336657 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6060541-c2b7-4056-92ad-9acee8923ff1 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:51.337155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6060541-c2b7-4056-92ad-9acee8923ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:51.337607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6060541-c2b7-4056-92ad-9acee8923ff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:51.348455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6060541-c2b7-4056-92ad-9acee8923ff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:51.350078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6060541-c2b7-4056-92ad-9acee8923ff1 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:51.350351 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76712eb-d345-4ad2-9ce0-65b353ba0833 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-b6060541-c2b7-4056-92ad-9acee8923ff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:51.369311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:51.370225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:51.371150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:51.371150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:51.371150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:51.371150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:51.373380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 460/906] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:51.379844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6060541-c2b7-4056-92ad-9acee8923ff1 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:51.387606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcc81b-9b38-4c6b-b57d-d2bed223601f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:51.388396 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcc81b-9b38-4c6b-b57d-d2bed223601f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:51.388683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcc81b-9b38-4c6b-b57d-d2bed223601f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:51.388956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dcc81b-9b38-4c6b-b57d-d2bed223601f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:51.389749 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcc81b-9b38-4c6b-b57d-d2bed223601f None admin] RBAC: Adding query filter params (interface=public, service_id=4d00f4b774814216b24f6b511ebeb822, region_id=RegionOne) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:51.390063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcc81b-9b38-4c6b-b57d-d2bed223601f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:51.391504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dcc81b-9b38-4c6b-b57d-d2bed223601f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:51.401193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 447/907] 10.222.0.73 () {56 vars in 1251 bytes} [Wed May 4 13:35:51 2022] GET /identity/v3/endpoints?service_id=4d00f4b774814216b24f6b511ebeb822&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:51.402217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcc81b-9b38-4c6b-b57d-d2bed223601f None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:51.501308 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6060541-c2b7-4056-92ad-9acee8923ff1 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:51.512597 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dcc81b-9b38-4c6b-b57d-d2bed223601f None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:51.536514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff731f-9da7-42dc-9abb-f1ed4aea74cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:51.537331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff731f-9da7-42dc-9abb-f1ed4aea74cc None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:51.537918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff731f-9da7-42dc-9abb-f1ed4aea74cc None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:51.538036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff731f-9da7-42dc-9abb-f1ed4aea74cc None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:51.538856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff731f-9da7-42dc-9abb-f1ed4aea74cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:51.539323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff731f-9da7-42dc-9abb-f1ed4aea74cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:51.540739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff731f-9da7-42dc-9abb-f1ed4aea74cc None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:51.553207 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 461/908] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:51.556563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c6e62-1154-43cd-837d-081a029a38a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:51.557737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c6e62-1154-43cd-837d-081a029a38a5 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:51.558207 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c6e62-1154-43cd-837d-081a029a38a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:51.558637 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff731f-9da7-42dc-9abb-f1ed4aea74cc None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:51.558846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c6e62-1154-43cd-837d-081a029a38a5 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:51.559782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c6e62-1154-43cd-837d-081a029a38a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:51.561647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c6e62-1154-43cd-837d-081a029a38a5 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:51.569921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 448/909] 10.222.0.73 () {56 vars in 1087 bytes} [Wed May 4 13:35:51 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:35:51.677504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff731f-9da7-42dc-9abb-f1ed4aea74cc None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:51.713664 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13648a-77d8-4809-8ea8-0cc42660884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:51.714474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13648a-77d8-4809-8ea8-0cc42660884d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:51.714755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13648a-77d8-4809-8ea8-0cc42660884d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:51.715026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13648a-77d8-4809-8ea8-0cc42660884d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:51.723186 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13648a-77d8-4809-8ea8-0cc42660884d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:51.724653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13648a-77d8-4809-8ea8-0cc42660884d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-ce13648a-77d8-4809-8ea8-0cc42660884d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:51.740051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:51.741004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:51.741886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:51.741886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:51.741886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:51.741886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:51.741886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:51.741886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:51.741886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:51.741886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:51.741886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 462/910] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:51.747486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c6e62-1154-43cd-837d-081a029a38a5 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:51.851813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c6e62-1154-43cd-837d-081a029a38a5 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:51.887782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231c9ff-6803-4588-b8bf-840282984b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:51.889746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231c9ff-6803-4588-b8bf-840282984b29 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:51.890078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231c9ff-6803-4588-b8bf-840282984b29 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:51.890363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231c9ff-6803-4588-b8bf-840282984b29 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:51.891235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231c9ff-6803-4588-b8bf-840282984b29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:51.891591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231c9ff-6803-4588-b8bf-840282984b29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:51.893078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231c9ff-6803-4588-b8bf-840282984b29 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:51.906989 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 449/911] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:51.913141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13648a-77d8-4809-8ea8-0cc42660884d None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:52.017019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13648a-77d8-4809-8ea8-0cc42660884d None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:52.035488 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7320160-29c5-47bb-8caa-0525b609d540 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:52.036073 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7320160-29c5-47bb-8caa-0525b609d540 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:52.036526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7320160-29c5-47bb-8caa-0525b609d540 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:52.039598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 450/912] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:52.045133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22f96c-290d-4e7d-81e7-716dc8c3ed66 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:52.045426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22f96c-290d-4e7d-81e7-716dc8c3ed66 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:52.045699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22f96c-290d-4e7d-81e7-716dc8c3ed66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:52.056582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734caddb-f48b-4029-9f94-5c720dc5564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:52.057239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734caddb-f48b-4029-9f94-5c720dc5564b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:52.057519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734caddb-f48b-4029-9f94-5c720dc5564b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:52.057793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734caddb-f48b-4029-9f94-5c720dc5564b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:52.058728 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734caddb-f48b-4029-9f94-5c720dc5564b None admin] RBAC: Adding query filter params (role.id=bfebc8d95b31401c8be316fd2a084797, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=631d619317354b76bf1535550a207b0d) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:52.058934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734caddb-f48b-4029-9f94-5c720dc5564b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:52.060933 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734caddb-f48b-4029-9f94-5c720dc5564b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:52.064400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-df22f96c-290d-4e7d-81e7-716dc8c3ed66 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:52.066024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-df22f96c-290d-4e7d-81e7-716dc8c3ed66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:52.066690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 463/913] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:35:51 2022] GET /identity/v3/role_assignments?user.id=631d619317354b76bf1535550a207b0d&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bfebc8d95b31401c8be316fd2a084797 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:52.142367 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 451/914] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:35:52.165732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734caddb-f48b-4029-9f94-5c720dc5564b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:52.276294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734caddb-f48b-4029-9f94-5c720dc5564b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:52.314278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a199af-7b39-4f01-87ff-1a5a2d7cc58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:52.315092 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a199af-7b39-4f01-87ff-1a5a2d7cc58f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:52.315404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a199af-7b39-4f01-87ff-1a5a2d7cc58f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:52.315681 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a199af-7b39-4f01-87ff-1a5a2d7cc58f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:52.316335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a199af-7b39-4f01-87ff-1a5a2d7cc58f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:52.317684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a199af-7b39-4f01-87ff-1a5a2d7cc58f None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-55a199af-7b39-4f01-87ff-1a5a2d7cc58f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:52.330028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:52.331128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:52.332101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 464/915] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:35:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:52.339402 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22f96c-290d-4e7d-81e7-716dc8c3ed66 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:52.439470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22f96c-290d-4e7d-81e7-716dc8c3ed66 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:52.473980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fb187-da7f-4bdb-84bc-3994edc9be3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:52.474779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fb187-da7f-4bdb-84bc-3994edc9be3a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:52.475056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fb187-da7f-4bdb-84bc-3994edc9be3a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:52.475366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fb187-da7f-4bdb-84bc-3994edc9be3a None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:52.476076 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fb187-da7f-4bdb-84bc-3994edc9be3a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:52.476374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fb187-da7f-4bdb-84bc-3994edc9be3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:52.477729 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fb187-da7f-4bdb-84bc-3994edc9be3a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:52.483445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 452/916] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:35:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:52.491643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a199af-7b39-4f01-87ff-1a5a2d7cc58f None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:52.591011 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a199af-7b39-4f01-87ff-1a5a2d7cc58f None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:52.625728 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de65510-5620-4a82-85e8-2538418a966e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:52.626764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de65510-5620-4a82-85e8-2538418a966e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:52.627314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de65510-5620-4a82-85e8-2538418a966e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:52.627809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de65510-5620-4a82-85e8-2538418a966e None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:52.628740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de65510-5620-4a82-85e8-2538418a966e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:52.629257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de65510-5620-4a82-85e8-2538418a966e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:52.630810 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de65510-5620-4a82-85e8-2538418a966e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:52.636333 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 465/917] 10.222.0.73 () {56 vars in 1114 bytes} [Wed May 4 13:35:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:52.642125 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fb187-da7f-4bdb-84bc-3994edc9be3a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:52.746644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fb187-da7f-4bdb-84bc-3994edc9be3a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:52.781779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb58e9b-25c7-4505-9ac9-f5c3354c396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:52.782887 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb58e9b-25c7-4505-9ac9-f5c3354c396c None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:52.783428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb58e9b-25c7-4505-9ac9-f5c3354c396c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:52.783918 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb58e9b-25c7-4505-9ac9-f5c3354c396c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:52.784896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb58e9b-25c7-4505-9ac9-f5c3354c396c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:52.786470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb58e9b-25c7-4505-9ac9-f5c3354c396c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:52.808428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 453/918] 10.222.0.73 () {60 vars in 1144 bytes} [Wed May 4 13:35:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:53.061527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1bdd8-d79d-4439-b9ff-ed52d92c1a8d None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:53.062070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1bdd8-d79d-4439-b9ff-ed52d92c1a8d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:53.062070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1bdd8-d79d-4439-b9ff-ed52d92c1a8d None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:53.063739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 466/919] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:53.071949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8ec8e-32f8-4cf4-969e-6e97bcd3ad6d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:53.072350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8ec8e-32f8-4cf4-969e-6e97bcd3ad6d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:53.072729 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8ec8e-32f8-4cf4-969e-6e97bcd3ad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:53.090378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-8ff8ec8e-32f8-4cf4-969e-6e97bcd3ad6d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:53.092198 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8ff8ec8e-32f8-4cf4-969e-6e97bcd3ad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:53.165837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 454/920] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:53.188287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1bdd8-d79d-4439-b9ff-ed52d92c1a8d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:53.298040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1bdd8-d79d-4439-b9ff-ed52d92c1a8d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:53.333211 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b82bd-8b47-4b6a-862d-a06d5e2e7114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:53.334019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b82bd-8b47-4b6a-862d-a06d5e2e7114 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:53.334300 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b82bd-8b47-4b6a-862d-a06d5e2e7114 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:53.334631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b82bd-8b47-4b6a-862d-a06d5e2e7114 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:53.335317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b82bd-8b47-4b6a-862d-a06d5e2e7114 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:53.336723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b82bd-8b47-4b6a-862d-a06d5e2e7114 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-c07b82bd-8b47-4b6a-862d-a06d5e2e7114 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:53.349683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:53.350688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:53.351951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 467/921] 10.222.0.73 () {56 vars in 1126 bytes} [Wed May 4 13:35:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:53.357206 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8ec8e-32f8-4cf4-969e-6e97bcd3ad6d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:53.464079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8ec8e-32f8-4cf4-969e-6e97bcd3ad6d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:53.498323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eba40c-47a4-4c12-a8a4-6573bed412a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:53.498985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eba40c-47a4-4c12-a8a4-6573bed412a0 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:53.499291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eba40c-47a4-4c12-a8a4-6573bed412a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:53.499564 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eba40c-47a4-4c12-a8a4-6573bed412a0 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:53.500266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eba40c-47a4-4c12-a8a4-6573bed412a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:53.500578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eba40c-47a4-4c12-a8a4-6573bed412a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:53.501986 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eba40c-47a4-4c12-a8a4-6573bed412a0 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:53.506968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 455/922] 10.222.0.73 () {56 vars in 1122 bytes} [Wed May 4 13:35:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:53.512713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b82bd-8b47-4b6a-862d-a06d5e2e7114 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:53.618433 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b82bd-8b47-4b6a-862d-a06d5e2e7114 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:53.653537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ee52d-ef77-4a44-80bd-803881cfb1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:53.654555 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ee52d-ef77-4a44-80bd-803881cfb1d9 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:53.655056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ee52d-ef77-4a44-80bd-803881cfb1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:53.655566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ee52d-ef77-4a44-80bd-803881cfb1d9 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:53.656483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ee52d-ef77-4a44-80bd-803881cfb1d9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:53.656995 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ee52d-ef77-4a44-80bd-803881cfb1d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:53.658537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ee52d-ef77-4a44-80bd-803881cfb1d9 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:53.664233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 468/923] 10.222.0.73 () {56 vars in 1122 bytes} [Wed May 4 13:35:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:53.675256 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eba40c-47a4-4c12-a8a4-6573bed412a0 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:53.777665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eba40c-47a4-4c12-a8a4-6573bed412a0 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:53.812411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e5ac4-050f-4419-bc0f-b0d18dfd2fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:53.813076 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5ac4-050f-4419-bc0f-b0d18dfd2fd2 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:53.813360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5ac4-050f-4419-bc0f-b0d18dfd2fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:53.813638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e5ac4-050f-4419-bc0f-b0d18dfd2fd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:53.814424 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e5ac4-050f-4419-bc0f-b0d18dfd2fd2 None admin] RBAC: Adding query filter params (interface=public, service_id=b66f745595bb4a578619c9011555e96b, region_id=RegionOne) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:53.814738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e5ac4-050f-4419-bc0f-b0d18dfd2fd2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:53.816135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e5ac4-050f-4419-bc0f-b0d18dfd2fd2 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:53.821965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 456/924] 10.222.0.73 () {56 vars in 1251 bytes} [Wed May 4 13:35:53 2022] GET /identity/v3/endpoints?service_id=b66f745595bb4a578619c9011555e96b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:53.827519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ee52d-ef77-4a44-80bd-803881cfb1d9 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:53.924279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e844f0-91fe-4a8c-b895-a583cc3451da None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:53.924475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e844f0-91fe-4a8c-b895-a583cc3451da None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:53.924705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e844f0-91fe-4a8c-b895-a583cc3451da None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:53.926270 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 457/925] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:53.931242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad7bcb-d5b0-4c78-ac86-b014103fc5c8 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:53.931525 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad7bcb-d5b0-4c78-ac86-b014103fc5c8 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:53.931803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad7bcb-d5b0-4c78-ac86-b014103fc5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:53.932580 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ee52d-ef77-4a44-80bd-803881cfb1d9 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:53.948798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-2fad7bcb-d5b0-4c78-ac86-b014103fc5c8 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:53.950050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2fad7bcb-d5b0-4c78-ac86-b014103fc5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:53.967438 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a501ca0-8bef-432d-9951-739786f4f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:53.968448 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a501ca0-8bef-432d-9951-739786f4f6c7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:53.968915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a501ca0-8bef-432d-9951-739786f4f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:53.969376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a501ca0-8bef-432d-9951-739786f4f6c7 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:53.970241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a501ca0-8bef-432d-9951-739786f4f6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:53.971818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a501ca0-8bef-432d-9951-739786f4f6c7 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:53.978800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 469/926] 10.222.0.73 () {56 vars in 1087 bytes} [Wed May 4 13:35:53 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:35:54.033000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 458/927] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:54.056538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a501ca0-8bef-432d-9951-739786f4f6c7 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:54.167763 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a501ca0-8bef-432d-9951-739786f4f6c7 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:54.203514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1cc8a-9d65-4db6-8ca9-404234269044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:54.207338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1cc8a-9d65-4db6-8ca9-404234269044 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:54.207338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1cc8a-9d65-4db6-8ca9-404234269044 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:54.207338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1cc8a-9d65-4db6-8ca9-404234269044 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:54.207338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1cc8a-9d65-4db6-8ca9-404234269044 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:54.207338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1cc8a-9d65-4db6-8ca9-404234269044 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-0fd1cc8a-9d65-4db6-8ca9-404234269044 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:54.220922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:54.222056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 13:35:54.222912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:54.226479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 470/928] 10.222.0.73 () {56 vars in 1132 bytes} [Wed May 4 13:35:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:54.235341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad7bcb-d5b0-4c78-ac86-b014103fc5c8 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:54.345501 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad7bcb-d5b0-4c78-ac86-b014103fc5c8 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:54.379573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8850e4-baa2-4960-993b-4d10e1bdf97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:54.380230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8850e4-baa2-4960-993b-4d10e1bdf97f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:54.380498 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8850e4-baa2-4960-993b-4d10e1bdf97f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:54.380774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8850e4-baa2-4960-993b-4d10e1bdf97f None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:54.381474 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8850e4-baa2-4960-993b-4d10e1bdf97f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:54.381774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8850e4-baa2-4960-993b-4d10e1bdf97f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:54.383129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8850e4-baa2-4960-993b-4d10e1bdf97f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:54.388420 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 459/929] 10.222.0.73 () {56 vars in 1126 bytes} [Wed May 4 13:35:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:54.393839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1cc8a-9d65-4db6-8ca9-404234269044 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:54.426595 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f659ecd-0445-492d-87fb-a9e9cceec876 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:54.427106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f659ecd-0445-492d-87fb-a9e9cceec876 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:54.427575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f659ecd-0445-492d-87fb-a9e9cceec876 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:54.429324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 460/930] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:54.434323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcac5b-9d51-4c66-8585-aa61fc02c585 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:54.434793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcac5b-9d51-4c66-8585-aa61fc02c585 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:54.435267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcac5b-9d51-4c66-8585-aa61fc02c585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:54.451784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-8dbcac5b-9d51-4c66-8585-aa61fc02c585 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:54.453171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8dbcac5b-9d51-4c66-8585-aa61fc02c585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:54.496936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1cc8a-9d65-4db6-8ca9-404234269044 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:54.534465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 461/931] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:35:54.539890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d358301-9f96-43d8-bc9c-f26f28bdd084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:54.540814 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d358301-9f96-43d8-bc9c-f26f28bdd084 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:54.541309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d358301-9f96-43d8-bc9c-f26f28bdd084 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:54.541790 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d358301-9f96-43d8-bc9c-f26f28bdd084 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:54.542750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d358301-9f96-43d8-bc9c-f26f28bdd084 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:54.543284 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d358301-9f96-43d8-bc9c-f26f28bdd084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:54.544882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d358301-9f96-43d8-bc9c-f26f28bdd084 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:54.550495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 471/932] 10.222.0.73 () {56 vars in 1126 bytes} [Wed May 4 13:35:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:54.555952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcac5b-9d51-4c66-8585-aa61fc02c585 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:54.559999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d358301-9f96-43d8-bc9c-f26f28bdd084 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:54.671858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcac5b-9d51-4c66-8585-aa61fc02c585 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:54.672745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d358301-9f96-43d8-bc9c-f26f28bdd084 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:54.708005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada94f8-c078-44c9-a69c-55d36cfb30df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:54.708588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8169b7a-641b-4e3a-b7ea-ffa1b411d2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:54.708922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada94f8-c078-44c9-a69c-55d36cfb30df None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:54.709376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada94f8-c078-44c9-a69c-55d36cfb30df None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:54.709815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada94f8-c078-44c9-a69c-55d36cfb30df None admin] PATH_INFO: `/v3/endpoints` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:54.709937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8169b7a-641b-4e3a-b7ea-ffa1b411d2b0 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:54.710382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8169b7a-641b-4e3a-b7ea-ffa1b411d2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:54.710867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8169b7a-641b-4e3a-b7ea-ffa1b411d2b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:54.710982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada94f8-c078-44c9-a69c-55d36cfb30df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:54.712321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada94f8-c078-44c9-a69c-55d36cfb30df None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:54.724616 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8169b7a-641b-4e3a-b7ea-ffa1b411d2b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-a8169b7a-641b-4e3a-b7ea-ffa1b411d2b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:54.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:54.735856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:54.736689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:54.736689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:54.736689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:54.736689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:54.736689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:54.736689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:54.736689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:54.736689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:54.736689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:54.736689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:54.736689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:35:54.736689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:54.742800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 472/934] 10.222.0.73 () {60 vars in 1144 bytes} [Wed May 4 13:35:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:54.744028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 462/934] 10.222.0.73 () {56 vars in 1120 bytes} [Wed May 4 13:35:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:54.745379 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada94f8-c078-44c9-a69c-55d36cfb30df None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:54.862214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada94f8-c078-44c9-a69c-55d36cfb30df None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:54.897384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84aad3-2d5c-4846-8eb7-60bada8bc750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:54.898070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84aad3-2d5c-4846-8eb7-60bada8bc750 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:54.898356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84aad3-2d5c-4846-8eb7-60bada8bc750 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:54.898632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84aad3-2d5c-4846-8eb7-60bada8bc750 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:54.899439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84aad3-2d5c-4846-8eb7-60bada8bc750 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:54.899751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84aad3-2d5c-4846-8eb7-60bada8bc750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:54.901129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84aad3-2d5c-4846-8eb7-60bada8bc750 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:54.911028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 473/935] 10.222.0.73 () {56 vars in 1115 bytes} [Wed May 4 13:35:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:54.916876 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8169b7a-641b-4e3a-b7ea-ffa1b411d2b0 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:55.022523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8169b7a-641b-4e3a-b7ea-ffa1b411d2b0 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:55.065573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d06f83-74a9-45ad-b27c-24839b0d6d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:55.066370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06f83-74a9-45ad-b27c-24839b0d6d25 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:55.066656 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06f83-74a9-45ad-b27c-24839b0d6d25 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:55.066935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06f83-74a9-45ad-b27c-24839b0d6d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:55.078490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d06f83-74a9-45ad-b27c-24839b0d6d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:55.079969 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d06f83-74a9-45ad-b27c-24839b0d6d25 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-e6d06f83-74a9-45ad-b27c-24839b0d6d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:55.097638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:55.098556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:55.099557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:55.099557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:55.099557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:55.099557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:55.099557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 463/936] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:55.104913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84aad3-2d5c-4846-8eb7-60bada8bc750 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:55.213104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166f550-c184-4dff-ba07-e04c19b5d3ad None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:55.213717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166f550-c184-4dff-ba07-e04c19b5d3ad None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:55.214213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166f550-c184-4dff-ba07-e04c19b5d3ad None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:55.217055 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84aad3-2d5c-4846-8eb7-60bada8bc750 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:55.220124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 464/937] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:55.221810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b5d52-9d08-478d-8df0-4e211dc6c656 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:55.222310 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b5d52-9d08-478d-8df0-4e211dc6c656 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:55.222799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b5d52-9d08-478d-8df0-4e211dc6c656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:55.244750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-4e9b5d52-9d08-478d-8df0-4e211dc6c656 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:55.246897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4e9b5d52-9d08-478d-8df0-4e211dc6c656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:55.254177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e1da0-7d38-4e57-ab97-588af4bbb803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:55.254840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e1da0-7d38-4e57-ab97-588af4bbb803 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:55.255115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e1da0-7d38-4e57-ab97-588af4bbb803 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:55.255406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e1da0-7d38-4e57-ab97-588af4bbb803 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:55.256551 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e1da0-7d38-4e57-ab97-588af4bbb803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:55.256860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e1da0-7d38-4e57-ab97-588af4bbb803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:55.258210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e1da0-7d38-4e57-ab97-588af4bbb803 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:55.273734 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 474/938] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:55.279600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e1da0-7d38-4e57-ab97-588af4bbb803 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:55.335228 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 465/939] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:35:55.353420 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b5d52-9d08-478d-8df0-4e211dc6c656 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:55.401669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e1da0-7d38-4e57-ab97-588af4bbb803 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:55.436353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bee9f6-68da-4bc4-be20-fdd92a19b638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:55.437512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bee9f6-68da-4bc4-be20-fdd92a19b638 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:55.438034 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bee9f6-68da-4bc4-be20-fdd92a19b638 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:55.438501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bee9f6-68da-4bc4-be20-fdd92a19b638 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:55.446252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bee9f6-68da-4bc4-be20-fdd92a19b638 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:55.447942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bee9f6-68da-4bc4-be20-fdd92a19b638 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-c4bee9f6-68da-4bc4-be20-fdd92a19b638 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:55.468115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:55.469093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:55.470042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:55.470042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:55.470042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:55.470042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:55.470042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:55.470042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:55.470042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:55.470042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:55.470042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:35:55.470042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:55.472687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 475/940] 10.222.0.73 () {56 vars in 1117 bytes} [Wed May 4 13:35:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:55.472988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b5d52-9d08-478d-8df0-4e211dc6c656 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:55.480968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bee9f6-68da-4bc4-be20-fdd92a19b638 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:55.518502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec94e-26a3-4105-b8fe-9e14e2a0a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:55.519170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec94e-26a3-4105-b8fe-9e14e2a0a992 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:55.519486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec94e-26a3-4105-b8fe-9e14e2a0a992 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:55.519766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec94e-26a3-4105-b8fe-9e14e2a0a992 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:55.520503 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ec94e-26a3-4105-b8fe-9e14e2a0a992 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:55.522934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ec94e-26a3-4105-b8fe-9e14e2a0a992 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:55.524344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: WARNING keystone.server.flask.common [None req-925ec94e-26a3-4105-b8fe-9e14e2a0a992 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 13:35:55.546000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.sql.core [None req-925ec94e-26a3-4105-b8fe-9e14e2a0a992 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 13:35:55.546000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 13:35:55.546000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [parameters: {'id': 'e316f70e8a404575890b2a744df3a557', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 13:35:55.546000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86422) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-925ec94e-26a3-4105-b8fe-9e14e2a0a992 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e316f70e8a404575890b2a744df3a557.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e316f70e8a404575890b2a744df3a557. May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application result = self._query(query) May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application conn.query(q) May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 13:35:55.567229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application result.read() May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 04 13:35:55.568104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return project_ref.to_dict() May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application next(self.gen) May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application yield resource May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application next(self.gen) May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self.session.rollback() May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self.force_reraise() May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise self.value May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application session.commit() May 04 13:35:55.569048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._prepare_impl() May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self.session.flush() May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._flush(objects) May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application compat.raise_( May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application flush_context.execute() May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 13:35:55.570841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rec.execute(self) May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 13:35:55.571968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application result = self._query(query) May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application conn.query(q) May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application result.read() May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 13:35:55.572789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [parameters: {'id': 'e316f70e8a404575890b2a744df3a557', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:55.574338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:55.576901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:55.579467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:55.579467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 04 13:35:55.579467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 04 13:35:55.579467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:55.579467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:55.579467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 04 13:35:55.579467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.Conflict( May 04 13:35:55.579467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e316f70e8a404575890b2a744df3a557. May 04 13:35:55.579467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:55.579467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 466/941] 10.222.0.73 () {60 vars in 1140 bytes} [Wed May 4 13:35:55 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:55.579467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec94e-26a3-4105-b8fe-9e14e2a0a992 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:55.613188 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bee9f6-68da-4bc4-be20-fdd92a19b638 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:55.659084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1a8d4-1c9d-4870-a4d4-094147a4eac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:55.660174 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1a8d4-1c9d-4870-a4d4-094147a4eac5 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:55.660669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1a8d4-1c9d-4870-a4d4-094147a4eac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:55.661540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1a8d4-1c9d-4870-a4d4-094147a4eac5 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:55.662612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1a8d4-1c9d-4870-a4d4-094147a4eac5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:55.663517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1a8d4-1c9d-4870-a4d4-094147a4eac5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:55.665762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1a8d4-1c9d-4870-a4d4-094147a4eac5 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:55.685579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec94e-26a3-4105-b8fe-9e14e2a0a992 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:55.690384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 476/942] 10.222.0.73 () {56 vars in 1149 bytes} [Wed May 4 13:35:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:55.699261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1a8d4-1c9d-4870-a4d4-094147a4eac5 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:55.726292 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160f9ab-f4d5-4d13-9a9d-79bc6057c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:55.727043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160f9ab-f4d5-4d13-9a9d-79bc6057c388 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:55.727333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160f9ab-f4d5-4d13-9a9d-79bc6057c388 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:55.727617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160f9ab-f4d5-4d13-9a9d-79bc6057c388 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:55.734364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160f9ab-f4d5-4d13-9a9d-79bc6057c388 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:55.736074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160f9ab-f4d5-4d13-9a9d-79bc6057c388 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-3160f9ab-f4d5-4d13-9a9d-79bc6057c388 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:55.750710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:55.751704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:55.752577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:55.752577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:55.752577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:55.752577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:55.752577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:55.752577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:55.752577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:55.752577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:55.756959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 467/943] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:55.757800 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160f9ab-f4d5-4d13-9a9d-79bc6057c388 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:55.820912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1a8d4-1c9d-4870-a4d4-094147a4eac5 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:55.859931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160f9ab-f4d5-4d13-9a9d-79bc6057c388 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:55.865414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc77789-76ca-41b0-9668-652b0d6adc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:55.866214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77789-76ca-41b0-9668-652b0d6adc35 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:55.866500 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77789-76ca-41b0-9668-652b0d6adc35 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:55.866778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77789-76ca-41b0-9668-652b0d6adc35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:55.879800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc77789-76ca-41b0-9668-652b0d6adc35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:55.881252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc77789-76ca-41b0-9668-652b0d6adc35 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:55.898930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688c5b2-4d77-45d5-999f-d0eba65f541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:55.899628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688c5b2-4d77-45d5-999f-d0eba65f541b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:55.899909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688c5b2-4d77-45d5-999f-d0eba65f541b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:55.900183 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688c5b2-4d77-45d5-999f-d0eba65f541b None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:55.900943 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688c5b2-4d77-45d5-999f-d0eba65f541b None admin] RBAC: Adding query filter params (name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:55.901246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688c5b2-4d77-45d5-999f-d0eba65f541b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-ddc77789-76ca-41b0-9668-652b0d6adc35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:55.902512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:55.903390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:55.904868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:55.904868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:55.904868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:55.904868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:55.905098 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688c5b2-4d77-45d5-999f-d0eba65f541b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:55.911521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 477/944] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:55.912652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc77789-76ca-41b0-9668-652b0d6adc35 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:55.931355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 468/945] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:35:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:56.026818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc77789-76ca-41b0-9668-652b0d6adc35 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:56.063392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144436-a657-4bf5-88aa-e02f5e6360ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:56.064427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144436-a657-4bf5-88aa-e02f5e6360ad None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:56.064928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144436-a657-4bf5-88aa-e02f5e6360ad None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:56.065435 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144436-a657-4bf5-88aa-e02f5e6360ad None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:56.066372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b144436-a657-4bf5-88aa-e02f5e6360ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:56.066886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b144436-a657-4bf5-88aa-e02f5e6360ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:56.068569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b144436-a657-4bf5-88aa-e02f5e6360ad None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:56.082142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 478/946] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:56.088081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688c5b2-4d77-45d5-999f-d0eba65f541b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:56.196593 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688c5b2-4d77-45d5-999f-d0eba65f541b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:56.233316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560156f9-5d60-4f64-8947-e09454bcf3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:56.234417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560156f9-5d60-4f64-8947-e09454bcf3d6 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:56.234852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560156f9-5d60-4f64-8947-e09454bcf3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:56.235126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560156f9-5d60-4f64-8947-e09454bcf3d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:56.241920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560156f9-5d60-4f64-8947-e09454bcf3d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:56.243391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560156f9-5d60-4f64-8947-e09454bcf3d6 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-560156f9-5d60-4f64-8947-e09454bcf3d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:35:56.257212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:56.258166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:56.259079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:35:56.259079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:35:56.259079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:35:56.259079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:35:56.259079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:35:56.259079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:35:56.259079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:35:56.259079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:56.259079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 469/947] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:56.264825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144436-a657-4bf5-88aa-e02f5e6360ad None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:56.363349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f34bfd-e257-4c1f-b740-1a8e08efcdcf None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:56.364178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f34bfd-e257-4c1f-b740-1a8e08efcdcf None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:56.364868 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f34bfd-e257-4c1f-b740-1a8e08efcdcf None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:56.367763 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 470/948] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:56.376086 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edcf30-ee16-4cab-b717-e02a670bace7 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:56.376898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edcf30-ee16-4cab-b717-e02a670bace7 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:56.377586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edcf30-ee16-4cab-b717-e02a670bace7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:56.382379 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144436-a657-4bf5-88aa-e02f5e6360ad None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:56.396622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b8edcf30-ee16-4cab-b717-e02a670bace7 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:56.398522 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b8edcf30-ee16-4cab-b717-e02a670bace7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:56.417106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1f93-c4d7-40cd-8be3-9a35c0ef52ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:56.417717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1f93-c4d7-40cd-8be3-9a35c0ef52ed None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:56.417997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1f93-c4d7-40cd-8be3-9a35c0ef52ed None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:56.418270 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a1f93-c4d7-40cd-8be3-9a35c0ef52ed None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:56.419067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a1f93-c4d7-40cd-8be3-9a35c0ef52ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:56.419443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a1f93-c4d7-40cd-8be3-9a35c0ef52ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:56.420860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a1f93-c4d7-40cd-8be3-9a35c0ef52ed None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:56.434196 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 479/949] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:35:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:56.440223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1f93-c4d7-40cd-8be3-9a35c0ef52ed None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:56.470257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 471/950] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:56.492353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edcf30-ee16-4cab-b717-e02a670bace7 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:56.551878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a1f93-c4d7-40cd-8be3-9a35c0ef52ed None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:56.588388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbe87e-04d7-4359-b5eb-8992f274d64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:56.589245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbe87e-04d7-4359-b5eb-8992f274d64e None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:56.589529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbe87e-04d7-4359-b5eb-8992f274d64e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:56.589802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbe87e-04d7-4359-b5eb-8992f274d64e None admin] PATH_INFO: `/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/631d619317354b76bf1535550a207b0d/roles/bfebc8d95b31401c8be316fd2a084797` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:56.592120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbe87e-04d7-4359-b5eb-8992f274d64e None admin] RBAC: Authorizing `identity:create_grant(project_id=fbace3b0d2f54a408012ccc368865c82, user_id=631d619317354b76bf1535550a207b0d, role_id=bfebc8d95b31401c8be316fd2a084797)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:56.593618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbe87e-04d7-4359-b5eb-8992f274d64e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:56.614002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 480/951] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:35:56 2022] PUT /identity/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/631d619317354b76bf1535550a207b0d/roles/bfebc8d95b31401c8be316fd2a084797 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:35:56.614582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edcf30-ee16-4cab-b717-e02a670bace7 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:56.657957 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32d10d-a92b-45db-b021-c1716b4e0494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:56.658846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32d10d-a92b-45db-b021-c1716b4e0494 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:56.659137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32d10d-a92b-45db-b021-c1716b4e0494 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:56.659444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32d10d-a92b-45db-b021-c1716b4e0494 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:56.660220 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32d10d-a92b-45db-b021-c1716b4e0494 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:56.661823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32d10d-a92b-45db-b021-c1716b4e0494 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-fc32d10d-a92b-45db-b021-c1716b4e0494 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:56.675346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:56.676449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:56.677307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 472/952] 10.222.0.73 () {56 vars in 1126 bytes} [Wed May 4 13:35:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:56.682663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbe87e-04d7-4359-b5eb-8992f274d64e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:56.804227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbe87e-04d7-4359-b5eb-8992f274d64e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:56.838911 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38bc8a-1e58-4bc0-bd58-34f6bf5fbe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:56.839531 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38bc8a-1e58-4bc0-bd58-34f6bf5fbe16 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:56.839811 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38bc8a-1e58-4bc0-bd58-34f6bf5fbe16 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:56.840085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38bc8a-1e58-4bc0-bd58-34f6bf5fbe16 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:56.840814 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38bc8a-1e58-4bc0-bd58-34f6bf5fbe16 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:56.841257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38bc8a-1e58-4bc0-bd58-34f6bf5fbe16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:56.842504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38bc8a-1e58-4bc0-bd58-34f6bf5fbe16 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:56.847695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 481/953] 10.222.0.73 () {56 vars in 1122 bytes} [Wed May 4 13:35:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:56.853206 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32d10d-a92b-45db-b021-c1716b4e0494 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:56.961714 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32d10d-a92b-45db-b021-c1716b4e0494 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:56.998871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436c7aa-9d27-43a1-a1bd-57c5a56c576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:56.999603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c7aa-9d27-43a1-a1bd-57c5a56c576a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:56.999885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c7aa-9d27-43a1-a1bd-57c5a56c576a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:57.000158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c7aa-9d27-43a1-a1bd-57c5a56c576a None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:57.000860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436c7aa-9d27-43a1-a1bd-57c5a56c576a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:57.001212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436c7aa-9d27-43a1-a1bd-57c5a56c576a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:57.002559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436c7aa-9d27-43a1-a1bd-57c5a56c576a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:57.008035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 473/954] 10.222.0.73 () {56 vars in 1122 bytes} [Wed May 4 13:35:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:57.013608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38bc8a-1e58-4bc0-bd58-34f6bf5fbe16 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:57.121121 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38bc8a-1e58-4bc0-bd58-34f6bf5fbe16 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:57.157406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3178f6d-0bf2-433f-ab34-11fa786f9a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:57.158084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3178f6d-0bf2-433f-ab34-11fa786f9a46 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:57.158362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3178f6d-0bf2-433f-ab34-11fa786f9a46 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:57.158634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3178f6d-0bf2-433f-ab34-11fa786f9a46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:57.159633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3178f6d-0bf2-433f-ab34-11fa786f9a46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:57.161002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3178f6d-0bf2-433f-ab34-11fa786f9a46 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:57.166535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e007495-f872-4a01-90f2-e7962d0d329a None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:57.166971 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e007495-f872-4a01-90f2-e7962d0d329a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:57.167429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e007495-f872-4a01-90f2-e7962d0d329a None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:57.175497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 474/955] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:57.177748 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7e995-c07d-410f-bf35-f311eeb38c85 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:57.178183 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7e995-c07d-410f-bf35-f311eeb38c85 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:57.178624 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7e995-c07d-410f-bf35-f311eeb38c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:57.181646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 482/956] 10.222.0.73 () {60 vars in 1144 bytes} [Wed May 4 13:35:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:35:57.200836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-d7c7e995-c07d-410f-bf35-f311eeb38c85 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:57.202234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d7c7e995-c07d-410f-bf35-f311eeb38c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:57.286589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 475/957] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:57.308596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3178f6d-0bf2-433f-ab34-11fa786f9a46 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:57.415222 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3178f6d-0bf2-433f-ab34-11fa786f9a46 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:57.449541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d1af7-a95e-4748-8dd0-0e7b40defde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:57.450383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d1af7-a95e-4748-8dd0-0e7b40defde3 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:57.451179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d1af7-a95e-4748-8dd0-0e7b40defde3 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:57.451490 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d1af7-a95e-4748-8dd0-0e7b40defde3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:57.452149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d1af7-a95e-4748-8dd0-0e7b40defde3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:57.453504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d1af7-a95e-4748-8dd0-0e7b40defde3 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-da5d1af7-a95e-4748-8dd0-0e7b40defde3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:57.465265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:57.467688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:57.469721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 483/958] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:35:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:57.478375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7e995-c07d-410f-bf35-f311eeb38c85 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:57.582708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7e995-c07d-410f-bf35-f311eeb38c85 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:57.617894 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdf67c-3847-4c27-acdd-d4b000849a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:57.618917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdf67c-3847-4c27-acdd-d4b000849a52 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:57.619409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdf67c-3847-4c27-acdd-d4b000849a52 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:57.619886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdf67c-3847-4c27-acdd-d4b000849a52 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:57.620781 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdf67c-3847-4c27-acdd-d4b000849a52 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:57.621283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdf67c-3847-4c27-acdd-d4b000849a52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:57.623408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdf67c-3847-4c27-acdd-d4b000849a52 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:57.628743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 476/959] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:35:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:57.634515 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d1af7-a95e-4748-8dd0-0e7b40defde3 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:57.737264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d1af7-a95e-4748-8dd0-0e7b40defde3 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:57.772033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b9c8d-fc1e-4d72-ac4d-0f42e7dbce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:57.773003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b9c8d-fc1e-4d72-ac4d-0f42e7dbce98 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:57.773467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b9c8d-fc1e-4d72-ac4d-0f42e7dbce98 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:57.773945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b9c8d-fc1e-4d72-ac4d-0f42e7dbce98 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:57.774837 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b9c8d-fc1e-4d72-ac4d-0f42e7dbce98 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:57.775354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b9c8d-fc1e-4d72-ac4d-0f42e7dbce98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:57.776908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b9c8d-fc1e-4d72-ac4d-0f42e7dbce98 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:57.782043 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 484/960] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:35:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:58.441392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90941a4f-f834-436e-9e31-f337aedc3f57 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:58.441780 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90941a4f-f834-436e-9e31-f337aedc3f57 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:58.441980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90941a4f-f834-436e-9e31-f337aedc3f57 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:58.443639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 477/961] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:58.449172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1d628-414b-461e-82ca-3f96d8caff04 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:58.449667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1d628-414b-461e-82ca-3f96d8caff04 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:58.449750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1d628-414b-461e-82ca-3f96d8caff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:58.467355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-56c1d628-414b-461e-82ca-3f96d8caff04 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:58.468526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-56c1d628-414b-461e-82ca-3f96d8caff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:58.550249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 485/962] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:35:58.577615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90941a4f-f834-436e-9e31-f337aedc3f57 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:58.683244 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90941a4f-f834-436e-9e31-f337aedc3f57 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:58.719994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170975b-b092-4851-926d-165db88271be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:58.721066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170975b-b092-4851-926d-165db88271be None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:58.721555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170975b-b092-4851-926d-165db88271be None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:58.722088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170975b-b092-4851-926d-165db88271be None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:58.723043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170975b-b092-4851-926d-165db88271be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:58.724752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170975b-b092-4851-926d-165db88271be None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:58.739992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.sql.core [None req-3170975b-b092-4851-926d-165db88271be None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 13:35:58.739992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 13:35:58.739992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [parameters: {'user_id': 'db6e9a06148f430ca86fab9f6489804f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 13:35:58.739992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86422) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-3170975b-b092-4851-926d-165db88271be None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application result = self._query(query) May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application conn.query(q) May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application result.read() May 04 13:35:58.748747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 13:35:58.749625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application next(self.gen) May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application yield resource May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application next(self.gen) May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self.session.rollback() May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self.force_reraise() May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise self.value May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application session.commit() May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 13:35:58.750599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._prepare_impl() May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self.session.flush() May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._flush(objects) May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application compat.raise_( May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application flush_context.execute() May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rec.execute(self) May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 13:35:58.751534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application result = connection._execute_20( May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 13:35:58.752439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application result = self._query(query) May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application conn.query(q) May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application result.read() May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 13:35:58.753291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [parameters: {'user_id': 'db6e9a06148f430ca86fab9f6489804f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:58.754138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 04 13:35:58.754960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 04 13:35:58.757922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 04 13:35:58.757922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 04 13:35:58.757922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 13:35:58.757922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 13:35:58.757922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 13:35:58.757922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:58.760446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 478/963] 10.222.0.73 () {60 vars in 1131 bytes} [Wed May 4 13:35:58 2022] POST /identity/v3/users => generated 160 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:58.772444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1d628-414b-461e-82ca-3f96d8caff04 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:58.894985 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1d628-414b-461e-82ca-3f96d8caff04 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:58.931877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8becf0f-4ec4-49ca-8c7e-69237f3d6a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:58.933072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becf0f-4ec4-49ca-8c7e-69237f3d6a1f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:58.933560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becf0f-4ec4-49ca-8c7e-69237f3d6a1f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:58.934060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8becf0f-4ec4-49ca-8c7e-69237f3d6a1f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:58.942291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8becf0f-4ec4-49ca-8c7e-69237f3d6a1f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:58.944141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8becf0f-4ec4-49ca-8c7e-69237f3d6a1f None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-b8becf0f-4ec4-49ca-8c7e-69237f3d6a1f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:58.959791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:58.960762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:58.961717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:58.961717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:58.961717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:58.961717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:58.961717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:58.961717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:58.961717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:58.961717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:58.961717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 13:35:58.961717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:58.964367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 486/964] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:35:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:58.973516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170975b-b092-4851-926d-165db88271be None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:58.973689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa2c2f-9dda-495a-85f8-bda19d317684 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:58.973689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa2c2f-9dda-495a-85f8-bda19d317684 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:58.973689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa2c2f-9dda-495a-85f8-bda19d317684 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:58.974373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 487/965] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:35:58.979453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02163fdd-c9eb-44b8-ae8c-69b6e5582941 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:58.979743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02163fdd-c9eb-44b8-ae8c-69b6e5582941 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:58.980022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02163fdd-c9eb-44b8-ae8c-69b6e5582941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:59.001362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-02163fdd-c9eb-44b8-ae8c-69b6e5582941 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:59.002894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-02163fdd-c9eb-44b8-ae8c-69b6e5582941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:59.080747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 488/966] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:35:59.081525 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170975b-b092-4851-926d-165db88271be None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:59.103453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02163fdd-c9eb-44b8-ae8c-69b6e5582941 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:59.119474 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3d0ac-4557-410a-8ae7-918feba66973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:59.120146 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3d0ac-4557-410a-8ae7-918feba66973 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:59.120428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3d0ac-4557-410a-8ae7-918feba66973 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:59.120704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3d0ac-4557-410a-8ae7-918feba66973 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:59.121504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3d0ac-4557-410a-8ae7-918feba66973 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:59.121811 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3d0ac-4557-410a-8ae7-918feba66973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:59.124139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3d0ac-4557-410a-8ae7-918feba66973 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:59.166615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 479/967] 10.222.0.73 () {56 vars in 1101 bytes} [Wed May 4 13:35:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:59.225224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02163fdd-c9eb-44b8-ae8c-69b6e5582941 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:59.270791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43924e-b7db-4796-bef2-95639c01c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:59.272093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43924e-b7db-4796-bef2-95639c01c620 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:59.272614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43924e-b7db-4796-bef2-95639c01c620 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:59.273114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43924e-b7db-4796-bef2-95639c01c620 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:59.285170 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43924e-b7db-4796-bef2-95639c01c620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-7b43924e-b7db-4796-bef2-95639c01c620 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:35:59.293893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:59.295505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:59.296375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:59.296375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:59.296375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:59.296375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:59.296375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:35:59.296375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:35:59.296375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:35:59.296375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:35:59.296375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:35:59.296375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:35:59.296375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:35:59.296375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:59.299338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 489/968] 10.222.0.73 () {56 vars in 1120 bytes} [Wed May 4 13:35:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:59.307265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3d0ac-4557-410a-8ae7-918feba66973 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:59.426412 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3d0ac-4557-410a-8ae7-918feba66973 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:59.460268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b27817-ef21-4c53-aa96-27c284c446df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:59.460948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b27817-ef21-4c53-aa96-27c284c446df None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:59.461226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b27817-ef21-4c53-aa96-27c284c446df None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:59.461505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b27817-ef21-4c53-aa96-27c284c446df None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:59.462255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b27817-ef21-4c53-aa96-27c284c446df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:59.462564 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b27817-ef21-4c53-aa96-27c284c446df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:59.463984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b27817-ef21-4c53-aa96-27c284c446df None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:59.474540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 480/969] 10.222.0.73 () {56 vars in 1115 bytes} [Wed May 4 13:35:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:59.480296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43924e-b7db-4796-bef2-95639c01c620 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:59.506219 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98014-f532-4bf4-82a9-748b6165c610 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:59.506527 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98014-f532-4bf4-82a9-748b6165c610 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:59.506786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98014-f532-4bf4-82a9-748b6165c610 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:59.508644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 481/970] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:35:59.513758 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a348-d14a-4de7-b0c9-effd38fb8ca5 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:59.514194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a348-d14a-4de7-b0c9-effd38fb8ca5 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:59.514476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a348-d14a-4de7-b0c9-effd38fb8ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:59.531559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-3204a348-d14a-4de7-b0c9-effd38fb8ca5 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:35:59.533076 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3204a348-d14a-4de7-b0c9-effd38fb8ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:35:59.593048 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43924e-b7db-4796-bef2-95639c01c620 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:59.615526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 482/971] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:35:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:35:59.625776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a0b81-2562-4738-8cf9-60a8b43883a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:59.626633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a0b81-2562-4738-8cf9-60a8b43883a5 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:59.626919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a0b81-2562-4738-8cf9-60a8b43883a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:59.627101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204a348-d14a-4de7-b0c9-effd38fb8ca5 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:59.627250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a0b81-2562-4738-8cf9-60a8b43883a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:59.638757 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a0b81-2562-4738-8cf9-60a8b43883a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:59.640227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a0b81-2562-4738-8cf9-60a8b43883a5 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-ca0a0b81-2562-4738-8cf9-60a8b43883a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:35:59.657581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:59.658539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:59.660199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:35:59.660199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:35:59.660199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:35:59.660199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:59.660199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 490/972] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:35:59.664206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a0b81-2562-4738-8cf9-60a8b43883a5 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:59.729069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204a348-d14a-4de7-b0c9-effd38fb8ca5 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:59.761706 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd021a8-25ca-477a-bd28-891424365f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:59.762511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd021a8-25ca-477a-bd28-891424365f62 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:59.763366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd021a8-25ca-477a-bd28-891424365f62 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:59.763628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd021a8-25ca-477a-bd28-891424365f62 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:59.763730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a0b81-2562-4738-8cf9-60a8b43883a5 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:59.764276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd021a8-25ca-477a-bd28-891424365f62 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:59.765649 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd021a8-25ca-477a-bd28-891424365f62 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-5dd021a8-25ca-477a-bd28-891424365f62 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:59.778165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:59.780505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:35:59.783324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 483/973] 10.222.0.73 () {56 vars in 1126 bytes} [Wed May 4 13:35:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:59.786165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd021a8-25ca-477a-bd28-891424365f62 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:59.798850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68393-275d-4a70-93fe-a4936cd3cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:59.799603 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68393-275d-4a70-93fe-a4936cd3cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:59.799882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68393-275d-4a70-93fe-a4936cd3cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:59.800158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68393-275d-4a70-93fe-a4936cd3cfd6 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:59.800870 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee68393-275d-4a70-93fe-a4936cd3cfd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:59.801170 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee68393-275d-4a70-93fe-a4936cd3cfd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:59.802535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee68393-275d-4a70-93fe-a4936cd3cfd6 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:59.813896 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 491/974] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:35:59.819146 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68393-275d-4a70-93fe-a4936cd3cfd6 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:59.881740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd021a8-25ca-477a-bd28-891424365f62 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:59.914886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35caa5-e7b8-4907-a3b9-9fd9a0ee3596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:59.915793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35caa5-e7b8-4907-a3b9-9fd9a0ee3596 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:59.916074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35caa5-e7b8-4907-a3b9-9fd9a0ee3596 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:59.916352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35caa5-e7b8-4907-a3b9-9fd9a0ee3596 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:59.916624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68393-275d-4a70-93fe-a4936cd3cfd6 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:35:59.917083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35caa5-e7b8-4907-a3b9-9fd9a0ee3596 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:35:59.917391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35caa5-e7b8-4907-a3b9-9fd9a0ee3596 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:59.918756 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35caa5-e7b8-4907-a3b9-9fd9a0ee3596 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:59.923491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 484/975] 10.222.0.73 () {56 vars in 1122 bytes} [Wed May 4 13:35:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:35:59.928954 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35caa5-e7b8-4907-a3b9-9fd9a0ee3596 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:35:59.952336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9506a9-43cc-4f7a-9a19-9a88bf13216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:35:59.954134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9506a9-43cc-4f7a-9a19-9a88bf13216b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:35:59.954844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9506a9-43cc-4f7a-9a19-9a88bf13216b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:35:59.955328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9506a9-43cc-4f7a-9a19-9a88bf13216b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:35:59.965994 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9506a9-43cc-4f7a-9a19-9a88bf13216b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:35:59.968448 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9506a9-43cc-4f7a-9a19-9a88bf13216b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-4b9506a9-43cc-4f7a-9a19-9a88bf13216b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:35:59.986132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:35:59.987122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:35:59.988096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:35:59.988096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:35:59.988096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:35:59.988096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:35:59.988096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:35:59.988096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:35:59.988096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:35:59.988096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:35:59.988096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 13:35:59.988096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:35:59.988096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 492/976] 10.222.0.73 () {56 vars in 1117 bytes} [Wed May 4 13:35:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:35:59.993002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9506a9-43cc-4f7a-9a19-9a88bf13216b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:00.031596 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35caa5-e7b8-4907-a3b9-9fd9a0ee3596 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:00.063628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cfeaf-c6dc-42b8-bbdf-f88c1ac10667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:00.064293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cfeaf-c6dc-42b8-bbdf-f88c1ac10667 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:00.064578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cfeaf-c6dc-42b8-bbdf-f88c1ac10667 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:00.064855 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cfeaf-c6dc-42b8-bbdf-f88c1ac10667 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:00.065557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cfeaf-c6dc-42b8-bbdf-f88c1ac10667 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:00.065871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cfeaf-c6dc-42b8-bbdf-f88c1ac10667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:00.067243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cfeaf-c6dc-42b8-bbdf-f88c1ac10667 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:00.072167 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 485/977] 10.222.0.73 () {56 vars in 1122 bytes} [Wed May 4 13:35:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:00.078345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cfeaf-c6dc-42b8-bbdf-f88c1ac10667 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:00.096509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9506a9-43cc-4f7a-9a19-9a88bf13216b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:00.129904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c9e73-233d-452e-8887-a83c29f801f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:00.130573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c9e73-233d-452e-8887-a83c29f801f5 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:00.130859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c9e73-233d-452e-8887-a83c29f801f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:00.131143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c9e73-233d-452e-8887-a83c29f801f5 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:00.132010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c9e73-233d-452e-8887-a83c29f801f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:00.132330 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c9e73-233d-452e-8887-a83c29f801f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:00.133741 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c9e73-233d-452e-8887-a83c29f801f5 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:00.151126 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 493/978] 10.222.0.73 () {56 vars in 1149 bytes} [Wed May 4 13:35:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:00.152468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cb047-45d2-4842-ab7c-d5364e1b385a None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:00.152757 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cb047-45d2-4842-ab7c-d5364e1b385a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:00.153035 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cb047-45d2-4842-ab7c-d5364e1b385a None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:00.154431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 494/979] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:00.156934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cb047-45d2-4842-ab7c-d5364e1b385a None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:00.173978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cfeaf-c6dc-42b8-bbdf-f88c1ac10667 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:00.206624 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790512d2-9c78-4554-97da-60b78fd08da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:00.207294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790512d2-9c78-4554-97da-60b78fd08da2 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:00.207580 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790512d2-9c78-4554-97da-60b78fd08da2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:00.207855 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790512d2-9c78-4554-97da-60b78fd08da2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:00.208644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790512d2-9c78-4554-97da-60b78fd08da2 None admin] RBAC: Adding query filter params (interface=admin, service_id=b66f745595bb4a578619c9011555e96b, region_id=RegionOne) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:00.208963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790512d2-9c78-4554-97da-60b78fd08da2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:00.210314 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790512d2-9c78-4554-97da-60b78fd08da2 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:00.215081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 486/980] 10.222.0.73 () {56 vars in 1249 bytes} [Wed May 4 13:36:00 2022] GET /identity/v3/endpoints?service_id=b66f745595bb4a578619c9011555e96b&interface=admin®ion_id=RegionOne => generated 193 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:00.216428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e1769-dc31-4c4d-a968-929cc7aed659 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:00.216720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e1769-dc31-4c4d-a968-929cc7aed659 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:00.216999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e1769-dc31-4c4d-a968-929cc7aed659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:00.233243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-320e1769-dc31-4c4d-a968-929cc7aed659 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:00.234405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-320e1769-dc31-4c4d-a968-929cc7aed659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:00.253904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cb047-45d2-4842-ab7c-d5364e1b385a None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:00.285804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226f1b7-ec2f-4fde-a434-2c937f6eb68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:00.286442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f1b7-ec2f-4fde-a434-2c937f6eb68f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:00.286726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f1b7-ec2f-4fde-a434-2c937f6eb68f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:00.286999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f1b7-ec2f-4fde-a434-2c937f6eb68f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:00.297276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 487/981] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:00.297276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e1769-dc31-4c4d-a968-929cc7aed659 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:00.358075 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226f1b7-ec2f-4fde-a434-2c937f6eb68f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:00.359536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226f1b7-ec2f-4fde-a434-2c937f6eb68f None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:00.393218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e1769-dc31-4c4d-a968-929cc7aed659 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:00.424486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13274c7e-84fd-46b8-8ad6-62831ff982d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:00.425140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13274c7e-84fd-46b8-8ad6-62831ff982d4 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:00.425422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13274c7e-84fd-46b8-8ad6-62831ff982d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:00.425697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13274c7e-84fd-46b8-8ad6-62831ff982d4 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:00.426370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13274c7e-84fd-46b8-8ad6-62831ff982d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:00.427763 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13274c7e-84fd-46b8-8ad6-62831ff982d4 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:00.433464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 488/982] 10.222.0.73 () {56 vars in 1087 bytes} [Wed May 4 13:36:00 2022] GET /identity/v3/services => generated 1497 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:36:00.434220 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13274c7e-84fd-46b8-8ad6-62831ff982d4 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:00.461355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 495/983] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:36:00 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 13:36:00.463017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226f1b7-ec2f-4fde-a434-2c937f6eb68f None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:00.540019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13274c7e-84fd-46b8-8ad6-62831ff982d4 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:00.565455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226f1b7-ec2f-4fde-a434-2c937f6eb68f None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:00.576068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cf4ce-c919-4a46-8f4e-b7c797e0d765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:00.576748 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cf4ce-c919-4a46-8f4e-b7c797e0d765 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:00.577037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cf4ce-c919-4a46-8f4e-b7c797e0d765 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:00.577316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cf4ce-c919-4a46-8f4e-b7c797e0d765 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:00.578048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cf4ce-c919-4a46-8f4e-b7c797e0d765 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:00.579465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cf4ce-c919-4a46-8f4e-b7c797e0d765 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:00.603235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 489/984] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:36:00 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:36:00.609739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872ccb4-8711-482b-9153-eaeb8c5fa00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:00.610567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872ccb4-8711-482b-9153-eaeb8c5fa00b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:00.610850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872ccb4-8711-482b-9153-eaeb8c5fa00b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:00.611124 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872ccb4-8711-482b-9153-eaeb8c5fa00b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:00.623542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872ccb4-8711-482b-9153-eaeb8c5fa00b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:00.625548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872ccb4-8711-482b-9153-eaeb8c5fa00b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-9872ccb4-8711-482b-9153-eaeb8c5fa00b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:36:00.645646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:00.646848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:00.647929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:36:00.647929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:36:00.647929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:00.647929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:00.647929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 496/985] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:00.653091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cf4ce-c919-4a46-8f4e-b7c797e0d765 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:00.757853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cf4ce-c919-4a46-8f4e-b7c797e0d765 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:00.792728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7288b-299f-4e44-86df-4bff7f21233b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:00.793317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7288b-299f-4e44-86df-4bff7f21233b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:00.793599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7288b-299f-4e44-86df-4bff7f21233b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:00.793877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7288b-299f-4e44-86df-4bff7f21233b None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:00.794656 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7288b-299f-4e44-86df-4bff7f21233b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:00.794981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7288b-299f-4e44-86df-4bff7f21233b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:00.796410 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7288b-299f-4e44-86df-4bff7f21233b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:00.808940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 490/986] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:00.814266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872ccb4-8711-482b-9153-eaeb8c5fa00b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:00.909825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872ccb4-8711-482b-9153-eaeb8c5fa00b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:00.941569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86073e8f-d2c7-4678-a7c1-30f2ec56e5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:00.942357 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86073e8f-d2c7-4678-a7c1-30f2ec56e5a1 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:00.942630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86073e8f-d2c7-4678-a7c1-30f2ec56e5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:00.942899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86073e8f-d2c7-4678-a7c1-30f2ec56e5a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:00.949565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86073e8f-d2c7-4678-a7c1-30f2ec56e5a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:00.951043 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86073e8f-d2c7-4678-a7c1-30f2ec56e5a1 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-86073e8f-d2c7-4678-a7c1-30f2ec56e5a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:36:00.964251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:00.965144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:00.966749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:36:00.966749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:36:00.966749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:36:00.966749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:36:00.966749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:36:00.966749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:36:00.966749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:36:00.966749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:00.966749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 497/987] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:00.971648 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7288b-299f-4e44-86df-4bff7f21233b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:01.066112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7288b-299f-4e44-86df-4bff7f21233b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:01.098511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbdd51-61b5-4a07-a77f-b7d8c160c350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:01.099167 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbdd51-61b5-4a07-a77f-b7d8c160c350 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:01.099478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbdd51-61b5-4a07-a77f-b7d8c160c350 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:01.099756 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbdd51-61b5-4a07-a77f-b7d8c160c350 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:01.100540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbdd51-61b5-4a07-a77f-b7d8c160c350 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:01.100851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbdd51-61b5-4a07-a77f-b7d8c160c350 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:01.102271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbdd51-61b5-4a07-a77f-b7d8c160c350 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:01.118725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 491/988] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:01.120356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86073e8f-d2c7-4678-a7c1-30f2ec56e5a1 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:01.215513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86073e8f-d2c7-4678-a7c1-30f2ec56e5a1 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:01.247992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0147c5-4064-4c6f-91a9-b2b34e3f3fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:01.248647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0147c5-4064-4c6f-91a9-b2b34e3f3fce None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:01.248929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0147c5-4064-4c6f-91a9-b2b34e3f3fce None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:01.249205 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0147c5-4064-4c6f-91a9-b2b34e3f3fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:01.250036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0147c5-4064-4c6f-91a9-b2b34e3f3fce None admin] RBAC: Adding query filter params (role.id=bfebc8d95b31401c8be316fd2a084797, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=631d619317354b76bf1535550a207b0d) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:01.250350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0147c5-4064-4c6f-91a9-b2b34e3f3fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:01.251798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0147c5-4064-4c6f-91a9-b2b34e3f3fce None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:01.259247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 498/989] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:36:01 2022] GET /identity/v3/role_assignments?user.id=631d619317354b76bf1535550a207b0d&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bfebc8d95b31401c8be316fd2a084797 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:02.708280 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185285a6-799b-4017-a104-6598a920b56e None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:02.708797 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185285a6-799b-4017-a104-6598a920b56e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:02.708797 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185285a6-799b-4017-a104-6598a920b56e None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:02.710274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 492/990] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:02.715351 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfda04-f13c-4cde-b3a5-841161daee20 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:02.715739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfda04-f13c-4cde-b3a5-841161daee20 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:02.715939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfda04-f13c-4cde-b3a5-841161daee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:02.733120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d7dfda04-f13c-4cde-b3a5-841161daee20 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:02.734299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d7dfda04-f13c-4cde-b3a5-841161daee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:02.801120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 499/991] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:02.824207 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185285a6-799b-4017-a104-6598a920b56e None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:02.859785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ec055-c737-45a6-ac90-45f84b8d7508 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:02.860075 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ec055-c737-45a6-ac90-45f84b8d7508 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:02.860348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ec055-c737-45a6-ac90-45f84b8d7508 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:02.861827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 500/992] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:02.866448 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffab70-5487-4054-872c-1102f16b311e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:02.866734 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffab70-5487-4054-872c-1102f16b311e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:02.867012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffab70-5487-4054-872c-1102f16b311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:02.883652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a4ffab70-5487-4054-872c-1102f16b311e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:02.884821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a4ffab70-5487-4054-872c-1102f16b311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:02.932059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185285a6-799b-4017-a104-6598a920b56e None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:02.949934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 501/993] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:36:02.967348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04fdda-d7ca-4f42-a23d-1e63dbe95c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:02.968421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04fdda-d7ca-4f42-a23d-1e63dbe95c86 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:02.968931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04fdda-d7ca-4f42-a23d-1e63dbe95c86 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:02.969399 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04fdda-d7ca-4f42-a23d-1e63dbe95c86 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:02.970259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04fdda-d7ca-4f42-a23d-1e63dbe95c86 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:02.972175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04fdda-d7ca-4f42-a23d-1e63dbe95c86 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:02.972398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffab70-5487-4054-872c-1102f16b311e None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-bf04fdda-d7ca-4f42-a23d-1e63dbe95c86 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:02.985832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:02.986872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 13:36:02.987735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:02.988883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 493/994] 10.222.0.73 () {56 vars in 1126 bytes} [Wed May 4 13:36:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:02.994170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04fdda-d7ca-4f42-a23d-1e63dbe95c86 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:03.073042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffab70-5487-4054-872c-1102f16b311e None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:03.092845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04fdda-d7ca-4f42-a23d-1e63dbe95c86 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:03.107882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703179a0-6668-4054-aee6-685f9421735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:03.108677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703179a0-6668-4054-aee6-685f9421735e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:03.108952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703179a0-6668-4054-aee6-685f9421735e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:03.109221 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703179a0-6668-4054-aee6-685f9421735e None admin] PATH_INFO: `/v3/services/compute` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:03.109890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703179a0-6668-4054-aee6-685f9421735e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:03.111245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703179a0-6668-4054-aee6-685f9421735e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-703179a0-6668-4054-aee6-685f9421735e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:03.123249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:03.127264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:03.128355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 502/995] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:36:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:03.130857 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703179a0-6668-4054-aee6-685f9421735e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:03.132368 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8e335-62b5-4146-a973-e59a4610ee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:03.133096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8e335-62b5-4146-a973-e59a4610ee74 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:03.133376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8e335-62b5-4146-a973-e59a4610ee74 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:03.133679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8e335-62b5-4146-a973-e59a4610ee74 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:03.134387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8e335-62b5-4146-a973-e59a4610ee74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:03.134697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8e335-62b5-4146-a973-e59a4610ee74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:03.136091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8e335-62b5-4146-a973-e59a4610ee74 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:03.141059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 494/996] 10.222.0.73 () {56 vars in 1122 bytes} [Wed May 4 13:36:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:03.146521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8e335-62b5-4146-a973-e59a4610ee74 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:03.232353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703179a0-6668-4054-aee6-685f9421735e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:03.244825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8e335-62b5-4146-a973-e59a4610ee74 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:03.265331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ec322-11e0-48e4-a500-2f8af3895e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:03.265993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ec322-11e0-48e4-a500-2f8af3895e41 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:03.266275 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ec322-11e0-48e4-a500-2f8af3895e41 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:03.266548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ec322-11e0-48e4-a500-2f8af3895e41 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:03.267278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ec322-11e0-48e4-a500-2f8af3895e41 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:03.267605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ec322-11e0-48e4-a500-2f8af3895e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:03.269040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ec322-11e0-48e4-a500-2f8af3895e41 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:03.273920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 503/997] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:36:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:03.278622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea022b-aff1-42b2-a56b-570fddd4c083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:03.279291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ec322-11e0-48e4-a500-2f8af3895e41 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:03.279392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea022b-aff1-42b2-a56b-570fddd4c083 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:03.279650 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea022b-aff1-42b2-a56b-570fddd4c083 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:03.279865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea022b-aff1-42b2-a56b-570fddd4c083 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:03.280572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea022b-aff1-42b2-a56b-570fddd4c083 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:03.280874 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea022b-aff1-42b2-a56b-570fddd4c083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:03.282226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea022b-aff1-42b2-a56b-570fddd4c083 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:03.291546 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 495/998] 10.222.0.73 () {56 vars in 1122 bytes} [Wed May 4 13:36:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:03.292726 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea022b-aff1-42b2-a56b-570fddd4c083 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:03.387155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ec322-11e0-48e4-a500-2f8af3895e41 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:03.393519 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea022b-aff1-42b2-a56b-570fddd4c083 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:03.420399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129f279-ec40-4828-9f5f-7e33365a2d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:03.421062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129f279-ec40-4828-9f5f-7e33365a2d5a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:03.421345 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129f279-ec40-4828-9f5f-7e33365a2d5a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:03.421621 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129f279-ec40-4828-9f5f-7e33365a2d5a None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:03.422323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129f279-ec40-4828-9f5f-7e33365a2d5a None admin] RBAC: Adding query filter params (type=compute) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:03.422627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129f279-ec40-4828-9f5f-7e33365a2d5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:03.424006 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129f279-ec40-4828-9f5f-7e33365a2d5a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:03.428057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f877d5-6cb7-4cb0-b212-0ac2094fdacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:03.428698 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 504/999] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:36:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:03.429086 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f877d5-6cb7-4cb0-b212-0ac2094fdacd None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:03.429538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f877d5-6cb7-4cb0-b212-0ac2094fdacd None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:03.430016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f877d5-6cb7-4cb0-b212-0ac2094fdacd None admin] PATH_INFO: `/v3/endpoints` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:03.430891 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f877d5-6cb7-4cb0-b212-0ac2094fdacd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:03.432414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f877d5-6cb7-4cb0-b212-0ac2094fdacd None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:03.434335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129f279-ec40-4828-9f5f-7e33365a2d5a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:03.459422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 496/1000] 10.222.0.73 () {60 vars in 1144 bytes} [Wed May 4 13:36:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:36:03.545155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143531aa-3a09-4c82-929b-ee5caace6287 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:03.545494 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143531aa-3a09-4c82-929b-ee5caace6287 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:03.545717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143531aa-3a09-4c82-929b-ee5caace6287 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:03.551255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 497/1001] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:36:03.552072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129f279-ec40-4828-9f5f-7e33365a2d5a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:03.552686 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad407528-14dc-4d5f-9379-60362e5a9169 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:03.552975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad407528-14dc-4d5f-9379-60362e5a9169 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:03.553252 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad407528-14dc-4d5f-9379-60362e5a9169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:03.570974 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-ad407528-14dc-4d5f-9379-60362e5a9169 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:03.572200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ad407528-14dc-4d5f-9379-60362e5a9169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:03.597002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002c404-1e1f-44e2-89ea-813e8a3f8b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:03.597664 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002c404-1e1f-44e2-89ea-813e8a3f8b81 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:03.597945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002c404-1e1f-44e2-89ea-813e8a3f8b81 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:03.598219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002c404-1e1f-44e2-89ea-813e8a3f8b81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:03.599011 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002c404-1e1f-44e2-89ea-813e8a3f8b81 None admin] RBAC: Adding query filter params (interface=public, service_id=dff6e176c1cf4d30991d47b145184ebe, region_id=RegionOne) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:03.599365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002c404-1e1f-44e2-89ea-813e8a3f8b81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:03.600748 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002c404-1e1f-44e2-89ea-813e8a3f8b81 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:03.611422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 505/1002] 10.222.0.73 () {56 vars in 1251 bytes} [Wed May 4 13:36:03 2022] GET /identity/v3/endpoints?service_id=dff6e176c1cf4d30991d47b145184ebe&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:03.612204 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002c404-1e1f-44e2-89ea-813e8a3f8b81 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:03.643487 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 498/1003] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:03 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:03.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad407528-14dc-4d5f-9379-60362e5a9169 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:03.716168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002c404-1e1f-44e2-89ea-813e8a3f8b81 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:03.750920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acf586-d430-4942-a5a4-d651b977f96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:03.751614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acf586-d430-4942-a5a4-d651b977f96b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:03.751893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acf586-d430-4942-a5a4-d651b977f96b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:03.752172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acf586-d430-4942-a5a4-d651b977f96b None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:03.752839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acf586-d430-4942-a5a4-d651b977f96b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:03.754182 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acf586-d430-4942-a5a4-d651b977f96b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:03.771241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 506/1004] 10.222.0.73 () {56 vars in 1087 bytes} [Wed May 4 13:36:03 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:36:03.771478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad407528-14dc-4d5f-9379-60362e5a9169 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:03.805914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89d862-858c-4837-a048-9638253fa116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:03.806638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89d862-858c-4837-a048-9638253fa116 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:03.806920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89d862-858c-4837-a048-9638253fa116 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:03.807193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89d862-858c-4837-a048-9638253fa116 None admin] PATH_INFO: `/v3/services/image` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:03.807879 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89d862-858c-4837-a048-9638253fa116 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:03.809254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89d862-858c-4837-a048-9638253fa116 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-8e89d862-858c-4837-a048-9638253fa116 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:03.822370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:03.823473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:03.829406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 499/1005] 10.222.0.73 () {56 vars in 1105 bytes} [Wed May 4 13:36:03 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:03.832417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acf586-d430-4942-a5a4-d651b977f96b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:03.935634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acf586-d430-4942-a5a4-d651b977f96b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:03.969206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27a4b0-5377-442d-869d-a1fbcf4b0592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:03.969870 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27a4b0-5377-442d-869d-a1fbcf4b0592 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:03.970146 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27a4b0-5377-442d-869d-a1fbcf4b0592 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:03.970415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27a4b0-5377-442d-869d-a1fbcf4b0592 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:03.971115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27a4b0-5377-442d-869d-a1fbcf4b0592 None admin] RBAC: Adding query filter params (name=image) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:03.971441 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27a4b0-5377-442d-869d-a1fbcf4b0592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:03.972780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27a4b0-5377-442d-869d-a1fbcf4b0592 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:03.977519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 507/1006] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:03.983704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89d862-858c-4837-a048-9638253fa116 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:04.077899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89d862-858c-4837-a048-9638253fa116 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:04.110951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98cf9d-51a4-4080-91d3-84e0bf229866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:04.111635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98cf9d-51a4-4080-91d3-84e0bf229866 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:04.111921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98cf9d-51a4-4080-91d3-84e0bf229866 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:04.112194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98cf9d-51a4-4080-91d3-84e0bf229866 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:04.112888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98cf9d-51a4-4080-91d3-84e0bf229866 None admin] RBAC: Adding query filter params (type=image) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:04.113190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98cf9d-51a4-4080-91d3-84e0bf229866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:04.114538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98cf9d-51a4-4080-91d3-84e0bf229866 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:04.119318 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 500/1007] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:05.726827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd46166-1cdd-4eda-adef-f57d5d1dce7d None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:05.727367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd46166-1cdd-4eda-adef-f57d5d1dce7d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:05.727367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd46166-1cdd-4eda-adef-f57d5d1dce7d None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:05.728807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 508/1008] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:05.734323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3234e4-a7aa-467d-84a6-b5d93518bbab None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:05.734718 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3234e4-a7aa-467d-84a6-b5d93518bbab None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:05.734877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3234e4-a7aa-467d-84a6-b5d93518bbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:05.751263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-2c3234e4-a7aa-467d-84a6-b5d93518bbab None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:05.752422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2c3234e4-a7aa-467d-84a6-b5d93518bbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:05.818002 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 501/1009] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:05.842623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd46166-1cdd-4eda-adef-f57d5d1dce7d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:05.943576 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd46166-1cdd-4eda-adef-f57d5d1dce7d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:05.978412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dd45d-7832-499f-99f4-dbfb11fadb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:05.979128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dd45d-7832-499f-99f4-dbfb11fadb51 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:05.979435 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dd45d-7832-499f-99f4-dbfb11fadb51 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:05.979705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dd45d-7832-499f-99f4-dbfb11fadb51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:05.980859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dd45d-7832-499f-99f4-dbfb11fadb51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:05.982302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dd45d-7832-499f-99f4-dbfb11fadb51 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:05.991626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 509/1010] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:05.991790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3234e4-a7aa-467d-84a6-b5d93518bbab None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:05.999794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e6dd5-ad6f-42fc-b496-9defe8461666 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:06.000444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e6dd5-ad6f-42fc-b496-9defe8461666 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:06.000725 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e6dd5-ad6f-42fc-b496-9defe8461666 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:06.002209 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 510/1011] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:36:06.007031 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff18ba5-d9d9-432d-8ea5-058727e31e66 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:06.007340 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff18ba5-d9d9-432d-8ea5-058727e31e66 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:06.007669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff18ba5-d9d9-432d-8ea5-058727e31e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:06.024268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-4ff18ba5-d9d9-432d-8ea5-058727e31e66 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:06.025424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4ff18ba5-d9d9-432d-8ea5-058727e31e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:06.087524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3234e4-a7aa-467d-84a6-b5d93518bbab None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:06.093199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 511/1012] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:36:06.115321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff18ba5-d9d9-432d-8ea5-058727e31e66 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:06.120323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc47023-01be-42c6-8f1f-9882221a52f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:06.120984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc47023-01be-42c6-8f1f-9882221a52f1 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:06.121264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc47023-01be-42c6-8f1f-9882221a52f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:06.121539 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc47023-01be-42c6-8f1f-9882221a52f1 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:06.122788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc47023-01be-42c6-8f1f-9882221a52f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:06.124264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc47023-01be-42c6-8f1f-9882221a52f1 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:06.159241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 502/1013] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:36:05 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:36:06.222510 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff18ba5-d9d9-432d-8ea5-058727e31e66 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:06.258838 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e731d-f702-47bd-a61f-83e2be0e8627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:06.260041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e731d-f702-47bd-a61f-83e2be0e8627 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:06.260535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e731d-f702-47bd-a61f-83e2be0e8627 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:06.260989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e731d-f702-47bd-a61f-83e2be0e8627 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:06.261832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e731d-f702-47bd-a61f-83e2be0e8627 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:06.263986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e731d-f702-47bd-a61f-83e2be0e8627 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-290e731d-f702-47bd-a61f-83e2be0e8627 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:06.276789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:06.277970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 13:36:06.278961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:06.283385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 512/1014] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:36:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:06.285833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc47023-01be-42c6-8f1f-9882221a52f1 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:06.356408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00543077-0f4b-4fa4-9927-8499a8b4da98 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:06.356874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00543077-0f4b-4fa4-9927-8499a8b4da98 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:06.356990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00543077-0f4b-4fa4-9927-8499a8b4da98 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:06.358345 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 513/1015] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:36:06.363595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c085cf-5348-4f96-99cd-545cb4cbb805 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:06.363879 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c085cf-5348-4f96-99cd-545cb4cbb805 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:06.364156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c085cf-5348-4f96-99cd-545cb4cbb805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:06.383904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-52c085cf-5348-4f96-99cd-545cb4cbb805 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:06.385084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-52c085cf-5348-4f96-99cd-545cb4cbb805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:06.403373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc47023-01be-42c6-8f1f-9882221a52f1 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:06.435754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db731cc-c078-4f75-a888-726dc7f1078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:06.436420 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db731cc-c078-4f75-a888-726dc7f1078a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:06.436701 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db731cc-c078-4f75-a888-726dc7f1078a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:06.436972 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db731cc-c078-4f75-a888-726dc7f1078a None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:06.437674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db731cc-c078-4f75-a888-726dc7f1078a None admin] RBAC: Adding query filter params (name=compute) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:06.437977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db731cc-c078-4f75-a888-726dc7f1078a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:06.439358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db731cc-c078-4f75-a888-726dc7f1078a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:06.444158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 503/1016] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:36:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:06.449770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db731cc-c078-4f75-a888-726dc7f1078a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:06.454537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 514/1017] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:06.477219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c085cf-5348-4f96-99cd-545cb4cbb805 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:06.543843 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db731cc-c078-4f75-a888-726dc7f1078a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:06.574956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c085cf-5348-4f96-99cd-545cb4cbb805 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:06.576866 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd3330-225f-42ad-bb7d-1b1c99dc9706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:06.577779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd3330-225f-42ad-bb7d-1b1c99dc9706 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:06.578318 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd3330-225f-42ad-bb7d-1b1c99dc9706 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:06.578794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd3330-225f-42ad-bb7d-1b1c99dc9706 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:06.579771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd3330-225f-42ad-bb7d-1b1c99dc9706 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:06.580281 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd3330-225f-42ad-bb7d-1b1c99dc9706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:06.581841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd3330-225f-42ad-bb7d-1b1c99dc9706 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:06.586781 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 504/1018] 10.222.0.73 () {56 vars in 1112 bytes} [Wed May 4 13:36:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:06.592318 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd3330-225f-42ad-bb7d-1b1c99dc9706 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:06.610585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adaa4c-be6e-4125-a28f-06e6817565ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:06.611320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adaa4c-be6e-4125-a28f-06e6817565ee None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:06.611607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adaa4c-be6e-4125-a28f-06e6817565ee None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:06.611879 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adaa4c-be6e-4125-a28f-06e6817565ee None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:06.612603 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adaa4c-be6e-4125-a28f-06e6817565ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:06.614078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8adaa4c-be6e-4125-a28f-06e6817565ee None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:06.643234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 515/1019] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:36:06 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:36:06.704968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd3330-225f-42ad-bb7d-1b1c99dc9706 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:06.748995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08138074-6b2e-4e3c-96b0-0614f4919441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:06.749653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08138074-6b2e-4e3c-96b0-0614f4919441 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:06.749930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08138074-6b2e-4e3c-96b0-0614f4919441 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:06.750203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08138074-6b2e-4e3c-96b0-0614f4919441 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:06.750937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08138074-6b2e-4e3c-96b0-0614f4919441 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:06.752350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08138074-6b2e-4e3c-96b0-0614f4919441 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:06.775248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 505/1020] 10.222.0.73 () {60 vars in 1144 bytes} [Wed May 4 13:36:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:36:08.499897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2a2c0-0e26-41bb-a210-e57be7301dcf None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:08.500455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2a2c0-0e26-41bb-a210-e57be7301dcf None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:08.500455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2a2c0-0e26-41bb-a210-e57be7301dcf None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:08.501878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 516/1021] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:08.507618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03fe2f-6425-43ad-84a5-a6bc06c2b906 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:08.508079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03fe2f-6425-43ad-84a5-a6bc06c2b906 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:08.508306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03fe2f-6425-43ad-84a5-a6bc06c2b906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:08.525805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-ce03fe2f-6425-43ad-84a5-a6bc06c2b906 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:08.526972 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ce03fe2f-6425-43ad-84a5-a6bc06c2b906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:08.598808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 506/1022] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:08.622966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2a2c0-0e26-41bb-a210-e57be7301dcf None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:08.721801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2a2c0-0e26-41bb-a210-e57be7301dcf None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:08.754487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8c16-1a8c-4482-af8f-32e47deab6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:08.755302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8c16-1a8c-4482-af8f-32e47deab6a6 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:08.755582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8c16-1a8c-4482-af8f-32e47deab6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:08.755850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8c16-1a8c-4482-af8f-32e47deab6a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:08.757019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b8c16-1a8c-4482-af8f-32e47deab6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:08.758422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b8c16-1a8c-4482-af8f-32e47deab6a6 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:08.760246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 517/1023] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:08.766163 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03fe2f-6425-43ad-84a5-a6bc06c2b906 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:08.864461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03fe2f-6425-43ad-84a5-a6bc06c2b906 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:08.896352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613e584-13de-4163-ac61-2b7832cae011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:08.897015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613e584-13de-4163-ac61-2b7832cae011 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:08.897290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613e584-13de-4163-ac61-2b7832cae011 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:08.897559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613e584-13de-4163-ac61-2b7832cae011 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:08.898268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613e584-13de-4163-ac61-2b7832cae011 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:08.899712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613e584-13de-4163-ac61-2b7832cae011 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:08.921584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 507/1024] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:36:08 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:36:08.984995 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715668b6-4ea9-4580-a877-1440beade9c7 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:08.985334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715668b6-4ea9-4580-a877-1440beade9c7 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:08.985559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715668b6-4ea9-4580-a877-1440beade9c7 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:08.987327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 518/1025] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:08.993343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c3c13-8cb4-4874-b6d1-637f6891f1c8 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:08.993661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c3c13-8cb4-4874-b6d1-637f6891f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:08.993912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c3c13-8cb4-4874-b6d1-637f6891f1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:09.012213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-499c3c13-8cb4-4874-b6d1-637f6891f1c8 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:09.013979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-499c3c13-8cb4-4874-b6d1-637f6891f1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:09.083525 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 508/1026] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:09.106519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715668b6-4ea9-4580-a877-1440beade9c7 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:09.179905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb1bc4-d2c2-4e40-836f-75611572f382 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:09.180494 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb1bc4-d2c2-4e40-836f-75611572f382 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:09.180775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb1bc4-d2c2-4e40-836f-75611572f382 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:09.182207 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 509/1027] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:09.188217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e03ca-ea74-4446-ad49-1716511ae00a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:09.188506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e03ca-ea74-4446-ad49-1716511ae00a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:09.189253 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e03ca-ea74-4446-ad49-1716511ae00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:09.206483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-919e03ca-ea74-4446-ad49-1716511ae00a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:09.207677 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-919e03ca-ea74-4446-ad49-1716511ae00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:09.215287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715668b6-4ea9-4580-a877-1440beade9c7 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:09.248461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5d00e-7ed3-46e0-9a91-bc7c3d4a733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:09.249276 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5d00e-7ed3-46e0-9a91-bc7c3d4a733b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:09.249554 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5d00e-7ed3-46e0-9a91-bc7c3d4a733b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:09.249821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5d00e-7ed3-46e0-9a91-bc7c3d4a733b None admin] PATH_INFO: `/v3/services/image` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:09.250464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5d00e-7ed3-46e0-9a91-bc7c3d4a733b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:09.251837 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5d00e-7ed3-46e0-9a91-bc7c3d4a733b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-3cd5d00e-7ed3-46e0-9a91-bc7c3d4a733b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:09.263938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:09.265079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:36:09.265936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:09.270391 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 519/1028] 10.222.0.73 () {56 vars in 1105 bytes} [Wed May 4 13:36:09 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:09.271113 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5d00e-7ed3-46e0-9a91-bc7c3d4a733b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:09.275255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 510/1029] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:36:09.298597 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e03ca-ea74-4446-ad49-1716511ae00a None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:09.371411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5d00e-7ed3-46e0-9a91-bc7c3d4a733b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:09.404349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3bfb0-0977-46a6-a9a1-b799dc53c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:09.404679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e03ca-ea74-4446-ad49-1716511ae00a None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:09.405016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3bfb0-0977-46a6-a9a1-b799dc53c1cb None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:09.405301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3bfb0-0977-46a6-a9a1-b799dc53c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:09.405576 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3bfb0-0977-46a6-a9a1-b799dc53c1cb None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:09.406280 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3bfb0-0977-46a6-a9a1-b799dc53c1cb None admin] RBAC: Adding query filter params (name=image) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:09.406585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3bfb0-0977-46a6-a9a1-b799dc53c1cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:09.407968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3bfb0-0977-46a6-a9a1-b799dc53c1cb None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:09.412847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 520/1030] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:09.418219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3bfb0-0977-46a6-a9a1-b799dc53c1cb None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:09.441167 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b347c2-f562-41d0-98a1-2ce0799c7884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:09.442174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b347c2-f562-41d0-98a1-2ce0799c7884 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:09.442456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b347c2-f562-41d0-98a1-2ce0799c7884 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:09.442724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b347c2-f562-41d0-98a1-2ce0799c7884 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:09.453277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b347c2-f562-41d0-98a1-2ce0799c7884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-f3b347c2-f562-41d0-98a1-2ce0799c7884 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:36:09.461433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:09.462443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:09.463312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 511/1031] 10.222.0.73 () {56 vars in 1120 bytes} [Wed May 4 13:36:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:09.468380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b347c2-f562-41d0-98a1-2ce0799c7884 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:09.518739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3bfb0-0977-46a6-a9a1-b799dc53c1cb None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:09.555589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086f33-24c0-4700-a5d8-66d9d20aeb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:09.556262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086f33-24c0-4700-a5d8-66d9d20aeb9b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:09.556548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086f33-24c0-4700-a5d8-66d9d20aeb9b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:09.556825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086f33-24c0-4700-a5d8-66d9d20aeb9b None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:09.557533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc086f33-24c0-4700-a5d8-66d9d20aeb9b None admin] RBAC: Adding query filter params (type=image) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:09.557839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc086f33-24c0-4700-a5d8-66d9d20aeb9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:09.559245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc086f33-24c0-4700-a5d8-66d9d20aeb9b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:09.564786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 521/1032] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:09.567585 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b347c2-f562-41d0-98a1-2ce0799c7884 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:09.570465 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086f33-24c0-4700-a5d8-66d9d20aeb9b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:09.600022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf417e-a29b-4314-a33f-9006b017c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:09.600686 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf417e-a29b-4314-a33f-9006b017c047 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:09.601024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf417e-a29b-4314-a33f-9006b017c047 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:09.601306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf417e-a29b-4314-a33f-9006b017c047 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:09.602047 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf417e-a29b-4314-a33f-9006b017c047 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:09.602353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf417e-a29b-4314-a33f-9006b017c047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:09.603741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf417e-a29b-4314-a33f-9006b017c047 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:09.612021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 512/1033] 10.222.0.73 () {56 vars in 1115 bytes} [Wed May 4 13:36:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:09.617306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf417e-a29b-4314-a33f-9006b017c047 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:09.667842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086f33-24c0-4700-a5d8-66d9d20aeb9b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:09.701700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773967-be4e-425e-9d1a-11fb368062f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:09.702287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773967-be4e-425e-9d1a-11fb368062f5 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:09.702568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773967-be4e-425e-9d1a-11fb368062f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:09.702956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f773967-be4e-425e-9d1a-11fb368062f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:09.703698 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f773967-be4e-425e-9d1a-11fb368062f5 None admin] RBAC: Adding query filter params (interface=public, service_id=3c9c2ea51847423c9263f2ebec214ad3, region_id=RegionOne) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:09.703990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f773967-be4e-425e-9d1a-11fb368062f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:09.705375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f773967-be4e-425e-9d1a-11fb368062f5 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:09.710372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 522/1034] 10.222.0.73 () {56 vars in 1251 bytes} [Wed May 4 13:36:09 2022] GET /identity/v3/endpoints?service_id=3c9c2ea51847423c9263f2ebec214ad3&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:09.715733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773967-be4e-425e-9d1a-11fb368062f5 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:09.726700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf417e-a29b-4314-a33f-9006b017c047 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:09.759860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dc31c-10dc-4cf0-b862-155d52927150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:09.760646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dc31c-10dc-4cf0-b862-155d52927150 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:09.760924 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dc31c-10dc-4cf0-b862-155d52927150 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:09.761193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dc31c-10dc-4cf0-b862-155d52927150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:09.771553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dc31c-10dc-4cf0-b862-155d52927150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:09.772992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dc31c-10dc-4cf0-b862-155d52927150 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-ec1dc31c-10dc-4cf0-b862-155d52927150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:36:09.789370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:09.791802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:09.792851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:36:09.792851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:36:09.792851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:09.792851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:09.792851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 513/1035] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:09.796832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dc31c-10dc-4cf0-b862-155d52927150 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:09.817513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f773967-be4e-425e-9d1a-11fb368062f5 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:09.849671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5659091-4354-483e-b5e3-241560ec1583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:09.850329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5659091-4354-483e-b5e3-241560ec1583 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:09.850613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5659091-4354-483e-b5e3-241560ec1583 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:09.850884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5659091-4354-483e-b5e3-241560ec1583 None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:09.851589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5659091-4354-483e-b5e3-241560ec1583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:09.852928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5659091-4354-483e-b5e3-241560ec1583 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:09.859988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 523/1036] 10.222.0.73 () {56 vars in 1087 bytes} [Wed May 4 13:36:09 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:36:09.901464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dc31c-10dc-4cf0-b862-155d52927150 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:09.936728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225cba9-8436-475b-861f-7db3a3a08279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:09.937447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225cba9-8436-475b-861f-7db3a3a08279 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:09.937730 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225cba9-8436-475b-861f-7db3a3a08279 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:09.938001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225cba9-8436-475b-861f-7db3a3a08279 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:09.938733 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225cba9-8436-475b-861f-7db3a3a08279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:09.939036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225cba9-8436-475b-861f-7db3a3a08279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:09.940460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225cba9-8436-475b-861f-7db3a3a08279 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:09.958070 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 514/1037] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:09.959643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5659091-4354-483e-b5e3-241560ec1583 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:10.062452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5659091-4354-483e-b5e3-241560ec1583 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:10.094881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc807c9-bd5a-4972-9900-5c0031b5d5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:10.095705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc807c9-bd5a-4972-9900-5c0031b5d5fe None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:10.095984 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc807c9-bd5a-4972-9900-5c0031b5d5fe None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:10.096254 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc807c9-bd5a-4972-9900-5c0031b5d5fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:10.104326 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc807c9-bd5a-4972-9900-5c0031b5d5fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:10.105744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc807c9-bd5a-4972-9900-5c0031b5d5fe None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-5cc807c9-bd5a-4972-9900-5c0031b5d5fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:36:10.120374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:10.121498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:10.122492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:10.122492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:10.122492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:36:10.122492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:36:10.122492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:36:10.122492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:36:10.122492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:36:10.122492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:36:10.122492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:36:10.122492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:10.122492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 524/1038] 10.222.0.73 () {56 vars in 1093 bytes} [Wed May 4 13:36:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:10.129012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225cba9-8436-475b-861f-7db3a3a08279 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:10.223258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225cba9-8436-475b-861f-7db3a3a08279 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:10.255946 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4330b0-cda5-4ebb-86cf-0f3a4e7c43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:10.256612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4330b0-cda5-4ebb-86cf-0f3a4e7c43ee None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:10.256889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4330b0-cda5-4ebb-86cf-0f3a4e7c43ee None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:10.257160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4330b0-cda5-4ebb-86cf-0f3a4e7c43ee None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:10.257978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4330b0-cda5-4ebb-86cf-0f3a4e7c43ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:10.258282 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4330b0-cda5-4ebb-86cf-0f3a4e7c43ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:10.259712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4330b0-cda5-4ebb-86cf-0f3a4e7c43ee None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:10.281548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 515/1039] 10.222.0.73 () {56 vars in 1133 bytes} [Wed May 4 13:36:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:10.282820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc807c9-bd5a-4972-9900-5c0031b5d5fe None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:10.383071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc807c9-bd5a-4972-9900-5c0031b5d5fe None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:10.415471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9cdf9-40bc-4f4d-b804-094a5a4936f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:10.416114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9cdf9-40bc-4f4d-b804-094a5a4936f4 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:10.416395 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9cdf9-40bc-4f4d-b804-094a5a4936f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:10.416670 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9cdf9-40bc-4f4d-b804-094a5a4936f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:10.480652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9cdf9-40bc-4f4d-b804-094a5a4936f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:10.482059 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9cdf9-40bc-4f4d-b804-094a5a4936f4 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:10.580469 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 525/1040] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:36:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 13:36:10.581707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4330b0-cda5-4ebb-86cf-0f3a4e7c43ee None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:10.683124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4330b0-cda5-4ebb-86cf-0f3a4e7c43ee None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:10.717178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9c583-659a-4298-b6a7-575f8939e222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:10.717971 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9c583-659a-4298-b6a7-575f8939e222 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:10.718251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9c583-659a-4298-b6a7-575f8939e222 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:10.718526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9c583-659a-4298-b6a7-575f8939e222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:10.728448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9c583-659a-4298-b6a7-575f8939e222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:10.729899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9c583-659a-4298-b6a7-575f8939e222 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-a9c9c583-659a-4298-b6a7-575f8939e222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:36:10.746817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:10.748422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:10.749873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:36:10.749873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:36:10.749873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:10.749873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:10.749873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 516/1041] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:10.754151 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9cdf9-40bc-4f4d-b804-094a5a4936f4 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:10.849551 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9cdf9-40bc-4f4d-b804-094a5a4936f4 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:10.882255 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f1591-dc0d-4a63-afe8-7b89727a5e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:10.882917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1591-dc0d-4a63-afe8-7b89727a5e78 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:10.883213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1591-dc0d-4a63-afe8-7b89727a5e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:10.883506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f1591-dc0d-4a63-afe8-7b89727a5e78 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:10.884223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f1591-dc0d-4a63-afe8-7b89727a5e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:10.884530 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f1591-dc0d-4a63-afe8-7b89727a5e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:10.885892 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f1591-dc0d-4a63-afe8-7b89727a5e78 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:10.905128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 526/1042] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:10.906603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9c583-659a-4298-b6a7-575f8939e222 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:11.002908 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9c583-659a-4298-b6a7-575f8939e222 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:11.035286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716c4fa-e55a-43c3-b1cd-903cd39765e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:11.036062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716c4fa-e55a-43c3-b1cd-903cd39765e7 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:11.036338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716c4fa-e55a-43c3-b1cd-903cd39765e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:11.036604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716c4fa-e55a-43c3-b1cd-903cd39765e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:11.043039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716c4fa-e55a-43c3-b1cd-903cd39765e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:11.045202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716c4fa-e55a-43c3-b1cd-903cd39765e7 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-c716c4fa-e55a-43c3-b1cd-903cd39765e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:36:11.059029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:11.060846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:11.061745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:36:11.061745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:36:11.061745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:36:11.061745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:36:11.061745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:36:11.061745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:36:11.061745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:36:11.061745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:11.062803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 517/1043] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:11.066900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f1591-dc0d-4a63-afe8-7b89727a5e78 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:11.163903 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f1591-dc0d-4a63-afe8-7b89727a5e78 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:11.196631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031880c4-3690-4e94-affb-0e85fa0d5292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:11.197290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031880c4-3690-4e94-affb-0e85fa0d5292 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:11.197571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031880c4-3690-4e94-affb-0e85fa0d5292 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:11.197844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031880c4-3690-4e94-affb-0e85fa0d5292 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:11.198633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031880c4-3690-4e94-affb-0e85fa0d5292 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:11.198943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031880c4-3690-4e94-affb-0e85fa0d5292 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:11.200416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031880c4-3690-4e94-affb-0e85fa0d5292 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:11.212350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 527/1044] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:36:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:11.218234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716c4fa-e55a-43c3-b1cd-903cd39765e7 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:11.245625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ef192-fade-48af-9302-4a7dd79119c5 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:11.245907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ef192-fade-48af-9302-4a7dd79119c5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:11.246180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ef192-fade-48af-9302-4a7dd79119c5 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:11.248316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 528/1045] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:36:11.253039 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efa95b-a74d-4dde-ba26-3b92734e902b None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:11.253266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efa95b-a74d-4dde-ba26-3b92734e902b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:11.253535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efa95b-a74d-4dde-ba26-3b92734e902b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:11.269536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a1efa95b-a74d-4dde-ba26-3b92734e902b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:11.270716 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a1efa95b-a74d-4dde-ba26-3b92734e902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:11.320822 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716c4fa-e55a-43c3-b1cd-903cd39765e7 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:11.349474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 529/1046] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:36:11.357899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecffde0-4ee5-4fd6-8b13-36fb832133d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:11.358551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecffde0-4ee5-4fd6-8b13-36fb832133d2 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:11.358828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecffde0-4ee5-4fd6-8b13-36fb832133d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:11.359097 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecffde0-4ee5-4fd6-8b13-36fb832133d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:11.359972 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecffde0-4ee5-4fd6-8b13-36fb832133d2 None admin] RBAC: Adding query filter params (role.id=bfebc8d95b31401c8be316fd2a084797, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=10d07b370370461a90cab0b182938292) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:11.360279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecffde0-4ee5-4fd6-8b13-36fb832133d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:11.361686 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecffde0-4ee5-4fd6-8b13-36fb832133d2 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:11.367240 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 518/1047] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:36:11 2022] GET /identity/v3/role_assignments?user.id=10d07b370370461a90cab0b182938292&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bfebc8d95b31401c8be316fd2a084797 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:11.370653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efa95b-a74d-4dde-ba26-3b92734e902b None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:11.474538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efa95b-a74d-4dde-ba26-3b92734e902b None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:11.510314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b1e00-92f0-421a-bed3-da621badc55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:11.511520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1e00-92f0-421a-bed3-da621badc55a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:11.512030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1e00-92f0-421a-bed3-da621badc55a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:11.512521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1e00-92f0-421a-bed3-da621badc55a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:11.523764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b1e00-92f0-421a-bed3-da621badc55a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-862b1e00-92f0-421a-bed3-da621badc55a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:36:11.532519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:11.533546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:11.534399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:11.534399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:11.534399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:11.534399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:11.534399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:36:11.534399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:36:11.534399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:36:11.534399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:36:11.534399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:36:11.534399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:36:11.534399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:11.534399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:11.536827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 530/1048] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:36:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:11.542606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecffde0-4ee5-4fd6-8b13-36fb832133d2 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:11.641888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecffde0-4ee5-4fd6-8b13-36fb832133d2 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:11.674234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05941a4d-bb00-40df-8e87-c08bd910e7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:11.674902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05941a4d-bb00-40df-8e87-c08bd910e7c4 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:11.675184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05941a4d-bb00-40df-8e87-c08bd910e7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:11.675488 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05941a4d-bb00-40df-8e87-c08bd910e7c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:11.676225 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05941a4d-bb00-40df-8e87-c08bd910e7c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:11.676576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05941a4d-bb00-40df-8e87-c08bd910e7c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:11.678105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05941a4d-bb00-40df-8e87-c08bd910e7c4 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:11.690880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 519/1049] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:36:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:11.692138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b1e00-92f0-421a-bed3-da621badc55a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:11.790348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b1e00-92f0-421a-bed3-da621badc55a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:11.822342 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8080324-58e3-4e6a-abc4-dc891521a86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:11.823497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8080324-58e3-4e6a-abc4-dc891521a86d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:11.823958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8080324-58e3-4e6a-abc4-dc891521a86d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:11.824448 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8080324-58e3-4e6a-abc4-dc891521a86d None admin] PATH_INFO: `/v3/users/475ea8c5972648f4a2672c509d37bd68` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:11.838146 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8080324-58e3-4e6a-abc4-dc891521a86d None admin] RBAC: Authorizing `identity:get_user(user_id=475ea8c5972648f4a2672c509d37bd68)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:11.839894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8080324-58e3-4e6a-abc4-dc891521a86d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:11.842803 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 531/1050] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:11 2022] GET /identity/v3/users/475ea8c5972648f4a2672c509d37bd68 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:11.848391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05941a4d-bb00-40df-8e87-c08bd910e7c4 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:11.946574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05941a4d-bb00-40df-8e87-c08bd910e7c4 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:11.981022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cac2c-342f-4e6f-a845-9ff1e3a98452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:11.981700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cac2c-342f-4e6f-a845-9ff1e3a98452 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:11.981980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cac2c-342f-4e6f-a845-9ff1e3a98452 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:11.982254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cac2c-342f-4e6f-a845-9ff1e3a98452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:12.046157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cac2c-342f-4e6f-a845-9ff1e3a98452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:12.047554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cac2c-342f-4e6f-a845-9ff1e3a98452 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:12.112158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7de42-7453-4e61-aee0-14fd5a7e459b None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:12.112432 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7de42-7453-4e61-aee0-14fd5a7e459b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:12.112712 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7de42-7453-4e61-aee0-14fd5a7e459b None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:12.114059 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 532/1051] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:36:12.118938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cffc64-5548-499c-a599-eb9be7b66bbb None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:12.119239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cffc64-5548-499c-a599-eb9be7b66bbb None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:12.119525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cffc64-5548-499c-a599-eb9be7b66bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:12.135849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-80cffc64-5548-499c-a599-eb9be7b66bbb None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:12.137001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-80cffc64-5548-499c-a599-eb9be7b66bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:12.143988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 520/1052] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:36:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:36:12.149358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cac2c-342f-4e6f-a845-9ff1e3a98452 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:12.205541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 533/1053] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:36:12.227543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cffc64-5548-499c-a599-eb9be7b66bbb None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:12.254080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cac2c-342f-4e6f-a845-9ff1e3a98452 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:12.286776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdca3bb-6805-4782-87eb-a5413201dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:12.287732 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca3bb-6805-4782-87eb-a5413201dc00 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:12.288017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca3bb-6805-4782-87eb-a5413201dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:12.288405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca3bb-6805-4782-87eb-a5413201dc00 None admin] PATH_INFO: `/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:12.289577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdca3bb-6805-4782-87eb-a5413201dc00 None admin] RBAC: Authorizing `identity:get_project(project_id=b48dc6c1df2e4d04bacc39bb20bb2d10)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:12.290998 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdca3bb-6805-4782-87eb-a5413201dc00 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:12.293032 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 521/1054] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:36:12 2022] GET /identity/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:12.300226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdca3bb-6805-4782-87eb-a5413201dc00 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:12.339134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cffc64-5548-499c-a599-eb9be7b66bbb None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:12.373322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb11a4-f4e3-4ade-b500-c2383b134d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:12.374119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb11a4-f4e3-4ade-b500-c2383b134d10 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:12.374397 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb11a4-f4e3-4ade-b500-c2383b134d10 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:12.374668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb11a4-f4e3-4ade-b500-c2383b134d10 None admin] PATH_INFO: `/v3/services/image` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:12.375360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb11a4-f4e3-4ade-b500-c2383b134d10 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:12.376714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb11a4-f4e3-4ade-b500-c2383b134d10 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-abdb11a4-f4e3-4ade-b500-c2383b134d10 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:12.388732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:12.389969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:12.390805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 534/1055] 10.222.0.73 () {56 vars in 1105 bytes} [Wed May 4 13:36:12 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:12.396019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb11a4-f4e3-4ade-b500-c2383b134d10 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:12.409490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdca3bb-6805-4782-87eb-a5413201dc00 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:12.442142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20024da-77bf-443b-86ad-d4ab9cb480a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:12.442812 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20024da-77bf-443b-86ad-d4ab9cb480a9 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:12.443080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20024da-77bf-443b-86ad-d4ab9cb480a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:12.443385 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20024da-77bf-443b-86ad-d4ab9cb480a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:12.444210 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20024da-77bf-443b-86ad-d4ab9cb480a9 None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=b48dc6c1df2e4d04bacc39bb20bb2d10, user.id=475ea8c5972648f4a2672c509d37bd68) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:12.444518 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20024da-77bf-443b-86ad-d4ab9cb480a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:12.446203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20024da-77bf-443b-86ad-d4ab9cb480a9 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:12.463238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 522/1056] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:36:12 2022] GET /identity/v3/role_assignments?user.id=475ea8c5972648f4a2672c509d37bd68&scope.project.id=b48dc6c1df2e4d04bacc39bb20bb2d10&role.id=70e67f35994843ae942d4f1703d5619e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:12.498864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb11a4-f4e3-4ade-b500-c2383b134d10 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:12.534850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3046bd-798e-430d-a398-f5bd059db64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:12.535562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3046bd-798e-430d-a398-f5bd059db64b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:12.535845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3046bd-798e-430d-a398-f5bd059db64b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:12.536119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3046bd-798e-430d-a398-f5bd059db64b None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:12.536865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3046bd-798e-430d-a398-f5bd059db64b None admin] RBAC: Adding query filter params (name=image) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:12.537175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3046bd-798e-430d-a398-f5bd059db64b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:12.538612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3046bd-798e-430d-a398-f5bd059db64b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:12.549477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 535/1057] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:12.551288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20024da-77bf-443b-86ad-d4ab9cb480a9 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:12.652305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20024da-77bf-443b-86ad-d4ab9cb480a9 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:12.685337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee5075-3d15-4a1d-a82b-abdd0669dc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:12.685995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee5075-3d15-4a1d-a82b-abdd0669dc2a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:12.686273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee5075-3d15-4a1d-a82b-abdd0669dc2a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:12.686543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee5075-3d15-4a1d-a82b-abdd0669dc2a None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:12.687263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee5075-3d15-4a1d-a82b-abdd0669dc2a None admin] RBAC: Adding query filter params (type=image) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:12.687571 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee5075-3d15-4a1d-a82b-abdd0669dc2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:12.688919 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee5075-3d15-4a1d-a82b-abdd0669dc2a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:12.698426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 523/1058] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:12.700641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3046bd-798e-430d-a398-f5bd059db64b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:12.804649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3046bd-798e-430d-a398-f5bd059db64b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:12.837300 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767907c7-8a76-45ae-8bdf-63b362c81d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:12.837952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767907c7-8a76-45ae-8bdf-63b362c81d0c None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:12.838229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767907c7-8a76-45ae-8bdf-63b362c81d0c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:12.838499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767907c7-8a76-45ae-8bdf-63b362c81d0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:12.839245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767907c7-8a76-45ae-8bdf-63b362c81d0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:12.840589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767907c7-8a76-45ae-8bdf-63b362c81d0c None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:12.863622 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 536/1059] 10.222.0.73 () {60 vars in 1144 bytes} [Wed May 4 13:36:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:36:13.738936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a21fff-02c3-4c5e-bab8-474c43da9ccd None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:13.739461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a21fff-02c3-4c5e-bab8-474c43da9ccd None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:13.739461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a21fff-02c3-4c5e-bab8-474c43da9ccd None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:13.740853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 524/1060] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:13.745977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f38d5-144b-4008-b99c-a04f2481389f None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:13.746363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f38d5-144b-4008-b99c-a04f2481389f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:13.746530 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f38d5-144b-4008-b99c-a04f2481389f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:13.764369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-c03f38d5-144b-4008-b99c-a04f2481389f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:13.765541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c03f38d5-144b-4008-b99c-a04f2481389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:13.837382 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 537/1061] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:13.859772 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a21fff-02c3-4c5e-bab8-474c43da9ccd None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:13.956829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a21fff-02c3-4c5e-bab8-474c43da9ccd None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:13.989592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f434f97-1974-4b1b-b016-29e0c479555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:13.990352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f434f97-1974-4b1b-b016-29e0c479555c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:13.990636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f434f97-1974-4b1b-b016-29e0c479555c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:13.990913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f434f97-1974-4b1b-b016-29e0c479555c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:14.003273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f434f97-1974-4b1b-b016-29e0c479555c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-6f434f97-1974-4b1b-b016-29e0c479555c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:36:14.011643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:14.012608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:14.013466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:14.013466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:14.013466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:14.013466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:14.013466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:36:14.013466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:36:14.013466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:36:14.013466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:36:14.013466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:36:14.013466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:36:14.013466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:36:14.013466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:14.015540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 525/1062] 10.222.0.73 () {56 vars in 1120 bytes} [Wed May 4 13:36:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:14.018886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f38d5-144b-4008-b99c-a04f2481389f None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:14.113463 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f38d5-144b-4008-b99c-a04f2481389f None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:14.145873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7bc96-1116-48d6-b25d-9fd88ad57a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:14.146539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7bc96-1116-48d6-b25d-9fd88ad57a69 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:14.146821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7bc96-1116-48d6-b25d-9fd88ad57a69 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:14.147095 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7bc96-1116-48d6-b25d-9fd88ad57a69 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:14.147871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7bc96-1116-48d6-b25d-9fd88ad57a69 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:14.148188 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7bc96-1116-48d6-b25d-9fd88ad57a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:14.149512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7bc96-1116-48d6-b25d-9fd88ad57a69 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:14.161970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 538/1063] 10.222.0.73 () {56 vars in 1115 bytes} [Wed May 4 13:36:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:14.163654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f434f97-1974-4b1b-b016-29e0c479555c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:14.259884 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f434f97-1974-4b1b-b016-29e0c479555c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:14.293574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db02a0-7715-4723-836e-42b7b3560285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:14.295695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db02a0-7715-4723-836e-42b7b3560285 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:14.295695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db02a0-7715-4723-836e-42b7b3560285 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:14.295695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db02a0-7715-4723-836e-42b7b3560285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:14.307106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db02a0-7715-4723-836e-42b7b3560285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:14.308583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db02a0-7715-4723-836e-42b7b3560285 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-51db02a0-7715-4723-836e-42b7b3560285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:36:14.328661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:14.329601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:14.330611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:36:14.330611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:36:14.330611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:14.330611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:14.334777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 526/1064] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:14.335917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7bc96-1116-48d6-b25d-9fd88ad57a69 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:14.432617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7bc96-1116-48d6-b25d-9fd88ad57a69 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:14.464159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b2c12-aa05-45dd-91b1-0a71cb05a12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:14.464822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b2c12-aa05-45dd-91b1-0a71cb05a12e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:14.465102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b2c12-aa05-45dd-91b1-0a71cb05a12e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:14.465400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b2c12-aa05-45dd-91b1-0a71cb05a12e None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:14.466634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b2c12-aa05-45dd-91b1-0a71cb05a12e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:14.466938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b2c12-aa05-45dd-91b1-0a71cb05a12e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:14.468322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b2c12-aa05-45dd-91b1-0a71cb05a12e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:14.480180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 539/1065] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:14.486094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db02a0-7715-4723-836e-42b7b3560285 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:14.584858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db02a0-7715-4723-836e-42b7b3560285 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:14.617259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3542e44-6f19-4643-9678-dd8fc91b0bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:14.618050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3542e44-6f19-4643-9678-dd8fc91b0bbd None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:14.618331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3542e44-6f19-4643-9678-dd8fc91b0bbd None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:14.618601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3542e44-6f19-4643-9678-dd8fc91b0bbd None admin] PATH_INFO: `/v3/users/nova` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:14.626119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3542e44-6f19-4643-9678-dd8fc91b0bbd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:14.627576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3542e44-6f19-4643-9678-dd8fc91b0bbd None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-d3542e44-6f19-4643-9678-dd8fc91b0bbd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:36:14.641188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:14.642119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:14.643054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:14.643054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:14.643054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:36:14.643054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:36:14.643054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:36:14.643054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:36:14.643054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:36:14.643054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:36:14.643054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:36:14.643054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:14.648633 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 527/1066] 10.222.0.73 () {56 vars in 1093 bytes} [Wed May 4 13:36:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:14.648764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b2c12-aa05-45dd-91b1-0a71cb05a12e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:14.712145 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618f735-652f-4075-b7bc-98b14b81221a None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:14.712467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618f735-652f-4075-b7bc-98b14b81221a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:14.712708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618f735-652f-4075-b7bc-98b14b81221a None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:14.714233 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 528/1067] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:36:14.719600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f214a-3cb5-45d4-9124-f173ea160a03 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:14.719890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f214a-3cb5-45d4-9124-f173ea160a03 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:14.720164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f214a-3cb5-45d4-9124-f173ea160a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:14.737840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-999f214a-3cb5-45d4-9124-f173ea160a03 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:14.739020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-999f214a-3cb5-45d4-9124-f173ea160a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:14.746730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b2c12-aa05-45dd-91b1-0a71cb05a12e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:14.779860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfc916-ac1f-499e-be2c-a538aaea891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:14.780545 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc916-ac1f-499e-be2c-a538aaea891a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:14.780807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc916-ac1f-499e-be2c-a538aaea891a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:14.781078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc916-ac1f-499e-be2c-a538aaea891a None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:14.781907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfc916-ac1f-499e-be2c-a538aaea891a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:14.782210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfc916-ac1f-499e-be2c-a538aaea891a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:14.783645 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfc916-ac1f-499e-be2c-a538aaea891a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:14.805347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 540/1068] 10.222.0.73 () {56 vars in 1133 bytes} [Wed May 4 13:36:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:14.806871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfc916-ac1f-499e-be2c-a538aaea891a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:14.808462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 529/1069] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:36:14.835660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f214a-3cb5-45d4-9124-f173ea160a03 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:14.908540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfc916-ac1f-499e-be2c-a538aaea891a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:14.933159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f214a-3cb5-45d4-9124-f173ea160a03 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:14.940202 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1682eb1-05dd-4680-9a87-43825fc95090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:14.940995 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1682eb1-05dd-4680-9a87-43825fc95090 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:14.941268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1682eb1-05dd-4680-9a87-43825fc95090 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:14.941532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1682eb1-05dd-4680-9a87-43825fc95090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:14.953781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1682eb1-05dd-4680-9a87-43825fc95090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:14.955369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1682eb1-05dd-4680-9a87-43825fc95090 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:14.967650 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363fa92-6a8a-45f2-b45b-b7eb9de49ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:14.968448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363fa92-6a8a-45f2-b45b-b7eb9de49ebc None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:14.968722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363fa92-6a8a-45f2-b45b-b7eb9de49ebc None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:14.968990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363fa92-6a8a-45f2-b45b-b7eb9de49ebc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-a1682eb1-05dd-4680-9a87-43825fc95090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:36:14.973498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:14.974476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:14.980542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:36:14.980542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:36:14.980542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:14.980542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:14.980542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 541/1070] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:14.981217 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1682eb1-05dd-4680-9a87-43825fc95090 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:14.989116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363fa92-6a8a-45f2-b45b-b7eb9de49ebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-2363fa92-6a8a-45f2-b45b-b7eb9de49ebc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:36:14.996914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:14.997973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:14.998825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 530/1071] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:15.004683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363fa92-6a8a-45f2-b45b-b7eb9de49ebc None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:15.087113 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1682eb1-05dd-4680-9a87-43825fc95090 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:15.100054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363fa92-6a8a-45f2-b45b-b7eb9de49ebc None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:15.120534 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6089c-f7a5-4d1f-9bdd-d6bce808ffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:15.121200 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6089c-f7a5-4d1f-9bdd-d6bce808ffef None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:15.121477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6089c-f7a5-4d1f-9bdd-d6bce808ffef None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:15.121747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6089c-f7a5-4d1f-9bdd-d6bce808ffef None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:15.123005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6089c-f7a5-4d1f-9bdd-d6bce808ffef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:15.123335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6089c-f7a5-4d1f-9bdd-d6bce808ffef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:15.124689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6089c-f7a5-4d1f-9bdd-d6bce808ffef None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:15.135163 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13d647-5ca3-43eb-ae61-b58b3244a91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:15.135663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 542/1072] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:15.140837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13d647-5ca3-43eb-ae61-b58b3244a91f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:15.140837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13d647-5ca3-43eb-ae61-b58b3244a91f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:15.140837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13d647-5ca3-43eb-ae61-b58b3244a91f None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:15.141199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13d647-5ca3-43eb-ae61-b58b3244a91f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:15.141513 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13d647-5ca3-43eb-ae61-b58b3244a91f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:15.141835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6089c-f7a5-4d1f-9bdd-d6bce808ffef None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:15.142902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13d647-5ca3-43eb-ae61-b58b3244a91f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:15.159520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 531/1073] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:36:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:15.161623 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13d647-5ca3-43eb-ae61-b58b3244a91f None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:15.236794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6089c-f7a5-4d1f-9bdd-d6bce808ffef None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:15.254332 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13d647-5ca3-43eb-ae61-b58b3244a91f None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:15.269106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562db57-9404-486f-8ffd-101da46eb38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:15.269890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562db57-9404-486f-8ffd-101da46eb38f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:15.270165 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562db57-9404-486f-8ffd-101da46eb38f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:15.270432 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562db57-9404-486f-8ffd-101da46eb38f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:15.276763 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562db57-9404-486f-8ffd-101da46eb38f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:15.278166 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562db57-9404-486f-8ffd-101da46eb38f None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:15.286107 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b6dcb-8ff9-47d0-9d60-cf24609c050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:15.286967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b6dcb-8ff9-47d0-9d60-cf24609c050c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:15.287275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b6dcb-8ff9-47d0-9d60-cf24609c050c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:15.287553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b6dcb-8ff9-47d0-9d60-cf24609c050c None admin] PATH_INFO: `/v3/users/475ea8c5972648f4a2672c509d37bd68` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:15.288739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b6dcb-8ff9-47d0-9d60-cf24609c050c None admin] RBAC: Authorizing `identity:get_user(user_id=475ea8c5972648f4a2672c509d37bd68)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:15.290140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b6dcb-8ff9-47d0-9d60-cf24609c050c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:15.291779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 532/1074] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:15 2022] GET /identity/v3/users/475ea8c5972648f4a2672c509d37bd68 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-f562db57-9404-486f-8ffd-101da46eb38f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:36:15.291951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:15.292889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:15.293804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:36:15.293804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:36:15.293804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:36:15.293804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:36:15.293804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:36:15.293804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:36:15.293804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:36:15.293804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:15.294243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20733ba-4c3f-42f9-99f6-e477eca81926 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:15.294243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20733ba-4c3f-42f9-99f6-e477eca81926 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:15.294243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20733ba-4c3f-42f9-99f6-e477eca81926 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:15.295886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 533/1075] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:15.296319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 543/1076] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:15.298622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20733ba-4c3f-42f9-99f6-e477eca81926 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:15.299796 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562db57-9404-486f-8ffd-101da46eb38f None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:15.393733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562db57-9404-486f-8ffd-101da46eb38f None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:15.394708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20733ba-4c3f-42f9-99f6-e477eca81926 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:15.424880 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2cde-fc99-49f5-895f-427394d510b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:15.425524 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2cde-fc99-49f5-895f-427394d510b7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:15.425698 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a7bfc-9b07-4954-8b20-986378dcc7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:15.425818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2cde-fc99-49f5-895f-427394d510b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:15.426057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2cde-fc99-49f5-895f-427394d510b7 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:15.426544 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a7bfc-9b07-4954-8b20-986378dcc7fb None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:15.426830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a7bfc-9b07-4954-8b20-986378dcc7fb None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:15.426920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b2cde-fc99-49f5-895f-427394d510b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:15.427106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a7bfc-9b07-4954-8b20-986378dcc7fb None admin] PATH_INFO: `/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:15.427229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b2cde-fc99-49f5-895f-427394d510b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:15.428294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a7bfc-9b07-4954-8b20-986378dcc7fb None admin] RBAC: Authorizing `identity:get_project(project_id=b48dc6c1df2e4d04bacc39bb20bb2d10)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:15.428606 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b2cde-fc99-49f5-895f-427394d510b7 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:15.429690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a7bfc-9b07-4954-8b20-986378dcc7fb None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:15.431388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 534/1077] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:36:15 2022] GET /identity/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:15.437182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3721d1-0155-4132-8d7c-74d62a720c39 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:15.437182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3721d1-0155-4132-8d7c-74d62a720c39 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:15.437182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3721d1-0155-4132-8d7c-74d62a720c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:15.444952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 544/1078] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:15.444952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2cde-fc99-49f5-895f-427394d510b7 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:15.457205 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6b3721d1-0155-4132-8d7c-74d62a720c39 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:15.458373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6b3721d1-0155-4132-8d7c-74d62a720c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:15.521042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 535/1079] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:15.521952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3721d1-0155-4132-8d7c-74d62a720c39 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:15.535791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2cde-fc99-49f5-895f-427394d510b7 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:15.569730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1623ec-f7f4-4b71-bab3-c7e6f6dc9a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:15.570885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1623ec-f7f4-4b71-bab3-c7e6f6dc9a6b None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:15.571164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1623ec-f7f4-4b71-bab3-c7e6f6dc9a6b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:15.571465 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1623ec-f7f4-4b71-bab3-c7e6f6dc9a6b None admin] PATH_INFO: `/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10/users/475ea8c5972648f4a2672c509d37bd68/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:15.573539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1623ec-f7f4-4b71-bab3-c7e6f6dc9a6b None admin] RBAC: Authorizing `identity:create_grant(project_id=b48dc6c1df2e4d04bacc39bb20bb2d10, user_id=475ea8c5972648f4a2672c509d37bd68, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:15.574951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1623ec-f7f4-4b71-bab3-c7e6f6dc9a6b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:15.588059 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 545/1080] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:36:15 2022] PUT /identity/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10/users/475ea8c5972648f4a2672c509d37bd68/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:36:15.588841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1623ec-f7f4-4b71-bab3-c7e6f6dc9a6b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:15.624285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3721d1-0155-4132-8d7c-74d62a720c39 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:15.663744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348a82b-6c87-490e-9760-6e5e18a0057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:15.664566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348a82b-6c87-490e-9760-6e5e18a0057c None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:15.664853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348a82b-6c87-490e-9760-6e5e18a0057c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:15.665133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348a82b-6c87-490e-9760-6e5e18a0057c None admin] PATH_INFO: `/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/10d07b370370461a90cab0b182938292/roles/bfebc8d95b31401c8be316fd2a084797` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:15.667517 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348a82b-6c87-490e-9760-6e5e18a0057c None admin] RBAC: Authorizing `identity:create_grant(project_id=fbace3b0d2f54a408012ccc368865c82, user_id=10d07b370370461a90cab0b182938292, role_id=bfebc8d95b31401c8be316fd2a084797)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:15.669042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348a82b-6c87-490e-9760-6e5e18a0057c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:15.683737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 536/1081] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:36:15 2022] PUT /identity/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/10d07b370370461a90cab0b182938292/roles/bfebc8d95b31401c8be316fd2a084797 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:36:15.699264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1623ec-f7f4-4b71-bab3-c7e6f6dc9a6b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:15.739382 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd71db0-3993-40c8-a70e-3cd275b41046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:15.740061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd71db0-3993-40c8-a70e-3cd275b41046 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:15.740340 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd71db0-3993-40c8-a70e-3cd275b41046 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:15.740615 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd71db0-3993-40c8-a70e-3cd275b41046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:15.814265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd71db0-3993-40c8-a70e-3cd275b41046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:15.815773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd71db0-3993-40c8-a70e-3cd275b41046 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:15.916435 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 546/1082] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:36:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:36:15.922291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348a82b-6c87-490e-9760-6e5e18a0057c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:16.017792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348a82b-6c87-490e-9760-6e5e18a0057c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:16.050863 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59f7b8-1ca0-4702-8273-1801dba327c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:16.051686 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59f7b8-1ca0-4702-8273-1801dba327c4 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:16.051974 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59f7b8-1ca0-4702-8273-1801dba327c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:16.052251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59f7b8-1ca0-4702-8273-1801dba327c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:16.062514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59f7b8-1ca0-4702-8273-1801dba327c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:16.063978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59f7b8-1ca0-4702-8273-1801dba327c4 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-3d59f7b8-1ca0-4702-8273-1801dba327c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:36:16.082127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:16.083044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:16.084053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:36:16.084053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:36:16.084053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:16.084053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:16.085051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 537/1083] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:16.089463 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd71db0-3993-40c8-a70e-3cd275b41046 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:16.184359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd71db0-3993-40c8-a70e-3cd275b41046 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:16.217913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205f7ef-7201-4cbe-84dd-0577bcfeaac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:16.218577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205f7ef-7201-4cbe-84dd-0577bcfeaac8 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:16.218854 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205f7ef-7201-4cbe-84dd-0577bcfeaac8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:16.219123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205f7ef-7201-4cbe-84dd-0577bcfeaac8 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:16.220018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205f7ef-7201-4cbe-84dd-0577bcfeaac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:16.220325 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205f7ef-7201-4cbe-84dd-0577bcfeaac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:16.221663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205f7ef-7201-4cbe-84dd-0577bcfeaac8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:16.233212 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 547/1084] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:17.842610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5befd0-4f34-4de4-a70f-1d1f3b4961e9 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:17.843151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5befd0-4f34-4de4-a70f-1d1f3b4961e9 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:17.843151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5befd0-4f34-4de4-a70f-1d1f3b4961e9 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:17.844552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 538/1085] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:17.849580 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5cf6c-24bd-445b-a820-14fb009131f5 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:17.849985 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5cf6c-24bd-445b-a820-14fb009131f5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:17.850247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5cf6c-24bd-445b-a820-14fb009131f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:17.866478 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b7b5cf6c-24bd-445b-a820-14fb009131f5 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:17.867652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b7b5cf6c-24bd-445b-a820-14fb009131f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:17.930656 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 548/1086] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:36:17.933579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad33dc6-843b-4606-a621-b68a665c943b None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:17.933864 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad33dc6-843b-4606-a621-b68a665c943b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:17.934134 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad33dc6-843b-4606-a621-b68a665c943b None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:17.935543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 539/1087] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:17.940489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128304f-c5fa-4b66-9812-e72b0b70aa04 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:17.940777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128304f-c5fa-4b66-9812-e72b0b70aa04 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:17.941049 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128304f-c5fa-4b66-9812-e72b0b70aa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:17.954333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad33dc6-843b-4606-a621-b68a665c943b None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:17.957539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a128304f-c5fa-4b66-9812-e72b0b70aa04 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:17.958701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a128304f-c5fa-4b66-9812-e72b0b70aa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:18.020733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 549/1088] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:18.043983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128304f-c5fa-4b66-9812-e72b0b70aa04 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:18.049971 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad33dc6-843b-4606-a621-b68a665c943b None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:18.083013 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2be9eb-3f6c-4b60-a2a8-a4331c71ffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:18.083828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2be9eb-3f6c-4b60-a2a8-a4331c71ffce None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:18.084110 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2be9eb-3f6c-4b60-a2a8-a4331c71ffce None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:18.084384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2be9eb-3f6c-4b60-a2a8-a4331c71ffce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:18.094686 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2be9eb-3f6c-4b60-a2a8-a4331c71ffce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-bb2be9eb-3f6c-4b60-a2a8-a4331c71ffce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:36:18.102193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:18.103142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:18.104137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 540/1089] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:36:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:18.109352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2be9eb-3f6c-4b60-a2a8-a4331c71ffce None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:18.136739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128304f-c5fa-4b66-9812-e72b0b70aa04 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:18.169384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25375d68-d473-42c0-adaf-6ad9992a7499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:18.170194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25375d68-d473-42c0-adaf-6ad9992a7499 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:18.170474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25375d68-d473-42c0-adaf-6ad9992a7499 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:18.170745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25375d68-d473-42c0-adaf-6ad9992a7499 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:18.180468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25375d68-d473-42c0-adaf-6ad9992a7499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-25375d68-d473-42c0-adaf-6ad9992a7499 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:36:18.189252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:18.190347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:18.191536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 550/1090] 10.222.0.73 () {56 vars in 1120 bytes} [Wed May 4 13:36:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:18.196527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25375d68-d473-42c0-adaf-6ad9992a7499 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:18.207272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2be9eb-3f6c-4b60-a2a8-a4331c71ffce None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:18.238119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d197dd-5e34-44c5-ac6a-e2e7547b61a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:18.238770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d197dd-5e34-44c5-ac6a-e2e7547b61a9 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:18.239050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d197dd-5e34-44c5-ac6a-e2e7547b61a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:18.239353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d197dd-5e34-44c5-ac6a-e2e7547b61a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:18.240093 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d197dd-5e34-44c5-ac6a-e2e7547b61a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:18.240406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d197dd-5e34-44c5-ac6a-e2e7547b61a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:18.241742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d197dd-5e34-44c5-ac6a-e2e7547b61a9 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:18.249876 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 541/1091] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:18.255447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d197dd-5e34-44c5-ac6a-e2e7547b61a9 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:18.290798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25375d68-d473-42c0-adaf-6ad9992a7499 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:18.323543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa2f15-ab90-4526-bc3b-513f715ef1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:18.324215 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa2f15-ab90-4526-bc3b-513f715ef1fb None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:18.324496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa2f15-ab90-4526-bc3b-513f715ef1fb None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:18.324769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa2f15-ab90-4526-bc3b-513f715ef1fb None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:18.326145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa2f15-ab90-4526-bc3b-513f715ef1fb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:18.326459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa2f15-ab90-4526-bc3b-513f715ef1fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:18.327852 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa2f15-ab90-4526-bc3b-513f715ef1fb None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:18.335561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 551/1092] 10.222.0.73 () {56 vars in 1115 bytes} [Wed May 4 13:36:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:18.341124 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa2f15-ab90-4526-bc3b-513f715ef1fb None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:18.351499 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d197dd-5e34-44c5-ac6a-e2e7547b61a9 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:18.382851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c62b78-124c-463b-9293-e6cd9ace603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:18.383744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c62b78-124c-463b-9293-e6cd9ace603e None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:18.384024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c62b78-124c-463b-9293-e6cd9ace603e None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:18.384294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c62b78-124c-463b-9293-e6cd9ace603e None admin] PATH_INFO: `/v3/users/475ea8c5972648f4a2672c509d37bd68` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:18.385473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c62b78-124c-463b-9293-e6cd9ace603e None admin] RBAC: Authorizing `identity:get_user(user_id=475ea8c5972648f4a2672c509d37bd68)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:18.386892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c62b78-124c-463b-9293-e6cd9ace603e None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:18.389267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 542/1093] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:18 2022] GET /identity/v3/users/475ea8c5972648f4a2672c509d37bd68 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:18.394809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c62b78-124c-463b-9293-e6cd9ace603e None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:18.435015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa2f15-ab90-4526-bc3b-513f715ef1fb None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:18.466929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d0dfb-9840-4731-9f60-a79d825455a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:18.467738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d0dfb-9840-4731-9f60-a79d825455a7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:18.468020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d0dfb-9840-4731-9f60-a79d825455a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:18.468293 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d0dfb-9840-4731-9f60-a79d825455a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:18.478353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d0dfb-9840-4731-9f60-a79d825455a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:18.479812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d0dfb-9840-4731-9f60-a79d825455a7 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:18.488383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c62b78-124c-463b-9293-e6cd9ace603e None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-f54d0dfb-9840-4731-9f60-a79d825455a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:36:18.496605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:18.498070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:18.499004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:36:18.499004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:36:18.499004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:18.499004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:18.503134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 552/1094] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:18.504015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d0dfb-9840-4731-9f60-a79d825455a7 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:18.520547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037d06-ee9a-439e-abed-966c124d7be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:18.521177 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037d06-ee9a-439e-abed-966c124d7be6 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:18.521472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037d06-ee9a-439e-abed-966c124d7be6 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:18.521724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037d06-ee9a-439e-abed-966c124d7be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:18.583963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a037d06-ee9a-439e-abed-966c124d7be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:18.585392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a037d06-ee9a-439e-abed-966c124d7be6 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:18.596862 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d0dfb-9840-4731-9f60-a79d825455a7 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:18.628894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4661e-4bf6-42a7-9889-9c4a9d25e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:18.629464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4661e-4bf6-42a7-9889-9c4a9d25e9d3 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:18.629746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4661e-4bf6-42a7-9889-9c4a9d25e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:18.630020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4661e-4bf6-42a7-9889-9c4a9d25e9d3 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:18.630726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4661e-4bf6-42a7-9889-9c4a9d25e9d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:18.631027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4661e-4bf6-42a7-9889-9c4a9d25e9d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:18.632398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4661e-4bf6-42a7-9889-9c4a9d25e9d3 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:18.643997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 553/1095] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:18.649587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4661e-4bf6-42a7-9889-9c4a9d25e9d3 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:18.676501 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 543/1096] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:36:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 13:36:18.682166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037d06-ee9a-439e-abed-966c124d7be6 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:18.743562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4661e-4bf6-42a7-9889-9c4a9d25e9d3 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:18.774193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037d06-ee9a-439e-abed-966c124d7be6 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:18.775484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33850d55-a0d5-494b-a711-704994c91260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:18.776265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33850d55-a0d5-494b-a711-704994c91260 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:18.776544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33850d55-a0d5-494b-a711-704994c91260 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:18.776818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33850d55-a0d5-494b-a711-704994c91260 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:18.784167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33850d55-a0d5-494b-a711-704994c91260 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:18.785582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33850d55-a0d5-494b-a711-704994c91260 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-33850d55-a0d5-494b-a711-704994c91260 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:36:18.799505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:18.800474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:18.801409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:18.801409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:18.801409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:36:18.801409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:36:18.801409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:36:18.801409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:36:18.801409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:36:18.801409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:36:18.801409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 13:36:18.801409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:18.801409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 554/1097] 10.222.0.73 () {56 vars in 1093 bytes} [Wed May 4 13:36:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:36:18.806304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33850d55-a0d5-494b-a711-704994c91260 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:18.806871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cd80f-7254-4d4f-84a6-c4b3e20c32a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:18.807767 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cd80f-7254-4d4f-84a6-c4b3e20c32a6 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:18.808048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cd80f-7254-4d4f-84a6-c4b3e20c32a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:18.808325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cd80f-7254-4d4f-84a6-c4b3e20c32a6 None admin] PATH_INFO: `/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:18.809496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cd80f-7254-4d4f-84a6-c4b3e20c32a6 None admin] RBAC: Authorizing `identity:get_project(project_id=b48dc6c1df2e4d04bacc39bb20bb2d10)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:18.810917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cd80f-7254-4d4f-84a6-c4b3e20c32a6 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:18.817692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 544/1098] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:36:18 2022] GET /identity/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:18.818440 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cd80f-7254-4d4f-84a6-c4b3e20c32a6 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:18.901099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33850d55-a0d5-494b-a711-704994c91260 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:18.910396 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cd80f-7254-4d4f-84a6-c4b3e20c32a6 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:18.932567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b08ae3-b2c0-49dc-a6b8-207096b44412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:18.933226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08ae3-b2c0-49dc-a6b8-207096b44412 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:18.933508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08ae3-b2c0-49dc-a6b8-207096b44412 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:18.933784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08ae3-b2c0-49dc-a6b8-207096b44412 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:18.935123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b08ae3-b2c0-49dc-a6b8-207096b44412 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:18.935462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b08ae3-b2c0-49dc-a6b8-207096b44412 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:18.936867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b08ae3-b2c0-49dc-a6b8-207096b44412 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:18.942023 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686b8f-31cc-4de7-96e6-3bc924c6bb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:18.942733 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686b8f-31cc-4de7-96e6-3bc924c6bb8c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:18.942933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686b8f-31cc-4de7-96e6-3bc924c6bb8c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:18.943222 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02686b8f-31cc-4de7-96e6-3bc924c6bb8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:18.944051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02686b8f-31cc-4de7-96e6-3bc924c6bb8c None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=b48dc6c1df2e4d04bacc39bb20bb2d10, user.id=475ea8c5972648f4a2672c509d37bd68) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:18.944361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02686b8f-31cc-4de7-96e6-3bc924c6bb8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:18.946022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02686b8f-31cc-4de7-96e6-3bc924c6bb8c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:18.952185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 545/1099] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:36:18 2022] GET /identity/v3/role_assignments?user.id=475ea8c5972648f4a2672c509d37bd68&scope.project.id=b48dc6c1df2e4d04bacc39bb20bb2d10&role.id=70e67f35994843ae942d4f1703d5619e => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:18.954341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 555/1100] 10.222.0.73 () {56 vars in 1133 bytes} [Wed May 4 13:36:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:36:18.959849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686b8f-31cc-4de7-96e6-3bc924c6bb8c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:19.061621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02686b8f-31cc-4de7-96e6-3bc924c6bb8c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:19.096636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b9946-76ba-45c9-9d25-ba7852c9a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:19.097295 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b9946-76ba-45c9-9d25-ba7852c9a67b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:19.097581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b9946-76ba-45c9-9d25-ba7852c9a67b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:19.097861 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b9946-76ba-45c9-9d25-ba7852c9a67b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:19.163713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b9946-76ba-45c9-9d25-ba7852c9a67b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:19.165077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b9946-76ba-45c9-9d25-ba7852c9a67b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:19.257738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 546/1101] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:36:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:36:19.263502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b08ae3-b2c0-49dc-a6b8-207096b44412 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:19.357897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b08ae3-b2c0-49dc-a6b8-207096b44412 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:19.389886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05088245-f1bb-4b7c-81e7-998a85ac5d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:19.390672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05088245-f1bb-4b7c-81e7-998a85ac5d44 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:19.390949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05088245-f1bb-4b7c-81e7-998a85ac5d44 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:19.391246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05088245-f1bb-4b7c-81e7-998a85ac5d44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:19.400822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05088245-f1bb-4b7c-81e7-998a85ac5d44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:19.402240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05088245-f1bb-4b7c-81e7-998a85ac5d44 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-05088245-f1bb-4b7c-81e7-998a85ac5d44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:36:19.419523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:19.420361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:19.421434 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:36:19.421434 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:36:19.421434 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:36:19.421434 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:19.421434 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 556/1102] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:19.426269 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b9946-76ba-45c9-9d25-ba7852c9a67b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:19.517481 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b9946-76ba-45c9-9d25-ba7852c9a67b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:19.548775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee3067-ea33-4b76-a58b-3c4a6944703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:19.549413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee3067-ea33-4b76-a58b-3c4a6944703b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:19.549688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee3067-ea33-4b76-a58b-3c4a6944703b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:19.549956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee3067-ea33-4b76-a58b-3c4a6944703b None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:19.550654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee3067-ea33-4b76-a58b-3c4a6944703b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:19.550952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee3067-ea33-4b76-a58b-3c4a6944703b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:19.552325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee3067-ea33-4b76-a58b-3c4a6944703b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:19.563475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 547/1103] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:19.569109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05088245-f1bb-4b7c-81e7-998a85ac5d44 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:19.662499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05088245-f1bb-4b7c-81e7-998a85ac5d44 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:19.694578 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54724e1-9aad-4f75-b9bc-2844cc280d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:19.695586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54724e1-9aad-4f75-b9bc-2844cc280d56 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:19.695868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54724e1-9aad-4f75-b9bc-2844cc280d56 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:19.696138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54724e1-9aad-4f75-b9bc-2844cc280d56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:19.702461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54724e1-9aad-4f75-b9bc-2844cc280d56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:19.703927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54724e1-9aad-4f75-b9bc-2844cc280d56 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-c54724e1-9aad-4f75-b9bc-2844cc280d56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:36:19.717738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:19.718613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:19.720133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:36:19.720133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:36:19.720133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:36:19.720133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:36:19.720133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:36:19.720133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:36:19.720133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:36:19.720133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:19.720133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 557/1104] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:36:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:19.724689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee3067-ea33-4b76-a58b-3c4a6944703b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:19.818182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee3067-ea33-4b76-a58b-3c4a6944703b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:19.849865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947827-76d9-4b5d-b5a2-04d267cc3cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:19.850516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947827-76d9-4b5d-b5a2-04d267cc3cae None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:19.850797 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947827-76d9-4b5d-b5a2-04d267cc3cae None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:19.851068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947827-76d9-4b5d-b5a2-04d267cc3cae None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:19.851874 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86947827-76d9-4b5d-b5a2-04d267cc3cae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:19.852180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86947827-76d9-4b5d-b5a2-04d267cc3cae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:19.853596 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86947827-76d9-4b5d-b5a2-04d267cc3cae None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:19.865599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 548/1105] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:19.871675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54724e1-9aad-4f75-b9bc-2844cc280d56 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:19.964873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54724e1-9aad-4f75-b9bc-2844cc280d56 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:19.997017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d396cb-6b7e-4c36-8481-663464f9ddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:19.997660 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d396cb-6b7e-4c36-8481-663464f9ddaa None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:19.997937 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d396cb-6b7e-4c36-8481-663464f9ddaa None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:19.998207 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d396cb-6b7e-4c36-8481-663464f9ddaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:19.999024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d396cb-6b7e-4c36-8481-663464f9ddaa None admin] RBAC: Adding query filter params (role.id=bfebc8d95b31401c8be316fd2a084797, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=10d07b370370461a90cab0b182938292) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:19.999358 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d396cb-6b7e-4c36-8481-663464f9ddaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:20.000759 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d396cb-6b7e-4c36-8481-663464f9ddaa None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:20.006332 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 558/1106] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:36:19 2022] GET /identity/v3/role_assignments?user.id=10d07b370370461a90cab0b182938292&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bfebc8d95b31401c8be316fd2a084797 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:21.227625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262117e-30c1-4a81-bbbe-203f55dd535c None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:21.227625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262117e-30c1-4a81-bbbe-203f55dd535c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:21.227625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262117e-30c1-4a81-bbbe-203f55dd535c None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:21.228553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 549/1107] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:21.234331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c1853-5d88-44f2-86a6-2dab4caa1c02 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:21.234782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c1853-5d88-44f2-86a6-2dab4caa1c02 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:21.234887 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c1853-5d88-44f2-86a6-2dab4caa1c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:21.251100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-572c1853-5d88-44f2-86a6-2dab4caa1c02 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:21.252302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-572c1853-5d88-44f2-86a6-2dab4caa1c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:21.315090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 559/1108] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:21.339325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262117e-30c1-4a81-bbbe-203f55dd535c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:21.433614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262117e-30c1-4a81-bbbe-203f55dd535c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:21.464569 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf7bc33-7190-4381-aa7a-2fb43e737d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:21.465334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7bc33-7190-4381-aa7a-2fb43e737d65 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:21.465615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7bc33-7190-4381-aa7a-2fb43e737d65 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:21.466401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf7bc33-7190-4381-aa7a-2fb43e737d65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:21.467636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7bc33-7190-4381-aa7a-2fb43e737d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:21.469047 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf7bc33-7190-4381-aa7a-2fb43e737d65 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:21.470606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 550/1109] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:21.476061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c1853-5d88-44f2-86a6-2dab4caa1c02 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:21.576770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c1853-5d88-44f2-86a6-2dab4caa1c02 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:21.620082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a4f0-79ca-4f49-8803-b1c8bebb58d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:21.620756 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a4f0-79ca-4f49-8803-b1c8bebb58d3 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:21.621039 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a4f0-79ca-4f49-8803-b1c8bebb58d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:21.621315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a4f0-79ca-4f49-8803-b1c8bebb58d3 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:21.622057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760a4f0-79ca-4f49-8803-b1c8bebb58d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:21.623503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760a4f0-79ca-4f49-8803-b1c8bebb58d3 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:21.642596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 560/1110] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:36:21 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:36:23.953141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d2399-1d4f-487d-abdf-a3b73f4370f0 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:23.953734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d2399-1d4f-487d-abdf-a3b73f4370f0 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:23.953734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d2399-1d4f-487d-abdf-a3b73f4370f0 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:23.955034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 551/1111] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:23.960585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca0e9-df38-4969-aca5-33013c6849fd None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:23.961033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca0e9-df38-4969-aca5-33013c6849fd None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:23.961134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca0e9-df38-4969-aca5-33013c6849fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:23.977400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-8e1ca0e9-df38-4969-aca5-33013c6849fd None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:23.978571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-8e1ca0e9-df38-4969-aca5-33013c6849fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:24.041111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 561/1112] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:24.065243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d2399-1d4f-487d-abdf-a3b73f4370f0 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:24.160088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d2399-1d4f-487d-abdf-a3b73f4370f0 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:24.191893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb85bf-1e40-403e-b45a-ed5ea484c882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:24.192820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb85bf-1e40-403e-b45a-ed5ea484c882 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:24.193105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb85bf-1e40-403e-b45a-ed5ea484c882 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:24.193381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb85bf-1e40-403e-b45a-ed5ea484c882 None admin] PATH_INFO: `/v3/roles/142e36ee06a7422e8e8d32a1080ea89a` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:24.194851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb85bf-1e40-403e-b45a-ed5ea484c882 None admin] RBAC: Authorizing `identity:get_role(role_id=142e36ee06a7422e8e8d32a1080ea89a)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:24.196500 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb85bf-1e40-403e-b45a-ed5ea484c882 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:24.197867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 552/1113] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:24 2022] GET /identity/v3/roles/142e36ee06a7422e8e8d32a1080ea89a => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:24.203729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ca0e9-df38-4969-aca5-33013c6849fd None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:24.297204 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ca0e9-df38-4969-aca5-33013c6849fd None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:24.329188 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c36644-f4ff-4df9-a886-dcef73e5a929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:24.330047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c36644-f4ff-4df9-a886-dcef73e5a929 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:24.330330 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c36644-f4ff-4df9-a886-dcef73e5a929 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:24.330605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c36644-f4ff-4df9-a886-dcef73e5a929 None admin] PATH_INFO: `/v3/users/48724e4c329b46afb85fd51515efd4e1` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:24.343544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c36644-f4ff-4df9-a886-dcef73e5a929 None admin] RBAC: Authorizing `identity:get_user(user_id=48724e4c329b46afb85fd51515efd4e1)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:24.344970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c36644-f4ff-4df9-a886-dcef73e5a929 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:24.346583 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 562/1114] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:24 2022] GET /identity/v3/users/48724e4c329b46afb85fd51515efd4e1 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:24.352934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb85bf-1e40-403e-b45a-ed5ea484c882 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:24.453059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb85bf-1e40-403e-b45a-ed5ea484c882 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:24.484985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4a924-39ca-4f05-925d-e9c04057d877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:24.485550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4a924-39ca-4f05-925d-e9c04057d877 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:24.485831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4a924-39ca-4f05-925d-e9c04057d877 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:24.486102 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4a924-39ca-4f05-925d-e9c04057d877 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:24.548354 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4a924-39ca-4f05-925d-e9c04057d877 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:24.549777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4a924-39ca-4f05-925d-e9c04057d877 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:24.639660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 553/1115] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:36:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:36:24.645476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c36644-f4ff-4df9-a886-dcef73e5a929 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:24.739103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c36644-f4ff-4df9-a886-dcef73e5a929 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:24.771010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdd565-7325-4f99-8931-e5549bfcf64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:24.771868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdd565-7325-4f99-8931-e5549bfcf64f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:24.772150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdd565-7325-4f99-8931-e5549bfcf64f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:24.772421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdd565-7325-4f99-8931-e5549bfcf64f None admin] PATH_INFO: `/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:24.773585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdd565-7325-4f99-8931-e5549bfcf64f None admin] RBAC: Authorizing `identity:get_project(project_id=b48dc6c1df2e4d04bacc39bb20bb2d10)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:24.774995 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdd565-7325-4f99-8931-e5549bfcf64f None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:24.776664 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 563/1116] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:36:24 2022] GET /identity/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:24.783018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4a924-39ca-4f05-925d-e9c04057d877 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:24.874508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4a924-39ca-4f05-925d-e9c04057d877 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:24.905994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267df3ad-15d7-4ec8-84c2-a9a0dbc1bf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:24.906625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267df3ad-15d7-4ec8-84c2-a9a0dbc1bf50 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:24.906907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267df3ad-15d7-4ec8-84c2-a9a0dbc1bf50 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:24.907180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267df3ad-15d7-4ec8-84c2-a9a0dbc1bf50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:24.908027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267df3ad-15d7-4ec8-84c2-a9a0dbc1bf50 None admin] RBAC: Adding query filter params (role.id=142e36ee06a7422e8e8d32a1080ea89a, scope.project.id=b48dc6c1df2e4d04bacc39bb20bb2d10, user.id=48724e4c329b46afb85fd51515efd4e1) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:24.908337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267df3ad-15d7-4ec8-84c2-a9a0dbc1bf50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:24.909731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267df3ad-15d7-4ec8-84c2-a9a0dbc1bf50 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:24.914861 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 554/1117] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:36:24 2022] GET /identity/v3/role_assignments?user.id=48724e4c329b46afb85fd51515efd4e1&scope.project.id=b48dc6c1df2e4d04bacc39bb20bb2d10&role.id=142e36ee06a7422e8e8d32a1080ea89a => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:27.093529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbedc9-af43-4dc8-9e0d-b05cef7ef58b None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:27.094084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbedc9-af43-4dc8-9e0d-b05cef7ef58b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:27.094084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbedc9-af43-4dc8-9e0d-b05cef7ef58b None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:27.095453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 564/1118] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:27.100576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96d16c-3b4f-428d-9463-e158cc777761 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:27.100977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96d16c-3b4f-428d-9463-e158cc777761 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:27.101134 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96d16c-3b4f-428d-9463-e158cc777761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:27.117648 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-0c96d16c-3b4f-428d-9463-e158cc777761 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:27.118801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0c96d16c-3b4f-428d-9463-e158cc777761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:27.180548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 555/1119] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:27.202936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbedc9-af43-4dc8-9e0d-b05cef7ef58b None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:27.298240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbedc9-af43-4dc8-9e0d-b05cef7ef58b None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:27.329952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275f594-d137-4742-a51d-12c44810dd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:27.330788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275f594-d137-4742-a51d-12c44810dd1b None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:27.331064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275f594-d137-4742-a51d-12c44810dd1b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:27.331361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275f594-d137-4742-a51d-12c44810dd1b None admin] PATH_INFO: `/v3/roles/142e36ee06a7422e8e8d32a1080ea89a` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:27.332793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275f594-d137-4742-a51d-12c44810dd1b None admin] RBAC: Authorizing `identity:get_role(role_id=142e36ee06a7422e8e8d32a1080ea89a)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:27.334129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275f594-d137-4742-a51d-12c44810dd1b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:27.335514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 565/1120] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:27 2022] GET /identity/v3/roles/142e36ee06a7422e8e8d32a1080ea89a => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:27.341702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96d16c-3b4f-428d-9463-e158cc777761 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:27.432404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96d16c-3b4f-428d-9463-e158cc777761 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:27.463159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139025b-66a4-4805-bfe5-63dfb17c4971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:27.464036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139025b-66a4-4805-bfe5-63dfb17c4971 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:27.464308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139025b-66a4-4805-bfe5-63dfb17c4971 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:27.464573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139025b-66a4-4805-bfe5-63dfb17c4971 None admin] PATH_INFO: `/v3/users/48724e4c329b46afb85fd51515efd4e1` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:27.466266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139025b-66a4-4805-bfe5-63dfb17c4971 None admin] RBAC: Authorizing `identity:get_user(user_id=48724e4c329b46afb85fd51515efd4e1)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:27.467699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139025b-66a4-4805-bfe5-63dfb17c4971 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:27.469275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 556/1121] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:27 2022] GET /identity/v3/users/48724e4c329b46afb85fd51515efd4e1 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:27.474841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275f594-d137-4742-a51d-12c44810dd1b None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:27.569832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275f594-d137-4742-a51d-12c44810dd1b None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:27.602743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d31f96-f60d-4b69-b1d9-600700fc847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:27.603608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d31f96-f60d-4b69-b1d9-600700fc847a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:27.603885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d31f96-f60d-4b69-b1d9-600700fc847a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:27.604153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d31f96-f60d-4b69-b1d9-600700fc847a None admin] PATH_INFO: `/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:27.605285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d31f96-f60d-4b69-b1d9-600700fc847a None admin] RBAC: Authorizing `identity:get_project(project_id=b48dc6c1df2e4d04bacc39bb20bb2d10)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:27.606718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d31f96-f60d-4b69-b1d9-600700fc847a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:27.608405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 566/1122] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:36:27 2022] GET /identity/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:27.614334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139025b-66a4-4805-bfe5-63dfb17c4971 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:27.710679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139025b-66a4-4805-bfe5-63dfb17c4971 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:27.741828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8c9fb-c768-43b4-afbc-da7be54b5d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:27.742689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8c9fb-c768-43b4-afbc-da7be54b5d10 None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:27.742964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8c9fb-c768-43b4-afbc-da7be54b5d10 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:27.743258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8c9fb-c768-43b4-afbc-da7be54b5d10 None admin] PATH_INFO: `/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10/users/48724e4c329b46afb85fd51515efd4e1/roles/142e36ee06a7422e8e8d32a1080ea89a` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:27.745503 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8c9fb-c768-43b4-afbc-da7be54b5d10 None admin] RBAC: Authorizing `identity:create_grant(project_id=b48dc6c1df2e4d04bacc39bb20bb2d10, user_id=48724e4c329b46afb85fd51515efd4e1, role_id=142e36ee06a7422e8e8d32a1080ea89a)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:27.746939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8c9fb-c768-43b4-afbc-da7be54b5d10 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:27.759370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 557/1123] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:36:27 2022] PUT /identity/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10/users/48724e4c329b46afb85fd51515efd4e1/roles/142e36ee06a7422e8e8d32a1080ea89a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:36:29.958720 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0c9b3-b963-4ea6-bc9a-9401cb8b3e06 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:29.959317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0c9b3-b963-4ea6-bc9a-9401cb8b3e06 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:29.959317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0c9b3-b963-4ea6-bc9a-9401cb8b3e06 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:29.960636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 567/1124] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:29.966247 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf205d4-a7cf-48fa-9a85-ccc9ac13179d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:29.966658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf205d4-a7cf-48fa-9a85-ccc9ac13179d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:29.966798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf205d4-a7cf-48fa-9a85-ccc9ac13179d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:29.983411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-9bf205d4-a7cf-48fa-9a85-ccc9ac13179d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:29.984559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9bf205d4-a7cf-48fa-9a85-ccc9ac13179d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:30.046313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 558/1125] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:30.069546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0c9b3-b963-4ea6-bc9a-9401cb8b3e06 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:30.164679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0c9b3-b963-4ea6-bc9a-9401cb8b3e06 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:30.197367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23049593-c193-4a8d-8e6b-bd7ab4f723ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:30.198199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23049593-c193-4a8d-8e6b-bd7ab4f723ce None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:30.198478 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23049593-c193-4a8d-8e6b-bd7ab4f723ce None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:30.198749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23049593-c193-4a8d-8e6b-bd7ab4f723ce None admin] PATH_INFO: `/v3/roles/142e36ee06a7422e8e8d32a1080ea89a` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:30.200740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23049593-c193-4a8d-8e6b-bd7ab4f723ce None admin] RBAC: Authorizing `identity:get_role(role_id=142e36ee06a7422e8e8d32a1080ea89a)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:30.202086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23049593-c193-4a8d-8e6b-bd7ab4f723ce None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:30.203436 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 568/1126] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:30 2022] GET /identity/v3/roles/142e36ee06a7422e8e8d32a1080ea89a => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:30.209091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf205d4-a7cf-48fa-9a85-ccc9ac13179d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:30.302161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf205d4-a7cf-48fa-9a85-ccc9ac13179d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:30.334928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685a420-3726-4656-a94d-e8876e72a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:30.335873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685a420-3726-4656-a94d-e8876e72a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:30.336148 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685a420-3726-4656-a94d-e8876e72a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:30.336414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685a420-3726-4656-a94d-e8876e72a4a1 None admin] PATH_INFO: `/v3/users/48724e4c329b46afb85fd51515efd4e1` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:30.337563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685a420-3726-4656-a94d-e8876e72a4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=48724e4c329b46afb85fd51515efd4e1)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:30.338973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685a420-3726-4656-a94d-e8876e72a4a1 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:30.340632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 559/1127] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:30 2022] GET /identity/v3/users/48724e4c329b46afb85fd51515efd4e1 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:30.346366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23049593-c193-4a8d-8e6b-bd7ab4f723ce None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:30.439299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23049593-c193-4a8d-8e6b-bd7ab4f723ce None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:30.471162 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f42e71-4540-4e1e-80d2-da7ed617e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:30.471761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f42e71-4540-4e1e-80d2-da7ed617e134 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:30.472039 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f42e71-4540-4e1e-80d2-da7ed617e134 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:30.472312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f42e71-4540-4e1e-80d2-da7ed617e134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:30.534502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f42e71-4540-4e1e-80d2-da7ed617e134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:30.535941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f42e71-4540-4e1e-80d2-da7ed617e134 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:30.629093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 569/1128] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:36:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:36:30.635025 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685a420-3726-4656-a94d-e8876e72a4a1 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:30.728004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685a420-3726-4656-a94d-e8876e72a4a1 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:30.759777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c109b41-1bb9-4a0c-8f8d-e15694007f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:30.760612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c109b41-1bb9-4a0c-8f8d-e15694007f37 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:30.760890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c109b41-1bb9-4a0c-8f8d-e15694007f37 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:30.761161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c109b41-1bb9-4a0c-8f8d-e15694007f37 None admin] PATH_INFO: `/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:30.762307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c109b41-1bb9-4a0c-8f8d-e15694007f37 None admin] RBAC: Authorizing `identity:get_project(project_id=b48dc6c1df2e4d04bacc39bb20bb2d10)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:30.763785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c109b41-1bb9-4a0c-8f8d-e15694007f37 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:30.765444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 560/1129] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:36:30 2022] GET /identity/v3/projects/b48dc6c1df2e4d04bacc39bb20bb2d10 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:30.771533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f42e71-4540-4e1e-80d2-da7ed617e134 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:30.863462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f42e71-4540-4e1e-80d2-da7ed617e134 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:30.895191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c84473-1719-4a52-b6e0-b69c5aa0b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:30.895856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c84473-1719-4a52-b6e0-b69c5aa0b824 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:30.896138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c84473-1719-4a52-b6e0-b69c5aa0b824 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:30.896411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c84473-1719-4a52-b6e0-b69c5aa0b824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:30.897228 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c84473-1719-4a52-b6e0-b69c5aa0b824 None admin] RBAC: Adding query filter params (role.id=142e36ee06a7422e8e8d32a1080ea89a, scope.project.id=b48dc6c1df2e4d04bacc39bb20bb2d10, user.id=48724e4c329b46afb85fd51515efd4e1) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:30.897535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c84473-1719-4a52-b6e0-b69c5aa0b824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:30.898930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c84473-1719-4a52-b6e0-b69c5aa0b824 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:30.904985 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 570/1130] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:36:30 2022] GET /identity/v3/role_assignments?user.id=48724e4c329b46afb85fd51515efd4e1&scope.project.id=b48dc6c1df2e4d04bacc39bb20bb2d10&role.id=142e36ee06a7422e8e8d32a1080ea89a => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:33.155719 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00b82-1590-45c9-ad4f-38965c7049ee None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:33.156281 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00b82-1590-45c9-ad4f-38965c7049ee None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:33.156281 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00b82-1590-45c9-ad4f-38965c7049ee None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:33.157608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 561/1131] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:33.162745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd414b-8e5e-4e92-abd7-01fb8bcc7556 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:33.163173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd414b-8e5e-4e92-abd7-01fb8bcc7556 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:33.163292 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd414b-8e5e-4e92-abd7-01fb8bcc7556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:33.180268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-bdfd414b-8e5e-4e92-abd7-01fb8bcc7556 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:33.181423 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-bdfd414b-8e5e-4e92-abd7-01fb8bcc7556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:33.244118 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 571/1132] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:36:33.266170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00b82-1590-45c9-ad4f-38965c7049ee None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:33.363669 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00b82-1590-45c9-ad4f-38965c7049ee None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:33.394735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1928d-584b-406c-a778-3cd2f8e13698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:33.395538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1928d-584b-406c-a778-3cd2f8e13698 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:33.395820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1928d-584b-406c-a778-3cd2f8e13698 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:33.396090 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1928d-584b-406c-a778-3cd2f8e13698 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:33.397245 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1928d-584b-406c-a778-3cd2f8e13698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:33.398658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1928d-584b-406c-a778-3cd2f8e13698 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:33.400278 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 562/1133] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:33.406801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd414b-8e5e-4e92-abd7-01fb8bcc7556 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:33.499224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd414b-8e5e-4e92-abd7-01fb8bcc7556 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:33.531348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625466ab-5d3c-4f64-9397-b23ff02a9f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:33.531991 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625466ab-5d3c-4f64-9397-b23ff02a9f49 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:33.532271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625466ab-5d3c-4f64-9397-b23ff02a9f49 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:33.532545 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625466ab-5d3c-4f64-9397-b23ff02a9f49 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:33.533239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625466ab-5d3c-4f64-9397-b23ff02a9f49 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:33.534642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625466ab-5d3c-4f64-9397-b23ff02a9f49 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:33.557880 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 572/1134] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:36:33 2022] POST /identity/v3/projects => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:36:35.772142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461d43b-e190-4c75-b208-f49a5482c0ac None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:35.772660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461d43b-e190-4c75-b208-f49a5482c0ac None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:35.772660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461d43b-e190-4c75-b208-f49a5482c0ac None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:35.774035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 563/1135] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:35.779688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4367225-48e2-4b5c-aa07-19b3d9754720 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:35.780096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4367225-48e2-4b5c-aa07-19b3d9754720 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:35.780238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4367225-48e2-4b5c-aa07-19b3d9754720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:35.796329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a4367225-48e2-4b5c-aa07-19b3d9754720 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:35.797481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a4367225-48e2-4b5c-aa07-19b3d9754720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:35.860194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 573/1136] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:35.883866 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461d43b-e190-4c75-b208-f49a5482c0ac None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:35.977387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461d43b-e190-4c75-b208-f49a5482c0ac None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:36.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79897acb-1b4d-465f-a329-153581f0c2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:36.008441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897acb-1b4d-465f-a329-153581f0c2a4 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:36.008719 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897acb-1b4d-465f-a329-153581f0c2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:36.008988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79897acb-1b4d-465f-a329-153581f0c2a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:36.010121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79897acb-1b4d-465f-a329-153581f0c2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:36.011550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79897acb-1b4d-465f-a329-153581f0c2a4 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:36.013607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 564/1137] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:36:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:36.019199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4367225-48e2-4b5c-aa07-19b3d9754720 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:36.111234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4367225-48e2-4b5c-aa07-19b3d9754720 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:36.143088 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e419d6-643d-4530-8b8d-aef2948d4444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:36.143871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e419d6-643d-4530-8b8d-aef2948d4444 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:36.144147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e419d6-643d-4530-8b8d-aef2948d4444 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:36.144416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e419d6-643d-4530-8b8d-aef2948d4444 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:36.145104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e419d6-643d-4530-8b8d-aef2948d4444 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:36.146499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e419d6-643d-4530-8b8d-aef2948d4444 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:36.164901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 574/1138] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:36:36 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:36:38.411007 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e03ed-5dca-4f43-a422-9a33507b7d34 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:38.411578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e03ed-5dca-4f43-a422-9a33507b7d34 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:38.411578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e03ed-5dca-4f43-a422-9a33507b7d34 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:38.413188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 565/1139] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:38.418277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2313b-7c1a-416a-95e0-9fcdf56bb225 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:38.418728 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2313b-7c1a-416a-95e0-9fcdf56bb225 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:38.418833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2313b-7c1a-416a-95e0-9fcdf56bb225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:38.435358 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-4ec2313b-7c1a-416a-95e0-9fcdf56bb225 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:38.436503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4ec2313b-7c1a-416a-95e0-9fcdf56bb225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:38.499182 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 575/1140] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:38.521898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e03ed-5dca-4f43-a422-9a33507b7d34 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:38.615287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e03ed-5dca-4f43-a422-9a33507b7d34 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:38.646853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4ea53-642e-4f98-8542-5681ca524cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:38.647647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4ea53-642e-4f98-8542-5681ca524cd2 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:38.647929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4ea53-642e-4f98-8542-5681ca524cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:38.648201 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4ea53-642e-4f98-8542-5681ca524cd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:38.657739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4ea53-642e-4f98-8542-5681ca524cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-2be4ea53-642e-4f98-8542-5681ca524cd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:36:38.665218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:38.666359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:38.667491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 566/1141] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:36:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:38.672177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2313b-7c1a-416a-95e0-9fcdf56bb225 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:38.766240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2313b-7c1a-416a-95e0-9fcdf56bb225 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:38.797858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d70cd2-0621-4ecf-af24-cdcad2b067f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:38.798505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d70cd2-0621-4ecf-af24-cdcad2b067f2 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:38.798785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d70cd2-0621-4ecf-af24-cdcad2b067f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:38.799059 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d70cd2-0621-4ecf-af24-cdcad2b067f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:38.799825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d70cd2-0621-4ecf-af24-cdcad2b067f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:38.800131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d70cd2-0621-4ecf-af24-cdcad2b067f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:38.801477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d70cd2-0621-4ecf-af24-cdcad2b067f2 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:38.809047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 576/1142] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:36:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:38.815188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4ea53-642e-4f98-8542-5681ca524cd2 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:38.908118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4ea53-642e-4f98-8542-5681ca524cd2 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:38.940099 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914114d-9f5d-4813-ab88-4694e1b5c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:38.940950 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914114d-9f5d-4813-ab88-4694e1b5c722 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:38.941227 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914114d-9f5d-4813-ab88-4694e1b5c722 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:38.941495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914114d-9f5d-4813-ab88-4694e1b5c722 None admin] PATH_INFO: `/v3/users/95dedcfadb3042d59e6cf078cd301783` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:38.954748 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914114d-9f5d-4813-ab88-4694e1b5c722 None admin] RBAC: Authorizing `identity:get_user(user_id=95dedcfadb3042d59e6cf078cd301783)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:38.956487 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914114d-9f5d-4813-ab88-4694e1b5c722 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:38.958310 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 567/1143] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:38 2022] GET /identity/v3/users/95dedcfadb3042d59e6cf078cd301783 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:38.966354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d70cd2-0621-4ecf-af24-cdcad2b067f2 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:39.058945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d70cd2-0621-4ecf-af24-cdcad2b067f2 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:39.090454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfb738-d694-4843-8080-f5ffb9fcdcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:39.091084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb738-d694-4843-8080-f5ffb9fcdcce None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:39.091388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb738-d694-4843-8080-f5ffb9fcdcce None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:39.091661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfb738-d694-4843-8080-f5ffb9fcdcce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:39.154417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfb738-d694-4843-8080-f5ffb9fcdcce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:39.155859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfb738-d694-4843-8080-f5ffb9fcdcce None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:39.246531 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 577/1144] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:36:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:36:39.252883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914114d-9f5d-4813-ab88-4694e1b5c722 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:39.353805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914114d-9f5d-4813-ab88-4694e1b5c722 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:39.385136 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366fe83-2487-4ee1-ba43-d915a1376320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:39.385979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366fe83-2487-4ee1-ba43-d915a1376320 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:39.386257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366fe83-2487-4ee1-ba43-d915a1376320 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:39.386526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366fe83-2487-4ee1-ba43-d915a1376320 None admin] PATH_INFO: `/v3/projects/b9dce380788646da85c69bc7b8113a86` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:39.388678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366fe83-2487-4ee1-ba43-d915a1376320 None admin] RBAC: Authorizing `identity:get_project(project_id=b9dce380788646da85c69bc7b8113a86)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:39.390741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366fe83-2487-4ee1-ba43-d915a1376320 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:39.392475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 568/1145] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:36:39 2022] GET /identity/v3/projects/b9dce380788646da85c69bc7b8113a86 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:39.398517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfb738-d694-4843-8080-f5ffb9fcdcce None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:39.490953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfb738-d694-4843-8080-f5ffb9fcdcce None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:39.522883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145c93c-e157-4a40-b748-7586eee8b061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:39.523484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145c93c-e157-4a40-b748-7586eee8b061 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:39.523762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145c93c-e157-4a40-b748-7586eee8b061 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:39.524030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145c93c-e157-4a40-b748-7586eee8b061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:39.524846 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145c93c-e157-4a40-b748-7586eee8b061 None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=b9dce380788646da85c69bc7b8113a86, user.id=95dedcfadb3042d59e6cf078cd301783) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:39.525151 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145c93c-e157-4a40-b748-7586eee8b061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:39.526540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145c93c-e157-4a40-b748-7586eee8b061 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:39.532194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 578/1146] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:36:39 2022] GET /identity/v3/role_assignments?user.id=95dedcfadb3042d59e6cf078cd301783&scope.project.id=b9dce380788646da85c69bc7b8113a86&role.id=70e67f35994843ae942d4f1703d5619e => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:41.711477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a927d0c-389b-4a1c-a587-a73687dbc488 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:41.712004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a927d0c-389b-4a1c-a587-a73687dbc488 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:41.712004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a927d0c-389b-4a1c-a587-a73687dbc488 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:41.713303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 569/1147] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:41.718682 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40105-2902-4d24-b61e-3a673626dabb None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:41.719086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40105-2902-4d24-b61e-3a673626dabb None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:41.719236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40105-2902-4d24-b61e-3a673626dabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:41.735742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-38b40105-2902-4d24-b61e-3a673626dabb None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:41.736883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-38b40105-2902-4d24-b61e-3a673626dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:41.797950 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 579/1148] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:36:41.820474 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a927d0c-389b-4a1c-a587-a73687dbc488 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:41.913494 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a927d0c-389b-4a1c-a587-a73687dbc488 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:41.944981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ba76e-1e16-43aa-b9b8-701093cc2e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:41.946008 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ba76e-1e16-43aa-b9b8-701093cc2e7f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:41.946284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ba76e-1e16-43aa-b9b8-701093cc2e7f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:41.946554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ba76e-1e16-43aa-b9b8-701093cc2e7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:41.955998 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ba76e-1e16-43aa-b9b8-701093cc2e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-918ba76e-1e16-43aa-b9b8-701093cc2e7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:36:41.963469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:41.964631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:41.965509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 570/1149] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:36:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:41.970581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b40105-2902-4d24-b61e-3a673626dabb None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:42.064616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b40105-2902-4d24-b61e-3a673626dabb None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:42.096640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a75c6a-93cd-4727-a5e0-40784076b41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:42.097293 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a75c6a-93cd-4727-a5e0-40784076b41d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:42.097574 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a75c6a-93cd-4727-a5e0-40784076b41d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:42.097845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a75c6a-93cd-4727-a5e0-40784076b41d None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:42.098581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a75c6a-93cd-4727-a5e0-40784076b41d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:42.098886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a75c6a-93cd-4727-a5e0-40784076b41d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:42.100269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a75c6a-93cd-4727-a5e0-40784076b41d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:42.108514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 580/1150] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:36:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:42.114352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ba76e-1e16-43aa-b9b8-701093cc2e7f None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:42.207683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ba76e-1e16-43aa-b9b8-701093cc2e7f None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:42.239250 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1e7f0-13b7-4bd4-ab91-83bb48b75e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:42.240055 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1e7f0-13b7-4bd4-ab91-83bb48b75e46 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:42.240336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1e7f0-13b7-4bd4-ab91-83bb48b75e46 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:42.240611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1e7f0-13b7-4bd4-ab91-83bb48b75e46 None admin] PATH_INFO: `/v3/users/95dedcfadb3042d59e6cf078cd301783` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:42.241770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1e7f0-13b7-4bd4-ab91-83bb48b75e46 None admin] RBAC: Authorizing `identity:get_user(user_id=95dedcfadb3042d59e6cf078cd301783)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:42.243176 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1e7f0-13b7-4bd4-ab91-83bb48b75e46 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:42.244784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 571/1151] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:42 2022] GET /identity/v3/users/95dedcfadb3042d59e6cf078cd301783 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:42.250536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a75c6a-93cd-4727-a5e0-40784076b41d None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:42.344766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a75c6a-93cd-4727-a5e0-40784076b41d None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:42.376243 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391b4d9-bfb2-4150-ad8b-bddecd71254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:42.377090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391b4d9-bfb2-4150-ad8b-bddecd71254a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:42.377369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391b4d9-bfb2-4150-ad8b-bddecd71254a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:42.377641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391b4d9-bfb2-4150-ad8b-bddecd71254a None admin] PATH_INFO: `/v3/projects/b9dce380788646da85c69bc7b8113a86` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:42.378808 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391b4d9-bfb2-4150-ad8b-bddecd71254a None admin] RBAC: Authorizing `identity:get_project(project_id=b9dce380788646da85c69bc7b8113a86)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:42.380243 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391b4d9-bfb2-4150-ad8b-bddecd71254a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:42.381921 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 581/1152] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:36:42 2022] GET /identity/v3/projects/b9dce380788646da85c69bc7b8113a86 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:42.388272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1e7f0-13b7-4bd4-ab91-83bb48b75e46 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:42.481673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1e7f0-13b7-4bd4-ab91-83bb48b75e46 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:42.512850 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c1cd7-b2dd-4eaa-9676-9fe9436aa8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:42.513713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c1cd7-b2dd-4eaa-9676-9fe9436aa8cf None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:42.513991 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c1cd7-b2dd-4eaa-9676-9fe9436aa8cf None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:42.514260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c1cd7-b2dd-4eaa-9676-9fe9436aa8cf None admin] PATH_INFO: `/v3/projects/b9dce380788646da85c69bc7b8113a86/users/95dedcfadb3042d59e6cf078cd301783/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:42.516188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c1cd7-b2dd-4eaa-9676-9fe9436aa8cf None admin] RBAC: Authorizing `identity:create_grant(project_id=b9dce380788646da85c69bc7b8113a86, user_id=95dedcfadb3042d59e6cf078cd301783, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:42.517596 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c1cd7-b2dd-4eaa-9676-9fe9436aa8cf None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:42.530684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 572/1153] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:36:42 2022] PUT /identity/v3/projects/b9dce380788646da85c69bc7b8113a86/users/95dedcfadb3042d59e6cf078cd301783/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:36:44.739639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc36426-bfb9-4470-8d14-e58b6f451a91 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:44.740171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc36426-bfb9-4470-8d14-e58b6f451a91 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:44.740171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc36426-bfb9-4470-8d14-e58b6f451a91 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:44.741449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 582/1154] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:44.746471 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd00c-a9b8-4971-a1b3-23f592478c64 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:44.747487 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd00c-a9b8-4971-a1b3-23f592478c64 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:44.747664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd00c-a9b8-4971-a1b3-23f592478c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:44.763814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-1d3fd00c-a9b8-4971-a1b3-23f592478c64 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:44.764971 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1d3fd00c-a9b8-4971-a1b3-23f592478c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:44.826812 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 573/1155] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:44.849739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc36426-bfb9-4470-8d14-e58b6f451a91 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:44.945477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc36426-bfb9-4470-8d14-e58b6f451a91 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:44.976875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d488ea-2e10-42e6-af00-32a0258179e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:44.977639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d488ea-2e10-42e6-af00-32a0258179e2 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:44.977915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d488ea-2e10-42e6-af00-32a0258179e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:44.978182 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d488ea-2e10-42e6-af00-32a0258179e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:44.987975 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d488ea-2e10-42e6-af00-32a0258179e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-58d488ea-2e10-42e6-af00-32a0258179e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:36:44.995613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:44.996730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:44.997936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 583/1156] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:36:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:45.002499 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fd00c-a9b8-4971-a1b3-23f592478c64 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:45.095634 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fd00c-a9b8-4971-a1b3-23f592478c64 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:45.126712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9af7d-f001-47d2-a6d9-367dd766a108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:45.127383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9af7d-f001-47d2-a6d9-367dd766a108 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:45.127665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9af7d-f001-47d2-a6d9-367dd766a108 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:45.127941 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9af7d-f001-47d2-a6d9-367dd766a108 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:45.128672 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9af7d-f001-47d2-a6d9-367dd766a108 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:45.128977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9af7d-f001-47d2-a6d9-367dd766a108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:45.130320 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9af7d-f001-47d2-a6d9-367dd766a108 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:45.138434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 574/1157] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:36:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:45.144061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d488ea-2e10-42e6-af00-32a0258179e2 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:45.237827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d488ea-2e10-42e6-af00-32a0258179e2 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:45.270197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60464b6c-46b9-4828-85c5-00a67f839a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:45.270986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60464b6c-46b9-4828-85c5-00a67f839a89 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:45.271294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60464b6c-46b9-4828-85c5-00a67f839a89 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:45.271566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60464b6c-46b9-4828-85c5-00a67f839a89 None admin] PATH_INFO: `/v3/users/95dedcfadb3042d59e6cf078cd301783` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:45.272724 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60464b6c-46b9-4828-85c5-00a67f839a89 None admin] RBAC: Authorizing `identity:get_user(user_id=95dedcfadb3042d59e6cf078cd301783)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:45.274120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60464b6c-46b9-4828-85c5-00a67f839a89 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:45.275794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 584/1158] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:45 2022] GET /identity/v3/users/95dedcfadb3042d59e6cf078cd301783 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:45.281432 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9af7d-f001-47d2-a6d9-367dd766a108 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:45.374865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9af7d-f001-47d2-a6d9-367dd766a108 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:45.405562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88b7b4-ba69-4274-b073-4cab308e23b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:45.406192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88b7b4-ba69-4274-b073-4cab308e23b1 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:45.406468 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88b7b4-ba69-4274-b073-4cab308e23b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:45.406738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88b7b4-ba69-4274-b073-4cab308e23b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:45.468648 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88b7b4-ba69-4274-b073-4cab308e23b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:45.470062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88b7b4-ba69-4274-b073-4cab308e23b1 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:45.559558 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 575/1159] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:36:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:36:45.565353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60464b6c-46b9-4828-85c5-00a67f839a89 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:45.663107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60464b6c-46b9-4828-85c5-00a67f839a89 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:45.694064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80943246-1966-45eb-b13b-32baa96c3569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:45.694899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80943246-1966-45eb-b13b-32baa96c3569 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:45.695453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80943246-1966-45eb-b13b-32baa96c3569 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:45.695725 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80943246-1966-45eb-b13b-32baa96c3569 None admin] PATH_INFO: `/v3/projects/b9dce380788646da85c69bc7b8113a86` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:45.696870 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80943246-1966-45eb-b13b-32baa96c3569 None admin] RBAC: Authorizing `identity:get_project(project_id=b9dce380788646da85c69bc7b8113a86)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:45.698269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80943246-1966-45eb-b13b-32baa96c3569 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:45.701828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 585/1160] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:36:45 2022] GET /identity/v3/projects/b9dce380788646da85c69bc7b8113a86 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:45.706778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88b7b4-ba69-4274-b073-4cab308e23b1 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:45.797575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88b7b4-ba69-4274-b073-4cab308e23b1 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:45.828825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938401b0-3077-4d25-bd4f-2a705d3e1d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:45.829401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938401b0-3077-4d25-bd4f-2a705d3e1d38 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:45.829678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938401b0-3077-4d25-bd4f-2a705d3e1d38 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:45.829950 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938401b0-3077-4d25-bd4f-2a705d3e1d38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:45.830762 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938401b0-3077-4d25-bd4f-2a705d3e1d38 None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=b9dce380788646da85c69bc7b8113a86, user.id=95dedcfadb3042d59e6cf078cd301783) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:45.831065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938401b0-3077-4d25-bd4f-2a705d3e1d38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:45.832495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938401b0-3077-4d25-bd4f-2a705d3e1d38 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:45.837936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 576/1161] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:36:45 2022] GET /identity/v3/role_assignments?user.id=95dedcfadb3042d59e6cf078cd301783&scope.project.id=b9dce380788646da85c69bc7b8113a86&role.id=70e67f35994843ae942d4f1703d5619e => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:48.065699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56c04a-a6c2-4655-924b-a1e8223a6f2c None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:48.066267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56c04a-a6c2-4655-924b-a1e8223a6f2c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:48.066267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56c04a-a6c2-4655-924b-a1e8223a6f2c None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:48.067647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 586/1162] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:48.073061 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a73699-532e-42ff-9ffc-160b6e44b443 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:48.073490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a73699-532e-42ff-9ffc-160b6e44b443 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:48.073588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a73699-532e-42ff-9ffc-160b6e44b443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:48.090088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b4a73699-532e-42ff-9ffc-160b6e44b443 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:48.091882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b4a73699-532e-42ff-9ffc-160b6e44b443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:48.153560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 577/1163] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:48.175110 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56c04a-a6c2-4655-924b-a1e8223a6f2c None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:48.271718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56c04a-a6c2-4655-924b-a1e8223a6f2c None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:48.302988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58345cb-21fe-4d81-aa4b-bcce9d67403d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:48.303655 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58345cb-21fe-4d81-aa4b-bcce9d67403d None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:48.303937 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58345cb-21fe-4d81-aa4b-bcce9d67403d None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:48.304210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58345cb-21fe-4d81-aa4b-bcce9d67403d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:48.367449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58345cb-21fe-4d81-aa4b-bcce9d67403d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:48.368819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58345cb-21fe-4d81-aa4b-bcce9d67403d None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:48.460436 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 587/1164] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:36:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:36:48.466396 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a73699-532e-42ff-9ffc-160b6e44b443 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:48.560044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a73699-532e-42ff-9ffc-160b6e44b443 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:48.591922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf6483-d9ba-40bc-a290-362ba73c4fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:48.592702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf6483-d9ba-40bc-a290-362ba73c4fe4 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:48.592978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf6483-d9ba-40bc-a290-362ba73c4fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:48.593249 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf6483-d9ba-40bc-a290-362ba73c4fe4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:48.599590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf6483-d9ba-40bc-a290-362ba73c4fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:48.601014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf6483-d9ba-40bc-a290-362ba73c4fe4 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-d9bf6483-d9ba-40bc-a290-362ba73c4fe4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:48.615325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:48.616369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:36:48.617341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 578/1165] 10.222.0.73 () {56 vars in 1117 bytes} [Wed May 4 13:36:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:48.623092 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58345cb-21fe-4d81-aa4b-bcce9d67403d None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:48.714556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58345cb-21fe-4d81-aa4b-bcce9d67403d None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:48.746534 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f943ad1-4ba8-4af6-8c52-1d9e49baa0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:48.747790 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f943ad1-4ba8-4af6-8c52-1d9e49baa0fa None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:48.748068 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f943ad1-4ba8-4af6-8c52-1d9e49baa0fa None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:48.748336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f943ad1-4ba8-4af6-8c52-1d9e49baa0fa None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:48.749036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f943ad1-4ba8-4af6-8c52-1d9e49baa0fa None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:48.749334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f943ad1-4ba8-4af6-8c52-1d9e49baa0fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:48.750655 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f943ad1-4ba8-4af6-8c52-1d9e49baa0fa None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:48.757482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 588/1166] 10.222.0.73 () {56 vars in 1115 bytes} [Wed May 4 13:36:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:50.951172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07455799-6946-4e68-bf1a-602d0e1c503d None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:50.951770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07455799-6946-4e68-bf1a-602d0e1c503d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:50.951770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07455799-6946-4e68-bf1a-602d0e1c503d None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:50.953097 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 579/1167] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:50.958186 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a328786-fee0-417d-a072-e45d810c66d5 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:50.958597 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a328786-fee0-417d-a072-e45d810c66d5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:50.958725 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a328786-fee0-417d-a072-e45d810c66d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:50.974667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-9a328786-fee0-417d-a072-e45d810c66d5 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:50.975843 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-9a328786-fee0-417d-a072-e45d810c66d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:51.037077 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 589/1168] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:51.059689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07455799-6946-4e68-bf1a-602d0e1c503d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:51.155749 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07455799-6946-4e68-bf1a-602d0e1c503d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:51.187100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810df9a-64a9-4cf1-8bc7-feebdb8aee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:51.187763 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810df9a-64a9-4cf1-8bc7-feebdb8aee4d None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:51.188045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810df9a-64a9-4cf1-8bc7-feebdb8aee4d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:51.188321 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810df9a-64a9-4cf1-8bc7-feebdb8aee4d None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:51.189054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810df9a-64a9-4cf1-8bc7-feebdb8aee4d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:51.190403 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810df9a-64a9-4cf1-8bc7-feebdb8aee4d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:51.204662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 580/1169] 10.222.0.73 () {60 vars in 1138 bytes} [Wed May 4 13:36:51 2022] POST /identity/v3/domains => generated 267 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:36:53.443187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d259156-0e85-40d1-bf1f-f3fb10ba29e5 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:53.443696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d259156-0e85-40d1-bf1f-f3fb10ba29e5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:53.443785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d259156-0e85-40d1-bf1f-f3fb10ba29e5 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:53.445100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 590/1170] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:53.450380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6cfa8-cf68-4b69-848d-4305f39de1ee None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:53.450807 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6cfa8-cf68-4b69-848d-4305f39de1ee None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:53.450963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6cfa8-cf68-4b69-848d-4305f39de1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:53.467583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-09b6cfa8-cf68-4b69-848d-4305f39de1ee None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:53.468742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-09b6cfa8-cf68-4b69-848d-4305f39de1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:53.529980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 581/1171] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 13:36:53.553057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d259156-0e85-40d1-bf1f-f3fb10ba29e5 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:53.649944 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d259156-0e85-40d1-bf1f-f3fb10ba29e5 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:53.682164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa77e8-09d0-4cea-832b-d440e8ed4aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:53.683011 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa77e8-09d0-4cea-832b-d440e8ed4aaf None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:53.683312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa77e8-09d0-4cea-832b-d440e8ed4aaf None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:53.683582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa77e8-09d0-4cea-832b-d440e8ed4aaf None admin] PATH_INFO: `/v3/domains/0c525022f821475c92ce98ef55a94390` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:53.693287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa77e8-09d0-4cea-832b-d440e8ed4aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=0c525022f821475c92ce98ef55a94390)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:53.694697 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa77e8-09d0-4cea-832b-d440e8ed4aaf None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:53.696572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 591/1172] 10.222.0.73 () {56 vars in 1183 bytes} [Wed May 4 13:36:53 2022] GET /identity/v3/domains/0c525022f821475c92ce98ef55a94390 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:53.702392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6cfa8-cf68-4b69-848d-4305f39de1ee None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:53.796837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6cfa8-cf68-4b69-848d-4305f39de1ee None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:53.828506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9dc77-8f35-4851-a0a3-08d14164c960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:53.829157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9dc77-8f35-4851-a0a3-08d14164c960 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:53.829439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9dc77-8f35-4851-a0a3-08d14164c960 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:53.829715 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9dc77-8f35-4851-a0a3-08d14164c960 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:53.830425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9dc77-8f35-4851-a0a3-08d14164c960 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:53.831876 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9dc77-8f35-4851-a0a3-08d14164c960 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:53.855968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 582/1173] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:36:53 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:36:56.087685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b20555-9b04-4a60-94dc-c45abedcd9ab None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:56.088255 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b20555-9b04-4a60-94dc-c45abedcd9ab None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:56.088255 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b20555-9b04-4a60-94dc-c45abedcd9ab None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:56.089587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 592/1174] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:56.094764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6eef8-5010-4551-b80a-8f8b189310c2 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:56.095186 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6eef8-5010-4551-b80a-8f8b189310c2 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:56.095491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6eef8-5010-4551-b80a-8f8b189310c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:56.112516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-bcc6eef8-5010-4551-b80a-8f8b189310c2 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:56.113674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bcc6eef8-5010-4551-b80a-8f8b189310c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:56.175318 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 583/1175] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:56.200696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b20555-9b04-4a60-94dc-c45abedcd9ab None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:56.296005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b20555-9b04-4a60-94dc-c45abedcd9ab None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:56.328186 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffc757-913a-4fb8-a761-1a5c54635df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:56.329030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffc757-913a-4fb8-a761-1a5c54635df7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:56.329308 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffc757-913a-4fb8-a761-1a5c54635df7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:56.329575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffc757-913a-4fb8-a761-1a5c54635df7 None admin] PATH_INFO: `/v3/domains/0c525022f821475c92ce98ef55a94390` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:56.330721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffc757-913a-4fb8-a761-1a5c54635df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0c525022f821475c92ce98ef55a94390)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:56.332145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffc757-913a-4fb8-a761-1a5c54635df7 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:56.333723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 593/1176] 10.222.0.73 () {56 vars in 1183 bytes} [Wed May 4 13:36:56 2022] GET /identity/v3/domains/0c525022f821475c92ce98ef55a94390 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:56.339656 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6eef8-5010-4551-b80a-8f8b189310c2 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:56.433674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6eef8-5010-4551-b80a-8f8b189310c2 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:56.464654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43320161-ee7a-4739-9269-407e086027ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:56.465829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43320161-ee7a-4739-9269-407e086027ce None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:56.466112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43320161-ee7a-4739-9269-407e086027ce None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:56.466389 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43320161-ee7a-4739-9269-407e086027ce None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:56.467080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43320161-ee7a-4739-9269-407e086027ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:56.468534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43320161-ee7a-4739-9269-407e086027ce None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:56.487764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 584/1177] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:36:56 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:36:58.724844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645934e-e55a-42d7-9128-4c48eeb82377 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:58.725369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645934e-e55a-42d7-9128-4c48eeb82377 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:58.725369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645934e-e55a-42d7-9128-4c48eeb82377 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:58.726650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 594/1178] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:36:58.731741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933a5de-26d9-4212-86b7-5739f983be9e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:58.732170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933a5de-26d9-4212-86b7-5739f983be9e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:58.732299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933a5de-26d9-4212-86b7-5739f983be9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:58.749021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-2933a5de-26d9-4212-86b7-5739f983be9e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:36:58.750171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2933a5de-26d9-4212-86b7-5739f983be9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:36:58.813355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 585/1179] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:36:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:36:58.836393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645934e-e55a-42d7-9128-4c48eeb82377 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:58.932107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645934e-e55a-42d7-9128-4c48eeb82377 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:58.963508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61490f-80dc-40d4-9f28-e70d9e3699f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:58.964283 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61490f-80dc-40d4-9f28-e70d9e3699f5 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:58.964566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61490f-80dc-40d4-9f28-e70d9e3699f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:58.964842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61490f-80dc-40d4-9f28-e70d9e3699f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:58.975004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61490f-80dc-40d4-9f28-e70d9e3699f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-fe61490f-80dc-40d4-9f28-e70d9e3699f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:36:58.983111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:36:58.984409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:36:58.985582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:36:58.985582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:36:58.985582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:36:58.985582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:36:58.985582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:36:58.985582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:36:58.985582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:36:58.985582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:36:58.985582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:36:58.985582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:36:58.985582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:36:58.985582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:36:58.987352 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 595/1180] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:36:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:36:58.989970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933a5de-26d9-4212-86b7-5739f983be9e None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:59.096058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933a5de-26d9-4212-86b7-5739f983be9e None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:59.128038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d7bd8-dfac-454d-9c55-d98289a32f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:59.128694 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d7bd8-dfac-454d-9c55-d98289a32f44 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:59.128969 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d7bd8-dfac-454d-9c55-d98289a32f44 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:59.129240 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d7bd8-dfac-454d-9c55-d98289a32f44 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:59.129973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d7bd8-dfac-454d-9c55-d98289a32f44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:59.130275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d7bd8-dfac-454d-9c55-d98289a32f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:59.131666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d7bd8-dfac-454d-9c55-d98289a32f44 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:59.139854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 586/1181] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:36:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:59.145629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61490f-80dc-40d4-9f28-e70d9e3699f5 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:59.238189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61490f-80dc-40d4-9f28-e70d9e3699f5 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:59.268934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fc412-cf3e-497b-b6bc-2cd543d97f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:59.269769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fc412-cf3e-497b-b6bc-2cd543d97f06 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:59.270045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fc412-cf3e-497b-b6bc-2cd543d97f06 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:59.270314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fc412-cf3e-497b-b6bc-2cd543d97f06 None admin] PATH_INFO: `/v3/users/9347d6265e8f4992aec31a8c09a5e113` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:59.283714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fc412-cf3e-497b-b6bc-2cd543d97f06 None admin] RBAC: Authorizing `identity:get_user(user_id=9347d6265e8f4992aec31a8c09a5e113)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:59.285117 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fc412-cf3e-497b-b6bc-2cd543d97f06 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:59.286698 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 596/1182] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:36:59 2022] GET /identity/v3/users/9347d6265e8f4992aec31a8c09a5e113 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:59.292292 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d7bd8-dfac-454d-9c55-d98289a32f44 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:59.384805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d7bd8-dfac-454d-9c55-d98289a32f44 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:59.416998 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe911ad5-6c97-4f15-ac73-d9b639062381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:59.417641 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe911ad5-6c97-4f15-ac73-d9b639062381 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:59.417922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe911ad5-6c97-4f15-ac73-d9b639062381 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:59.418197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe911ad5-6c97-4f15-ac73-d9b639062381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:59.481922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe911ad5-6c97-4f15-ac73-d9b639062381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:59.483383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe911ad5-6c97-4f15-ac73-d9b639062381 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:59.573383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 587/1183] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:36:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:36:59.579863 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fc412-cf3e-497b-b6bc-2cd543d97f06 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:59.670808 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fc412-cf3e-497b-b6bc-2cd543d97f06 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:59.704226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca25492-318a-4dfe-8f8d-d9aa1798949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:59.705073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca25492-318a-4dfe-8f8d-d9aa1798949f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:59.705353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca25492-318a-4dfe-8f8d-d9aa1798949f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:59.705628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca25492-318a-4dfe-8f8d-d9aa1798949f None admin] PATH_INFO: `/v3/projects/1296f998228a4442aaf65b80cb578426` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:59.706776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca25492-318a-4dfe-8f8d-d9aa1798949f None admin] RBAC: Authorizing `identity:get_project(project_id=1296f998228a4442aaf65b80cb578426)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:59.708209 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca25492-318a-4dfe-8f8d-d9aa1798949f None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:59.709871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 597/1184] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:36:59 2022] GET /identity/v3/projects/1296f998228a4442aaf65b80cb578426 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:36:59.715893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe911ad5-6c97-4f15-ac73-d9b639062381 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:36:59.808929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe911ad5-6c97-4f15-ac73-d9b639062381 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:36:59.841723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b0d49-e602-4164-8442-8232502a331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:36:59.842300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b0d49-e602-4164-8442-8232502a331f None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:36:59.842604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b0d49-e602-4164-8442-8232502a331f None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:36:59.842880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b0d49-e602-4164-8442-8232502a331f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:36:59.843725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b0d49-e602-4164-8442-8232502a331f None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=1296f998228a4442aaf65b80cb578426, user.id=9347d6265e8f4992aec31a8c09a5e113) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:36:59.844032 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b0d49-e602-4164-8442-8232502a331f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:36:59.845429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b0d49-e602-4164-8442-8232502a331f None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:36:59.850603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 588/1185] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:36:59 2022] GET /identity/v3/role_assignments?user.id=9347d6265e8f4992aec31a8c09a5e113&scope.project.id=1296f998228a4442aaf65b80cb578426&role.id=70e67f35994843ae942d4f1703d5619e => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:37:02.042789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd360c0a-f9d9-461d-b09e-e09d9c329273 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:02.043383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd360c0a-f9d9-461d-b09e-e09d9c329273 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:02.043643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd360c0a-f9d9-461d-b09e-e09d9c329273 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:02.045063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 598/1186] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:37:02.050396 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83be5f-9ca8-426d-9aaa-6376f295254d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:02.050827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83be5f-9ca8-426d-9aaa-6376f295254d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:02.050935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83be5f-9ca8-426d-9aaa-6376f295254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:02.066974 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-0c83be5f-9ca8-426d-9aaa-6376f295254d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:37:02.068165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0c83be5f-9ca8-426d-9aaa-6376f295254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:37:02.130256 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 589/1187] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:37:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:37:02.152281 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd360c0a-f9d9-461d-b09e-e09d9c329273 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:37:02.248400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd360c0a-f9d9-461d-b09e-e09d9c329273 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:37:02.280757 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98605d29-b783-434e-9f26-209dea4e168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:37:02.281536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98605d29-b783-434e-9f26-209dea4e168f None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:02.281819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98605d29-b783-434e-9f26-209dea4e168f None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:02.282094 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98605d29-b783-434e-9f26-209dea4e168f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:02.291669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98605d29-b783-434e-9f26-209dea4e168f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-98605d29-b783-434e-9f26-209dea4e168f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:37:02.299437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:37:02.300529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:37:02.305842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 599/1188] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:37:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:37:02.306717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83be5f-9ca8-426d-9aaa-6376f295254d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:37:02.400109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83be5f-9ca8-426d-9aaa-6376f295254d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:37:02.431271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd1fc4-ddac-4fa2-b974-f0194a828d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:37:02.431922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd1fc4-ddac-4fa2-b974-f0194a828d8d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:02.432204 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd1fc4-ddac-4fa2-b974-f0194a828d8d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:02.432480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd1fc4-ddac-4fa2-b974-f0194a828d8d None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:02.433219 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd1fc4-ddac-4fa2-b974-f0194a828d8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:37:02.433523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd1fc4-ddac-4fa2-b974-f0194a828d8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:37:02.435429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd1fc4-ddac-4fa2-b974-f0194a828d8d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:37:02.443187 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 590/1189] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:37:02.449335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98605d29-b783-434e-9f26-209dea4e168f None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:37:02.543066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98605d29-b783-434e-9f26-209dea4e168f None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:37:02.574433 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743f0bd-a912-467e-9737-c6063d301017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:37:02.575806 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743f0bd-a912-467e-9737-c6063d301017 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:02.576083 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743f0bd-a912-467e-9737-c6063d301017 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:02.576354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743f0bd-a912-467e-9737-c6063d301017 None admin] PATH_INFO: `/v3/users/9347d6265e8f4992aec31a8c09a5e113` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:02.577503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743f0bd-a912-467e-9737-c6063d301017 None admin] RBAC: Authorizing `identity:get_user(user_id=9347d6265e8f4992aec31a8c09a5e113)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:37:02.578899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743f0bd-a912-467e-9737-c6063d301017 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:37:02.580491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 600/1190] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:37:02 2022] GET /identity/v3/users/9347d6265e8f4992aec31a8c09a5e113 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:37:02.586587 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd1fc4-ddac-4fa2-b974-f0194a828d8d None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:37:02.678393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd1fc4-ddac-4fa2-b974-f0194a828d8d None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:37:02.710036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63ddbe-bb1f-4574-a628-a5904a24eb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:37:02.710875 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63ddbe-bb1f-4574-a628-a5904a24eb05 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:02.711154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63ddbe-bb1f-4574-a628-a5904a24eb05 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:02.711452 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63ddbe-bb1f-4574-a628-a5904a24eb05 None admin] PATH_INFO: `/v3/projects/1296f998228a4442aaf65b80cb578426` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:02.712606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63ddbe-bb1f-4574-a628-a5904a24eb05 None admin] RBAC: Authorizing `identity:get_project(project_id=1296f998228a4442aaf65b80cb578426)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:37:02.714008 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63ddbe-bb1f-4574-a628-a5904a24eb05 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:37:02.715720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 591/1191] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:37:02 2022] GET /identity/v3/projects/1296f998228a4442aaf65b80cb578426 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:37:02.721693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743f0bd-a912-467e-9737-c6063d301017 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:37:02.815300 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743f0bd-a912-467e-9737-c6063d301017 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:37:02.846154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd406fd-f612-4a63-ad11-10d84184b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:37:02.846964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd406fd-f612-4a63-ad11-10d84184b21b None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:02.847313 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd406fd-f612-4a63-ad11-10d84184b21b None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:02.847589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd406fd-f612-4a63-ad11-10d84184b21b None admin] PATH_INFO: `/v3/projects/1296f998228a4442aaf65b80cb578426/users/9347d6265e8f4992aec31a8c09a5e113/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:02.849482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd406fd-f612-4a63-ad11-10d84184b21b None admin] RBAC: Authorizing `identity:create_grant(project_id=1296f998228a4442aaf65b80cb578426, user_id=9347d6265e8f4992aec31a8c09a5e113, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:37:02.850876 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd406fd-f612-4a63-ad11-10d84184b21b None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:37:02.864152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 601/1192] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:37:02 2022] PUT /identity/v3/projects/1296f998228a4442aaf65b80cb578426/users/9347d6265e8f4992aec31a8c09a5e113/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:37:05.038551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97d52d-f1ed-46a5-b8ae-865283f2357b None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:05.039279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97d52d-f1ed-46a5-b8ae-865283f2357b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:05.039560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97d52d-f1ed-46a5-b8ae-865283f2357b None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:05.040933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 592/1193] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:37:05.046663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6a4a-90b6-49ff-83fc-559b59e88091 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:05.047090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6a4a-90b6-49ff-83fc-559b59e88091 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:05.047225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6a4a-90b6-49ff-83fc-559b59e88091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:05.063991 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-844b6a4a-90b6-49ff-83fc-559b59e88091 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:37:05.065145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-844b6a4a-90b6-49ff-83fc-559b59e88091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:37:05.127493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 602/1194] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:37:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:37:05.150037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97d52d-f1ed-46a5-b8ae-865283f2357b None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:37:05.245064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97d52d-f1ed-46a5-b8ae-865283f2357b None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:37:05.275698 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082cffb-f5d6-4ca2-a52a-6ad0d7b9cea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:37:05.276460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082cffb-f5d6-4ca2-a52a-6ad0d7b9cea8 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:05.276761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082cffb-f5d6-4ca2-a52a-6ad0d7b9cea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:05.277031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082cffb-f5d6-4ca2-a52a-6ad0d7b9cea8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:05.287436 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082cffb-f5d6-4ca2-a52a-6ad0d7b9cea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-d082cffb-f5d6-4ca2-a52a-6ad0d7b9cea8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:37:05.294944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:37:05.296088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:37:05.297137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:37:05.297137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:37:05.297137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:37:05.297137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:37:05.297137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:37:05.297137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:37:05.297137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:37:05.297137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:37:05.297137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:37:05.297137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:37:05.297137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:37:05.297137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:37:05.299362 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 593/1195] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:37:05.301965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6a4a-90b6-49ff-83fc-559b59e88091 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:37:05.395112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6a4a-90b6-49ff-83fc-559b59e88091 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:37:05.426879 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf623bf-57df-481c-9981-826f72907c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:37:05.427564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf623bf-57df-481c-9981-826f72907c48 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:05.427845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf623bf-57df-481c-9981-826f72907c48 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:05.428114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf623bf-57df-481c-9981-826f72907c48 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:05.428852 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf623bf-57df-481c-9981-826f72907c48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:37:05.429154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf623bf-57df-481c-9981-826f72907c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:37:05.430497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf623bf-57df-481c-9981-826f72907c48 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:37:05.438541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 603/1196] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:37:05.444172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082cffb-f5d6-4ca2-a52a-6ad0d7b9cea8 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:37:05.536897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082cffb-f5d6-4ca2-a52a-6ad0d7b9cea8 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:37:05.568197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b601602-47a7-462c-a7b0-375ed3b83d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:37:05.568985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b601602-47a7-462c-a7b0-375ed3b83d5e None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:05.569267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b601602-47a7-462c-a7b0-375ed3b83d5e None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:05.569542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b601602-47a7-462c-a7b0-375ed3b83d5e None admin] PATH_INFO: `/v3/users/9347d6265e8f4992aec31a8c09a5e113` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:05.570950 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b601602-47a7-462c-a7b0-375ed3b83d5e None admin] RBAC: Authorizing `identity:get_user(user_id=9347d6265e8f4992aec31a8c09a5e113)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:37:05.572390 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b601602-47a7-462c-a7b0-375ed3b83d5e None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:37:05.573967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 594/1197] 10.222.0.73 () {56 vars in 1177 bytes} [Wed May 4 13:37:05 2022] GET /identity/v3/users/9347d6265e8f4992aec31a8c09a5e113 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:37:05.580076 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf623bf-57df-481c-9981-826f72907c48 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:37:05.673436 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf623bf-57df-481c-9981-826f72907c48 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:37:05.709558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b91356-fa5b-411c-84f0-c6d8391324d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:37:05.710298 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b91356-fa5b-411c-84f0-c6d8391324d1 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:05.710660 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b91356-fa5b-411c-84f0-c6d8391324d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:05.710973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b91356-fa5b-411c-84f0-c6d8391324d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:05.774158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b91356-fa5b-411c-84f0-c6d8391324d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:37:05.775602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b91356-fa5b-411c-84f0-c6d8391324d1 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:37:05.870767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 604/1198] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:37:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:37:05.877337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b601602-47a7-462c-a7b0-375ed3b83d5e None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:37:05.969582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b601602-47a7-462c-a7b0-375ed3b83d5e None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:37:06.001272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa836ce-3f22-4ee2-b35f-be0e0f63bc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:37:06.002112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa836ce-3f22-4ee2-b35f-be0e0f63bc64 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:06.002392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa836ce-3f22-4ee2-b35f-be0e0f63bc64 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:06.002663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa836ce-3f22-4ee2-b35f-be0e0f63bc64 None admin] PATH_INFO: `/v3/projects/1296f998228a4442aaf65b80cb578426` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:06.003839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa836ce-3f22-4ee2-b35f-be0e0f63bc64 None admin] RBAC: Authorizing `identity:get_project(project_id=1296f998228a4442aaf65b80cb578426)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:37:06.005257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa836ce-3f22-4ee2-b35f-be0e0f63bc64 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:37:06.006897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 595/1199] 10.222.0.73 () {56 vars in 1186 bytes} [Wed May 4 13:37:05 2022] GET /identity/v3/projects/1296f998228a4442aaf65b80cb578426 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:37:06.012810 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b91356-fa5b-411c-84f0-c6d8391324d1 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:37:06.104297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b91356-fa5b-411c-84f0-c6d8391324d1 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:37:06.136480 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77a4f0-1715-45b5-b334-074434fe3ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:37:06.137080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a4f0-1715-45b5-b334-074434fe3ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:37:06.137361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a4f0-1715-45b5-b334-074434fe3ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:37:06.137633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a4f0-1715-45b5-b334-074434fe3ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:37:06.138449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77a4f0-1715-45b5-b334-074434fe3ff7 None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=1296f998228a4442aaf65b80cb578426, user.id=9347d6265e8f4992aec31a8c09a5e113) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:37:06.138756 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77a4f0-1715-45b5-b334-074434fe3ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:37:06.140183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77a4f0-1715-45b5-b334-074434fe3ff7 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:37:06.145671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 605/1200] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:37:06 2022] GET /identity/v3/role_assignments?user.id=9347d6265e8f4992aec31a8c09a5e113&scope.project.id=1296f998228a4442aaf65b80cb578426&role.id=70e67f35994843ae942d4f1703d5619e => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:07.270319 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf7afe-6b83-4ce1-823a-65ad6c93a82a None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:07.270946 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf7afe-6b83-4ce1-823a-65ad6c93a82a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:07.270946 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf7afe-6b83-4ce1-823a-65ad6c93a82a None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:07.272690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 596/1201] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:38:07.278430 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485a05-b74e-4c86-9b0c-659dd6d96a79 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:07.278924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485a05-b74e-4c86-9b0c-659dd6d96a79 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:07.279027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485a05-b74e-4c86-9b0c-659dd6d96a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:07.297606 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-44485a05-b74e-4c86-9b0c-659dd6d96a79 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:38:07.298924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-44485a05-b74e-4c86-9b0c-659dd6d96a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:38:07.379734 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 606/1202] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:38:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:38:07.409899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf7afe-6b83-4ce1-823a-65ad6c93a82a None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:07.547161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf7afe-6b83-4ce1-823a-65ad6c93a82a None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:07.587120 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d2dcd-bf04-47c8-a448-48374e5142f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:07.587962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2dcd-bf04-47c8-a448-48374e5142f7 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:07.588226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2dcd-bf04-47c8-a448-48374e5142f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:07.588644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2dcd-bf04-47c8-a448-48374e5142f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:07.600051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d2dcd-bf04-47c8-a448-48374e5142f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:07.601575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d2dcd-bf04-47c8-a448-48374e5142f7 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-cb8d2dcd-bf04-47c8-a448-48374e5142f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:07.620510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:07.622095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:07.623313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:07.623313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:07.623313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:07.623313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:07.623313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 597/1203] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:07.630957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44485a05-b74e-4c86-9b0c-659dd6d96a79 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:07.756416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44485a05-b74e-4c86-9b0c-659dd6d96a79 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:07.793863 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7034c-6e61-4b06-8b9a-07bed047baf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:07.794859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7034c-6e61-4b06-8b9a-07bed047baf4 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:07.795314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7034c-6e61-4b06-8b9a-07bed047baf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:07.795749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7034c-6e61-4b06-8b9a-07bed047baf4 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:07.796650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7034c-6e61-4b06-8b9a-07bed047baf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:07.797134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7034c-6e61-4b06-8b9a-07bed047baf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:07.798831 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7034c-6e61-4b06-8b9a-07bed047baf4 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:07.811817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 607/1204] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:07.821139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d2dcd-bf04-47c8-a448-48374e5142f7 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:07.954313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d2dcd-bf04-47c8-a448-48374e5142f7 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:07.994131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ff951-04da-4f46-ac91-54b1bfdd82e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:07.994814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ff951-04da-4f46-ac91-54b1bfdd82e8 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:07.995096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ff951-04da-4f46-ac91-54b1bfdd82e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:07.995388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ff951-04da-4f46-ac91-54b1bfdd82e8 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:07.996175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ff951-04da-4f46-ac91-54b1bfdd82e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:07.997635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ff951-04da-4f46-ac91-54b1bfdd82e8 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:08.023329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 598/1205] 10.222.0.73 () {60 vars in 1132 bytes} [Wed May 4 13:38:07 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:38:10.472135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50192f8-88c7-405d-a4d2-b8716d837131 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:10.472706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50192f8-88c7-405d-a4d2-b8716d837131 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:10.472706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50192f8-88c7-405d-a4d2-b8716d837131 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:10.474376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 608/1206] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:38:10.480520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a15253-d027-4235-9165-e0a01578edb4 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:10.481217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a15253-d027-4235-9165-e0a01578edb4 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:10.481326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a15253-d027-4235-9165-e0a01578edb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:10.500459 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-76a15253-d027-4235-9165-e0a01578edb4 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:38:10.501637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-76a15253-d027-4235-9165-e0a01578edb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:38:10.587311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 599/1207] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:38:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:38:10.608760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50192f8-88c7-405d-a4d2-b8716d837131 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:10.726854 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50192f8-88c7-405d-a4d2-b8716d837131 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:10.768634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af0fc2-f679-4f23-959c-cb623d34f8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:10.769441 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af0fc2-f679-4f23-959c-cb623d34f8bf None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:10.769728 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af0fc2-f679-4f23-959c-cb623d34f8bf None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:10.770002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af0fc2-f679-4f23-959c-cb623d34f8bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:10.780872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af0fc2-f679-4f23-959c-cb623d34f8bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-c3af0fc2-f679-4f23-959c-cb623d34f8bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:38:10.788769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:10.789818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:10.791226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 609/1208] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:38:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:10.796104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a15253-d027-4235-9165-e0a01578edb4 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:10.910854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a15253-d027-4235-9165-e0a01578edb4 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:10.950036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79d306-7385-40f5-b776-1c53be7f1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:10.950708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79d306-7385-40f5-b776-1c53be7f1610 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:10.950981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79d306-7385-40f5-b776-1c53be7f1610 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:10.951280 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79d306-7385-40f5-b776-1c53be7f1610 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:10.952028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79d306-7385-40f5-b776-1c53be7f1610 None admin] RBAC: Adding query filter params (name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:10.952333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79d306-7385-40f5-b776-1c53be7f1610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:10.953693 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79d306-7385-40f5-b776-1c53be7f1610 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:10.961784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 600/1209] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:38:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:10.967979 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af0fc2-f679-4f23-959c-cb623d34f8bf None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:11.076760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af0fc2-f679-4f23-959c-cb623d34f8bf None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:11.112864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433e2b1-dabc-4213-84d4-982e426290c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:11.114035 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433e2b1-dabc-4213-84d4-982e426290c9 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:11.114545 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433e2b1-dabc-4213-84d4-982e426290c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:11.115024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433e2b1-dabc-4213-84d4-982e426290c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:11.127977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433e2b1-dabc-4213-84d4-982e426290c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:11.129883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433e2b1-dabc-4213-84d4-982e426290c9 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-7433e2b1-dabc-4213-84d4-982e426290c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:11.151586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:11.153385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:11.155918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:11.155918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:11.155918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:11.155918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:11.155918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 610/1210] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:11.160937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79d306-7385-40f5-b776-1c53be7f1610 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:11.271092 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79d306-7385-40f5-b776-1c53be7f1610 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:11.308836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455da01-b48b-4362-95f5-7ee242665f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:11.309530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455da01-b48b-4362-95f5-7ee242665f4d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:11.309928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455da01-b48b-4362-95f5-7ee242665f4d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:11.310213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455da01-b48b-4362-95f5-7ee242665f4d None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:11.310968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455da01-b48b-4362-95f5-7ee242665f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:11.311301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455da01-b48b-4362-95f5-7ee242665f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:11.313805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455da01-b48b-4362-95f5-7ee242665f4d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:11.331403 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 601/1211] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:11.336490 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433e2b1-dabc-4213-84d4-982e426290c9 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:11.452549 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433e2b1-dabc-4213-84d4-982e426290c9 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:11.489262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759f94e-afd8-4d9d-a2ec-dc60e668ed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:11.490358 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759f94e-afd8-4d9d-a2ec-dc60e668ed23 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:11.490621 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759f94e-afd8-4d9d-a2ec-dc60e668ed23 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:11.490958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759f94e-afd8-4d9d-a2ec-dc60e668ed23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:11.499839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759f94e-afd8-4d9d-a2ec-dc60e668ed23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:11.501401 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759f94e-afd8-4d9d-a2ec-dc60e668ed23 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-9759f94e-afd8-4d9d-a2ec-dc60e668ed23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:38:11.517323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:11.518828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:11.520159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:11.520159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:11.520159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:38:11.520159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:38:11.520159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:38:11.520159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:38:11.520159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:38:11.520159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:38:11.520159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 13:38:11.520159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:11.520159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 611/1212] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:11.524897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455da01-b48b-4362-95f5-7ee242665f4d None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:11.639099 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455da01-b48b-4362-95f5-7ee242665f4d None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:11.673305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be219e-eab3-44b1-ba75-cba6877f9903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:11.674681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be219e-eab3-44b1-ba75-cba6877f9903 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:11.674681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be219e-eab3-44b1-ba75-cba6877f9903 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:11.674681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be219e-eab3-44b1-ba75-cba6877f9903 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:11.675520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be219e-eab3-44b1-ba75-cba6877f9903 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:11.675848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be219e-eab3-44b1-ba75-cba6877f9903 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:11.677466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be219e-eab3-44b1-ba75-cba6877f9903 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:11.701275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 602/1213] 10.222.0.73 () {56 vars in 1143 bytes} [Wed May 4 13:38:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:11.703189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759f94e-afd8-4d9d-a2ec-dc60e668ed23 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:11.826554 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759f94e-afd8-4d9d-a2ec-dc60e668ed23 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:11.864145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90974ae-e7f2-4f78-99f6-98c35cb22eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:11.865492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90974ae-e7f2-4f78-99f6-98c35cb22eb6 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:11.866017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90974ae-e7f2-4f78-99f6-98c35cb22eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:11.866481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90974ae-e7f2-4f78-99f6-98c35cb22eb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:11.941844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90974ae-e7f2-4f78-99f6-98c35cb22eb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:11.943320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90974ae-e7f2-4f78-99f6-98c35cb22eb6 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:12.052663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 612/1214] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:38:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 13:38:12.058999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be219e-eab3-44b1-ba75-cba6877f9903 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:12.174739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be219e-eab3-44b1-ba75-cba6877f9903 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:12.209628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd64141-3c2f-42d1-8f15-323b3125ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:12.210507 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd64141-3c2f-42d1-8f15-323b3125ce64 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:12.210829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd64141-3c2f-42d1-8f15-323b3125ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:12.211258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd64141-3c2f-42d1-8f15-323b3125ce64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:12.222708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd64141-3c2f-42d1-8f15-323b3125ce64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:12.224431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd64141-3c2f-42d1-8f15-323b3125ce64 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-9dd64141-3c2f-42d1-8f15-323b3125ce64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:12.245575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:12.247927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:12.249035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:12.249035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:12.249035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:12.249035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:12.249035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 603/1215] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:12.252754 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90974ae-e7f2-4f78-99f6-98c35cb22eb6 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:12.375835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90974ae-e7f2-4f78-99f6-98c35cb22eb6 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:12.414568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05442ad-1998-409d-aa2e-0dc112b81b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:12.415547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05442ad-1998-409d-aa2e-0dc112b81b1a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:12.415971 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05442ad-1998-409d-aa2e-0dc112b81b1a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:12.416403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05442ad-1998-409d-aa2e-0dc112b81b1a None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:12.417274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05442ad-1998-409d-aa2e-0dc112b81b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:12.418284 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05442ad-1998-409d-aa2e-0dc112b81b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:12.419836 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05442ad-1998-409d-aa2e-0dc112b81b1a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:12.433714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 613/1216] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:12.439447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd64141-3c2f-42d1-8f15-323b3125ce64 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:12.549876 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd64141-3c2f-42d1-8f15-323b3125ce64 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:12.585725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea2ef-ac83-4020-be72-b9804c6b527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:12.585725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea2ef-ac83-4020-be72-b9804c6b527d None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:12.585998 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea2ef-ac83-4020-be72-b9804c6b527d None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:12.586296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea2ef-ac83-4020-be72-b9804c6b527d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:12.595340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ea2ef-ac83-4020-be72-b9804c6b527d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:12.596890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ea2ef-ac83-4020-be72-b9804c6b527d None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-a52ea2ef-ac83-4020-be72-b9804c6b527d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:38:12.613149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:12.614202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:12.615688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:38:12.615688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:38:12.615688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:38:12.615688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:38:12.615688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:38:12.615688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:38:12.615688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:38:12.615688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:12.615688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 604/1217] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:38:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:12.620542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05442ad-1998-409d-aa2e-0dc112b81b1a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:12.734310 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05442ad-1998-409d-aa2e-0dc112b81b1a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:12.775654 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa8b07-35c7-4c82-b70d-c6e95bb9d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:12.776315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa8b07-35c7-4c82-b70d-c6e95bb9d5f9 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:12.776608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa8b07-35c7-4c82-b70d-c6e95bb9d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:12.776895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa8b07-35c7-4c82-b70d-c6e95bb9d5f9 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:12.778371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa8b07-35c7-4c82-b70d-c6e95bb9d5f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:12.778705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa8b07-35c7-4c82-b70d-c6e95bb9d5f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:12.780442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa8b07-35c7-4c82-b70d-c6e95bb9d5f9 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:12.794090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 614/1218] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:12.800637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea2ef-ac83-4020-be72-b9804c6b527d None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:12.915430 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea2ef-ac83-4020-be72-b9804c6b527d None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:12.953965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72362184-7650-4058-890c-f47e48c2d52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:12.954698 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72362184-7650-4058-890c-f47e48c2d52b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:12.955012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72362184-7650-4058-890c-f47e48c2d52b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:12.955320 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72362184-7650-4058-890c-f47e48c2d52b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:12.956402 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72362184-7650-4058-890c-f47e48c2d52b None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=735744b9ea1f429399b914f3e00d166f) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:12.956723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72362184-7650-4058-890c-f47e48c2d52b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:12.958145 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72362184-7650-4058-890c-f47e48c2d52b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:12.964300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 605/1219] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:38:12 2022] GET /identity/v3/role_assignments?user.id=735744b9ea1f429399b914f3e00d166f&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:38:15.500565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e262-a63e-4c59-83ed-bd6ca9c173cd None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:15.501155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e262-a63e-4c59-83ed-bd6ca9c173cd None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:15.501155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e262-a63e-4c59-83ed-bd6ca9c173cd None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:15.502493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 615/1220] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:38:15.509240 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a94b8c-af61-487d-858f-20c167e54d8f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:15.509712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a94b8c-af61-487d-858f-20c167e54d8f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:15.509833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a94b8c-af61-487d-858f-20c167e54d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:15.525933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-38a94b8c-af61-487d-858f-20c167e54d8f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:38:15.527168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-38a94b8c-af61-487d-858f-20c167e54d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:38:15.597410 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 606/1221] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:38:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:38:15.622302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330e262-a63e-4c59-83ed-bd6ca9c173cd None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:15.740813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330e262-a63e-4c59-83ed-bd6ca9c173cd None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:15.780724 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c00c8-94d2-480d-8d9b-7de0e5046023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:15.781665 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c00c8-94d2-480d-8d9b-7de0e5046023 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:15.781965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c00c8-94d2-480d-8d9b-7de0e5046023 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:15.782480 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c00c8-94d2-480d-8d9b-7de0e5046023 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:15.794858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c00c8-94d2-480d-8d9b-7de0e5046023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-014c00c8-94d2-480d-8d9b-7de0e5046023 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:38:15.802894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:15.804220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:15.805336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 616/1222] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:38:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:15.811590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a94b8c-af61-487d-858f-20c167e54d8f None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:15.924408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a94b8c-af61-487d-858f-20c167e54d8f None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:15.962811 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c5f48-accc-4e9b-a567-f16e3d862387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:15.963589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c5f48-accc-4e9b-a567-f16e3d862387 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:15.963869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c5f48-accc-4e9b-a567-f16e3d862387 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:15.964212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c5f48-accc-4e9b-a567-f16e3d862387 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:15.965224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c5f48-accc-4e9b-a567-f16e3d862387 None admin] RBAC: Adding query filter params (name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:15.965571 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c5f48-accc-4e9b-a567-f16e3d862387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:15.967034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c5f48-accc-4e9b-a567-f16e3d862387 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:15.976055 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 607/1223] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:38:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:15.982120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c00c8-94d2-480d-8d9b-7de0e5046023 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:16.085917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c00c8-94d2-480d-8d9b-7de0e5046023 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:16.119123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb6fe4-5736-4181-8ff4-72f930ef7383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:16.119937 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb6fe4-5736-4181-8ff4-72f930ef7383 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:16.120214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb6fe4-5736-4181-8ff4-72f930ef7383 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:16.120482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb6fe4-5736-4181-8ff4-72f930ef7383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:16.138795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb6fe4-5736-4181-8ff4-72f930ef7383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:16.140304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb6fe4-5736-4181-8ff4-72f930ef7383 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-1cdb6fe4-5736-4181-8ff4-72f930ef7383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:16.161416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:16.162447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:16.163468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:16.163468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:16.163468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:16.163468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:16.163468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 617/1224] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:16.169093 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c5f48-accc-4e9b-a567-f16e3d862387 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:16.283680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c5f48-accc-4e9b-a567-f16e3d862387 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:16.323606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a42e0-4bff-4f45-9598-95936fef21c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:16.324417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a42e0-4bff-4f45-9598-95936fef21c1 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:16.324849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a42e0-4bff-4f45-9598-95936fef21c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:16.325141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a42e0-4bff-4f45-9598-95936fef21c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:16.325884 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a42e0-4bff-4f45-9598-95936fef21c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:16.326324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a42e0-4bff-4f45-9598-95936fef21c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:16.327938 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a42e0-4bff-4f45-9598-95936fef21c1 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:16.340148 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 608/1225] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:16.346003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb6fe4-5736-4181-8ff4-72f930ef7383 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:16.455029 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb6fe4-5736-4181-8ff4-72f930ef7383 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:16.493740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be876d9-b126-4927-9437-84363142d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:16.494568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be876d9-b126-4927-9437-84363142d0d3 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:16.494916 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be876d9-b126-4927-9437-84363142d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:16.495221 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be876d9-b126-4927-9437-84363142d0d3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:16.505514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be876d9-b126-4927-9437-84363142d0d3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:16.507915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be876d9-b126-4927-9437-84363142d0d3 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-0be876d9-b126-4927-9437-84363142d0d3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:38:16.530990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:16.532400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:16.533614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:16.533614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:16.533614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:38:16.533614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:38:16.533614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:38:16.533614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:38:16.533614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:38:16.533614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:38:16.533614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 13:38:16.533614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:16.533614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 618/1226] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 13:38:16.538936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a42e0-4bff-4f45-9598-95936fef21c1 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:16.649590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a42e0-4bff-4f45-9598-95936fef21c1 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:16.688688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac796006-f18e-42b3-bf66-d62b5569a174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:16.689311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac796006-f18e-42b3-bf66-d62b5569a174 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:16.689597 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac796006-f18e-42b3-bf66-d62b5569a174 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:16.689876 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac796006-f18e-42b3-bf66-d62b5569a174 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:16.690711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac796006-f18e-42b3-bf66-d62b5569a174 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:16.691020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac796006-f18e-42b3-bf66-d62b5569a174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:16.692485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac796006-f18e-42b3-bf66-d62b5569a174 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:16.710712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 609/1227] 10.222.0.73 () {56 vars in 1143 bytes} [Wed May 4 13:38:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:16.717410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be876d9-b126-4927-9437-84363142d0d3 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:16.826147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be876d9-b126-4927-9437-84363142d0d3 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:16.863771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70257d-323e-432b-8ead-2bb0c24c0ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:16.864691 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70257d-323e-432b-8ead-2bb0c24c0ecd None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:16.864975 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70257d-323e-432b-8ead-2bb0c24c0ecd None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:16.865286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70257d-323e-432b-8ead-2bb0c24c0ecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:16.877786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70257d-323e-432b-8ead-2bb0c24c0ecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:16.879470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70257d-323e-432b-8ead-2bb0c24c0ecd None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-ae70257d-323e-432b-8ead-2bb0c24c0ecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:16.905296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:16.906535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:16.907743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:16.907743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:16.907743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:16.907743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:16.911268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 619/1228] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:16.913470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac796006-f18e-42b3-bf66-d62b5569a174 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:17.020062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac796006-f18e-42b3-bf66-d62b5569a174 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:17.061966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bb7c9-b8c5-475f-81fb-cde8a09273ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:17.062898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bb7c9-b8c5-475f-81fb-cde8a09273ae None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:17.063274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bb7c9-b8c5-475f-81fb-cde8a09273ae None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:17.063616 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bb7c9-b8c5-475f-81fb-cde8a09273ae None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:17.064304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bb7c9-b8c5-475f-81fb-cde8a09273ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:17.064619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bb7c9-b8c5-475f-81fb-cde8a09273ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:17.065977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bb7c9-b8c5-475f-81fb-cde8a09273ae None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:17.079300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 610/1229] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:17.083625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70257d-323e-432b-8ead-2bb0c24c0ecd None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:17.187913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70257d-323e-432b-8ead-2bb0c24c0ecd None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:17.224807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4f064-f568-47c2-88ff-fbf6d8a63b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:17.226016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4f064-f568-47c2-88ff-fbf6d8a63b1a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:17.226495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4f064-f568-47c2-88ff-fbf6d8a63b1a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:17.226702 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4f064-f568-47c2-88ff-fbf6d8a63b1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:17.234103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4f064-f568-47c2-88ff-fbf6d8a63b1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:17.235748 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4f064-f568-47c2-88ff-fbf6d8a63b1a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-ebc4f064-f568-47c2-88ff-fbf6d8a63b1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:38:17.255519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:17.264640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:17.266142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:38:17.266142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:38:17.266142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:38:17.266142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:38:17.266142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:38:17.266142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:38:17.266142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:38:17.266142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:17.266142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 620/1230] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:38:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:17.266839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bb7c9-b8c5-475f-81fb-cde8a09273ae None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:17.376179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bb7c9-b8c5-475f-81fb-cde8a09273ae None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:17.412227 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94167d4c-4d4d-432c-8178-b1d01ab972e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:17.413170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94167d4c-4d4d-432c-8178-b1d01ab972e6 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:17.413446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94167d4c-4d4d-432c-8178-b1d01ab972e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:17.413716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94167d4c-4d4d-432c-8178-b1d01ab972e6 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:17.414588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94167d4c-4d4d-432c-8178-b1d01ab972e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:17.414808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94167d4c-4d4d-432c-8178-b1d01ab972e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:17.416265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94167d4c-4d4d-432c-8178-b1d01ab972e6 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:17.428254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 611/1231] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:38:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:17.434455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4f064-f568-47c2-88ff-fbf6d8a63b1a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:17.534899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4f064-f568-47c2-88ff-fbf6d8a63b1a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:17.569255 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8da89-3675-4577-86bf-faf934129d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:17.570135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8da89-3675-4577-86bf-faf934129d42 None admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:17.570409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8da89-3675-4577-86bf-faf934129d42 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:17.570680 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8da89-3675-4577-86bf-faf934129d42 None admin] PATH_INFO: `/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/735744b9ea1f429399b914f3e00d166f/roles/bf0187c127ce4dcd9e2606d8dc4810ef` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:17.587967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8da89-3675-4577-86bf-faf934129d42 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbace3b0d2f54a408012ccc368865c82, user_id=735744b9ea1f429399b914f3e00d166f, role_id=bf0187c127ce4dcd9e2606d8dc4810ef)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:17.590675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8da89-3675-4577-86bf-faf934129d42 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:17.605396 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 621/1232] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:38:17 2022] PUT /identity/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/735744b9ea1f429399b914f3e00d166f/roles/bf0187c127ce4dcd9e2606d8dc4810ef => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:38:19.921439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995aa470-3ed9-4282-bcf2-38776930995f None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:19.922095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995aa470-3ed9-4282-bcf2-38776930995f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:19.922095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995aa470-3ed9-4282-bcf2-38776930995f None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:19.923391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 612/1233] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:38:19.928898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce831349-d057-471e-94fb-c6eeff7e9d5b None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:19.929317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce831349-d057-471e-94fb-c6eeff7e9d5b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:19.929585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce831349-d057-471e-94fb-c6eeff7e9d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:19.949313 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ce831349-d057-471e-94fb-c6eeff7e9d5b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:38:19.950499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ce831349-d057-471e-94fb-c6eeff7e9d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:38:20.020582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 622/1234] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:38:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:38:20.045378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995aa470-3ed9-4282-bcf2-38776930995f None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:20.158651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995aa470-3ed9-4282-bcf2-38776930995f None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:20.192021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236df5ee-4128-41b9-ab25-0cab607f4493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:20.192739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236df5ee-4128-41b9-ab25-0cab607f4493 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:20.193075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236df5ee-4128-41b9-ab25-0cab607f4493 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:20.193385 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236df5ee-4128-41b9-ab25-0cab607f4493 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:20.205288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236df5ee-4128-41b9-ab25-0cab607f4493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-236df5ee-4128-41b9-ab25-0cab607f4493 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:38:20.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:20.215766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:20.216898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 613/1235] 10.222.0.73 () {56 vars in 1102 bytes} [Wed May 4 13:38:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:20.222716 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce831349-d057-471e-94fb-c6eeff7e9d5b None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:20.326218 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce831349-d057-471e-94fb-c6eeff7e9d5b None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:20.363761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d000279-6033-460e-934c-21c4a22bd69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:20.364438 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d000279-6033-460e-934c-21c4a22bd69a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:20.364723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d000279-6033-460e-934c-21c4a22bd69a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:20.365004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d000279-6033-460e-934c-21c4a22bd69a None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:20.365752 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d000279-6033-460e-934c-21c4a22bd69a None admin] RBAC: Adding query filter params (name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:20.366060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d000279-6033-460e-934c-21c4a22bd69a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:20.367448 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d000279-6033-460e-934c-21c4a22bd69a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:20.376562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 623/1236] 10.222.0.73 () {56 vars in 1103 bytes} [Wed May 4 13:38:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:20.382320 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236df5ee-4128-41b9-ab25-0cab607f4493 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:20.484975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236df5ee-4128-41b9-ab25-0cab607f4493 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:20.520323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be6521-3593-4cd8-9412-eb6c0643b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:20.521119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be6521-3593-4cd8-9412-eb6c0643b44a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:20.521409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be6521-3593-4cd8-9412-eb6c0643b44a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:20.521683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be6521-3593-4cd8-9412-eb6c0643b44a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:20.533173 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be6521-3593-4cd8-9412-eb6c0643b44a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:20.534720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be6521-3593-4cd8-9412-eb6c0643b44a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-15be6521-3593-4cd8-9412-eb6c0643b44a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:20.552540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:20.553731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:20.559919 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:20.559919 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:20.559919 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:20.559919 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:20.559919 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 614/1237] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:20.560271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d000279-6033-460e-934c-21c4a22bd69a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:20.666319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d000279-6033-460e-934c-21c4a22bd69a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:20.703556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4920ebe-dfe7-4a21-a52f-de0f7176c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:20.704220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4920ebe-dfe7-4a21-a52f-de0f7176c2e4 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:20.704503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4920ebe-dfe7-4a21-a52f-de0f7176c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:20.704782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4920ebe-dfe7-4a21-a52f-de0f7176c2e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:20.705500 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4920ebe-dfe7-4a21-a52f-de0f7176c2e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:20.705807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4920ebe-dfe7-4a21-a52f-de0f7176c2e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:20.707157 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4920ebe-dfe7-4a21-a52f-de0f7176c2e4 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:20.718951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 624/1238] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:38:20.724642 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be6521-3593-4cd8-9412-eb6c0643b44a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:20.829896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be6521-3593-4cd8-9412-eb6c0643b44a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:20.866574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d62f9-3290-44c1-ac06-482267357083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:20.867409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d62f9-3290-44c1-ac06-482267357083 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:20.867690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d62f9-3290-44c1-ac06-482267357083 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:20.867961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d62f9-3290-44c1-ac06-482267357083 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:20.878883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d62f9-3290-44c1-ac06-482267357083 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:20.880899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d62f9-3290-44c1-ac06-482267357083 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-5d0d62f9-3290-44c1-ac06-482267357083 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:38:20.896521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:20.897847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:20.899234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:20.899234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:20.899234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:38:20.899234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:38:20.899234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:38:20.899234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:38:20.899234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:38:20.899234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:38:20.899234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 13:38:20.899234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:20.899234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 615/1239] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:20.903988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4920ebe-dfe7-4a21-a52f-de0f7176c2e4 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:21.005554 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4920ebe-dfe7-4a21-a52f-de0f7176c2e4 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:21.043230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e0915-7079-4455-811b-b2add579687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:21.043929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e0915-7079-4455-811b-b2add579687a None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:21.044209 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e0915-7079-4455-811b-b2add579687a None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:21.044470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e0915-7079-4455-811b-b2add579687a None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:21.045299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e0915-7079-4455-811b-b2add579687a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:21.045603 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e0915-7079-4455-811b-b2add579687a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:21.047001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e0915-7079-4455-811b-b2add579687a None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:21.066047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 625/1240] 10.222.0.73 () {56 vars in 1143 bytes} [Wed May 4 13:38:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:21.072239 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d62f9-3290-44c1-ac06-482267357083 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:21.173529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d62f9-3290-44c1-ac06-482267357083 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:21.206359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d7ec4-a090-4c58-be1e-b680c50fc42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:21.207008 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d7ec4-a090-4c58-be1e-b680c50fc42c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:21.207322 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d7ec4-a090-4c58-be1e-b680c50fc42c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:21.207600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d7ec4-a090-4c58-be1e-b680c50fc42c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:21.278855 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d7ec4-a090-4c58-be1e-b680c50fc42c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:21.281214 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d7ec4-a090-4c58-be1e-b680c50fc42c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:21.386639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 616/1241] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:38:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 13:38:21.392458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e0915-7079-4455-811b-b2add579687a None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:21.502699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e0915-7079-4455-811b-b2add579687a None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:21.539793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10de16-8745-48c6-b933-c623b19917e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:21.540585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10de16-8745-48c6-b933-c623b19917e0 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:21.540862 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10de16-8745-48c6-b933-c623b19917e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:21.541132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10de16-8745-48c6-b933-c623b19917e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:21.551119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10de16-8745-48c6-b933-c623b19917e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:21.552640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10de16-8745-48c6-b933-c623b19917e0 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-ca10de16-8745-48c6-b933-c623b19917e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:21.572229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:21.573356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:21.575001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:21.575001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:21.575001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:21.575001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:21.575001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 626/1242] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:21.580168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d7ec4-a090-4c58-be1e-b680c50fc42c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:21.678652 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d7ec4-a090-4c58-be1e-b680c50fc42c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:21.711026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf89023-254a-43f4-aaab-a214c7ae0c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:21.711808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf89023-254a-43f4-aaab-a214c7ae0c96 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:21.712063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf89023-254a-43f4-aaab-a214c7ae0c96 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:21.712379 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf89023-254a-43f4-aaab-a214c7ae0c96 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:21.713139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf89023-254a-43f4-aaab-a214c7ae0c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:21.713443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf89023-254a-43f4-aaab-a214c7ae0c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:21.715511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf89023-254a-43f4-aaab-a214c7ae0c96 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:21.728228 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 617/1243] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:21.734872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10de16-8745-48c6-b933-c623b19917e0 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:21.846036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10de16-8745-48c6-b933-c623b19917e0 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:21.883413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633221b-7e05-4ee7-a12f-17d76452a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:21.884237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633221b-7e05-4ee7-a12f-17d76452a311 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:21.884486 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633221b-7e05-4ee7-a12f-17d76452a311 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:21.884752 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633221b-7e05-4ee7-a12f-17d76452a311 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:21.891863 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633221b-7e05-4ee7-a12f-17d76452a311 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:21.893277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633221b-7e05-4ee7-a12f-17d76452a311 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-7633221b-7e05-4ee7-a12f-17d76452a311 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:38:21.907020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:21.908189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:21.909316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:38:21.909316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:38:21.909316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:38:21.909316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:38:21.909316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:38:21.909316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:38:21.909316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:38:21.909316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:21.909316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 627/1244] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:38:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:21.914239 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf89023-254a-43f4-aaab-a214c7ae0c96 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:22.017757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf89023-254a-43f4-aaab-a214c7ae0c96 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:22.055011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a7403-d5cc-440b-829a-bf829aac7494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:22.055694 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a7403-d5cc-440b-829a-bf829aac7494 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:22.056048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a7403-d5cc-440b-829a-bf829aac7494 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:22.056345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a7403-d5cc-440b-829a-bf829aac7494 None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:22.057213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a7403-d5cc-440b-829a-bf829aac7494 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:22.057548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a7403-d5cc-440b-829a-bf829aac7494 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:22.059712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a7403-d5cc-440b-829a-bf829aac7494 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:22.073146 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 618/1245] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:38:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:38:22.080033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633221b-7e05-4ee7-a12f-17d76452a311 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:22.190223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633221b-7e05-4ee7-a12f-17d76452a311 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:22.227645 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ab1cc-e710-4053-ba5b-82af547f46d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:22.228451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ab1cc-e710-4053-ba5b-82af547f46d6 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:22.228827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ab1cc-e710-4053-ba5b-82af547f46d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:22.229208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ab1cc-e710-4053-ba5b-82af547f46d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:22.230102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ab1cc-e710-4053-ba5b-82af547f46d6 None admin] RBAC: Adding query filter params (role.id=bf0187c127ce4dcd9e2606d8dc4810ef, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=735744b9ea1f429399b914f3e00d166f) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:22.230966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ab1cc-e710-4053-ba5b-82af547f46d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:22.232673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ab1cc-e710-4053-ba5b-82af547f46d6 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:22.240189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 628/1246] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:38:22 2022] GET /identity/v3/role_assignments?user.id=735744b9ea1f429399b914f3e00d166f&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=bf0187c127ce4dcd9e2606d8dc4810ef => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:24.706020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa231-534e-4948-aa01-9e588b45fbc4 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:24.706548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa231-534e-4948-aa01-9e588b45fbc4 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:24.706548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa231-534e-4948-aa01-9e588b45fbc4 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:24.707872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 619/1247] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:38:24.713528 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798174f-f61f-4556-ae53-083d772b4419 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:24.714003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798174f-f61f-4556-ae53-083d772b4419 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:24.714134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798174f-f61f-4556-ae53-083d772b4419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:24.735279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-e798174f-f61f-4556-ae53-083d772b4419 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:38:24.736727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e798174f-f61f-4556-ae53-083d772b4419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:38:24.817771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 629/1248] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:38:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:38:24.846694 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa231-534e-4948-aa01-9e588b45fbc4 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:24.953679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa231-534e-4948-aa01-9e588b45fbc4 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:24.986188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e579b0-47b1-4f01-9f1f-f04bfcfce87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:24.986906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e579b0-47b1-4f01-9f1f-f04bfcfce87a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:24.987185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e579b0-47b1-4f01-9f1f-f04bfcfce87a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:24.987484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e579b0-47b1-4f01-9f1f-f04bfcfce87a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:24.998068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e579b0-47b1-4f01-9f1f-f04bfcfce87a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-c0e579b0-47b1-4f01-9f1f-f04bfcfce87a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:38:25.005577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:25.006532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:25.007683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 620/1249] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:38:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:25.013696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798174f-f61f-4556-ae53-083d772b4419 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:25.116861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798174f-f61f-4556-ae53-083d772b4419 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:25.153230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c508e8-4022-46c9-8cfe-28c88cc36890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:25.154039 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c508e8-4022-46c9-8cfe-28c88cc36890 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:25.154340 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c508e8-4022-46c9-8cfe-28c88cc36890 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:25.154604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c508e8-4022-46c9-8cfe-28c88cc36890 None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:25.155385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c508e8-4022-46c9-8cfe-28c88cc36890 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:25.155793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c508e8-4022-46c9-8cfe-28c88cc36890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:25.157197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c508e8-4022-46c9-8cfe-28c88cc36890 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:25.165938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 630/1250] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:38:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:25.171921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e579b0-47b1-4f01-9f1f-f04bfcfce87a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:25.276043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e579b0-47b1-4f01-9f1f-f04bfcfce87a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:25.312271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913ea53-6fca-4c62-866b-6eda58b27906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:25.313219 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913ea53-6fca-4c62-866b-6eda58b27906 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:25.313542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913ea53-6fca-4c62-866b-6eda58b27906 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:25.313848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913ea53-6fca-4c62-866b-6eda58b27906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:25.326077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913ea53-6fca-4c62-866b-6eda58b27906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:25.327542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913ea53-6fca-4c62-866b-6eda58b27906 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-0913ea53-6fca-4c62-866b-6eda58b27906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:25.346063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:25.347038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:25.348221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:25.348221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:25.348221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:25.348221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:25.348221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 621/1251] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:25.353337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c508e8-4022-46c9-8cfe-28c88cc36890 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:25.466775 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c508e8-4022-46c9-8cfe-28c88cc36890 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:25.504902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb700d75-d6ac-4b3e-9059-644e46d8a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:25.505587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700d75-d6ac-4b3e-9059-644e46d8a954 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:25.505866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700d75-d6ac-4b3e-9059-644e46d8a954 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:25.506144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700d75-d6ac-4b3e-9059-644e46d8a954 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:25.506877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb700d75-d6ac-4b3e-9059-644e46d8a954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:25.507179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb700d75-d6ac-4b3e-9059-644e46d8a954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:25.508603 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb700d75-d6ac-4b3e-9059-644e46d8a954 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:25.522502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 631/1252] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:38:25.528906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913ea53-6fca-4c62-866b-6eda58b27906 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:25.630233 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913ea53-6fca-4c62-866b-6eda58b27906 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:25.664328 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d2af4-8a73-4fe4-be7a-8b7c5e98d95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:25.665126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2af4-8a73-4fe4-be7a-8b7c5e98d95a None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:25.665400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2af4-8a73-4fe4-be7a-8b7c5e98d95a None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:25.665665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d2af4-8a73-4fe4-be7a-8b7c5e98d95a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:25.673836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d2af4-8a73-4fe4-be7a-8b7c5e98d95a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:25.675349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d2af4-8a73-4fe4-be7a-8b7c5e98d95a None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-e80d2af4-8a73-4fe4-be7a-8b7c5e98d95a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:38:25.690948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:25.692114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:25.693185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:25.693185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:25.693185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:38:25.693185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:38:25.693185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:38:25.693185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:38:25.693185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:38:25.693185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:38:25.693185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 13:38:25.693185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:25.693185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 622/1253] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:25.698571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb700d75-d6ac-4b3e-9059-644e46d8a954 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:25.807872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb700d75-d6ac-4b3e-9059-644e46d8a954 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:25.847683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319974b-4801-427f-8892-ce8ba38fa5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:25.848365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319974b-4801-427f-8892-ce8ba38fa5c8 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:25.848647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319974b-4801-427f-8892-ce8ba38fa5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:25.848923 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319974b-4801-427f-8892-ce8ba38fa5c8 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:25.849796 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319974b-4801-427f-8892-ce8ba38fa5c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:25.850131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319974b-4801-427f-8892-ce8ba38fa5c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:25.851598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319974b-4801-427f-8892-ce8ba38fa5c8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:25.870337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 632/1254] 10.222.0.73 () {56 vars in 1143 bytes} [Wed May 4 13:38:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:25.876705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d2af4-8a73-4fe4-be7a-8b7c5e98d95a None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:25.975135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d2af4-8a73-4fe4-be7a-8b7c5e98d95a None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:26.007822 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1340b0-bb37-4be6-aad5-149c071b42fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:26.008468 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1340b0-bb37-4be6-aad5-149c071b42fe None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:26.008757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1340b0-bb37-4be6-aad5-149c071b42fe None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:26.009028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1340b0-bb37-4be6-aad5-149c071b42fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:26.076624 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1340b0-bb37-4be6-aad5-149c071b42fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:26.079255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1340b0-bb37-4be6-aad5-149c071b42fe None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:26.181105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 623/1255] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:38:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:38:26.186856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319974b-4801-427f-8892-ce8ba38fa5c8 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:26.282407 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319974b-4801-427f-8892-ce8ba38fa5c8 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:26.314514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8ad75-65de-4331-ab27-9c7af3f9dd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:26.315348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8ad75-65de-4331-ab27-9c7af3f9dd60 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:26.315630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8ad75-65de-4331-ab27-9c7af3f9dd60 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:26.315903 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8ad75-65de-4331-ab27-9c7af3f9dd60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:26.326290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8ad75-65de-4331-ab27-9c7af3f9dd60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:26.327807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8ad75-65de-4331-ab27-9c7af3f9dd60 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-8bb8ad75-65de-4331-ab27-9c7af3f9dd60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:26.345483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:26.346561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:26.347913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:26.347913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:26.347913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:26.347913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:26.347913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 633/1256] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:26.352256 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1340b0-bb37-4be6-aad5-149c071b42fe None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:26.448459 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1340b0-bb37-4be6-aad5-149c071b42fe None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:26.480767 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f5527-1758-49d9-b24d-4003fe86f8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:26.481421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f5527-1758-49d9-b24d-4003fe86f8b5 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:26.481705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f5527-1758-49d9-b24d-4003fe86f8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:26.481983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f5527-1758-49d9-b24d-4003fe86f8b5 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:26.482692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f5527-1758-49d9-b24d-4003fe86f8b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:26.482998 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f5527-1758-49d9-b24d-4003fe86f8b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:26.484387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f5527-1758-49d9-b24d-4003fe86f8b5 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:26.494937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 624/1257] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:26.500711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8ad75-65de-4331-ab27-9c7af3f9dd60 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:26.594691 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8ad75-65de-4331-ab27-9c7af3f9dd60 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:26.626477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27195304-ca6e-4baa-87ce-58d850149462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:26.627264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27195304-ca6e-4baa-87ce-58d850149462 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:26.627546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27195304-ca6e-4baa-87ce-58d850149462 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:26.627819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27195304-ca6e-4baa-87ce-58d850149462 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:26.634085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27195304-ca6e-4baa-87ce-58d850149462 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:26.635525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27195304-ca6e-4baa-87ce-58d850149462 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-27195304-ca6e-4baa-87ce-58d850149462 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:38:26.648726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:26.649800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:26.651079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:38:26.651079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:38:26.651079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:38:26.651079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:38:26.651079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:38:26.651079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:38:26.651079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:38:26.651079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:26.651079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 634/1258] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:26.655983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f5527-1758-49d9-b24d-4003fe86f8b5 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:26.748949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f5527-1758-49d9-b24d-4003fe86f8b5 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:26.780290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bec85-1348-463a-b267-0d0b8163b3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:26.780930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bec85-1348-463a-b267-0d0b8163b3fd None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:26.781212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bec85-1348-463a-b267-0d0b8163b3fd None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:26.781490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bec85-1348-463a-b267-0d0b8163b3fd None admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:26.782262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bec85-1348-463a-b267-0d0b8163b3fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:26.782571 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bec85-1348-463a-b267-0d0b8163b3fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:26.784020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bec85-1348-463a-b267-0d0b8163b3fd None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:26.795224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 625/1259] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:38:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:26.800867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27195304-ca6e-4baa-87ce-58d850149462 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:26.895000 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27195304-ca6e-4baa-87ce-58d850149462 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:26.927068 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cdcc7-485c-4085-8d6e-315b248ba4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:26.927733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cdcc7-485c-4085-8d6e-315b248ba4d9 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:26.928021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cdcc7-485c-4085-8d6e-315b248ba4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:26.928302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cdcc7-485c-4085-8d6e-315b248ba4d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:26.929130 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cdcc7-485c-4085-8d6e-315b248ba4d9 None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=735744b9ea1f429399b914f3e00d166f) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:26.929444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cdcc7-485c-4085-8d6e-315b248ba4d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:26.930846 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cdcc7-485c-4085-8d6e-315b248ba4d9 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:26.936105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 635/1260] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:38:26 2022] GET /identity/v3/role_assignments?user.id=735744b9ea1f429399b914f3e00d166f&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=70e67f35994843ae942d4f1703d5619e => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:38:29.126090 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee35e-5fe6-466e-a646-0bb1914cac26 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:29.126653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee35e-5fe6-466e-a646-0bb1914cac26 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:29.126653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee35e-5fe6-466e-a646-0bb1914cac26 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:29.128036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 626/1261] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:38:29.133105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924343ef-972e-45fc-8bca-e93e6cbeb786 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:29.133520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924343ef-972e-45fc-8bca-e93e6cbeb786 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:29.133652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924343ef-972e-45fc-8bca-e93e6cbeb786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:29.149804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-924343ef-972e-45fc-8bca-e93e6cbeb786 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:38:29.150948 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-924343ef-972e-45fc-8bca-e93e6cbeb786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:38:29.213251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 636/1262] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:38:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:38:29.235141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ee35e-5fe6-466e-a646-0bb1914cac26 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:29.330213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ee35e-5fe6-466e-a646-0bb1914cac26 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:29.361987 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da12a95-e13d-4f9c-ac16-3a415b7ea3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:29.362755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da12a95-e13d-4f9c-ac16-3a415b7ea3b6 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:29.363038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da12a95-e13d-4f9c-ac16-3a415b7ea3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:29.363339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da12a95-e13d-4f9c-ac16-3a415b7ea3b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:29.373402 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da12a95-e13d-4f9c-ac16-3a415b7ea3b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-8da12a95-e13d-4f9c-ac16-3a415b7ea3b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:38:29.381028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:29.382144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:29.383200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 627/1263] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:29.388194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924343ef-972e-45fc-8bca-e93e6cbeb786 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:29.481304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924343ef-972e-45fc-8bca-e93e6cbeb786 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:29.512068 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978a124-01eb-467d-9f84-173e4f102dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:29.512709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978a124-01eb-467d-9f84-173e4f102dea None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:29.512984 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978a124-01eb-467d-9f84-173e4f102dea None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:29.513250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978a124-01eb-467d-9f84-173e4f102dea None admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:29.513981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978a124-01eb-467d-9f84-173e4f102dea None admin] RBAC: Adding query filter params (name=admin) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:29.514279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978a124-01eb-467d-9f84-173e4f102dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:29.515648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978a124-01eb-467d-9f84-173e4f102dea None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:29.523223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 637/1264] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:38:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:29.529283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da12a95-e13d-4f9c-ac16-3a415b7ea3b6 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:29.623403 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da12a95-e13d-4f9c-ac16-3a415b7ea3b6 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:29.654737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed758dd-e12f-45db-a13b-ac03c2528024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:29.655486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed758dd-e12f-45db-a13b-ac03c2528024 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:29.655764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed758dd-e12f-45db-a13b-ac03c2528024 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:29.656034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed758dd-e12f-45db-a13b-ac03c2528024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:29.666027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed758dd-e12f-45db-a13b-ac03c2528024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:29.667490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed758dd-e12f-45db-a13b-ac03c2528024 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-3ed758dd-e12f-45db-a13b-ac03c2528024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:29.684039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:29.685077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:29.686325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:29.686325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:29.686325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:29.686325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:29.686325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 628/1265] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:29.690978 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978a124-01eb-467d-9f84-173e4f102dea None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:29.793302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978a124-01eb-467d-9f84-173e4f102dea None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:29.824778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aefa60-4ac0-420f-a5a4-85a68e8c84cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:29.825419 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aefa60-4ac0-420f-a5a4-85a68e8c84cb None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:29.825694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aefa60-4ac0-420f-a5a4-85a68e8c84cb None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:29.825962 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aefa60-4ac0-420f-a5a4-85a68e8c84cb None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:29.826669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aefa60-4ac0-420f-a5a4-85a68e8c84cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:29.826967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aefa60-4ac0-420f-a5a4-85a68e8c84cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:29.828335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aefa60-4ac0-420f-a5a4-85a68e8c84cb None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:29.839289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 638/1266] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:29.845550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed758dd-e12f-45db-a13b-ac03c2528024 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:29.938791 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed758dd-e12f-45db-a13b-ac03c2528024 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:29.970577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b9925-a8eb-48cb-8587-79dc181aa41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:29.971386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b9925-a8eb-48cb-8587-79dc181aa41c None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:29.971666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b9925-a8eb-48cb-8587-79dc181aa41c None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:29.971937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b9925-a8eb-48cb-8587-79dc181aa41c None admin] PATH_INFO: `/v3/users/placement` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:29.978963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b9925-a8eb-48cb-8587-79dc181aa41c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:29.980450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b9925-a8eb-48cb-8587-79dc181aa41c None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-a07b9925-a8eb-48cb-8587-79dc181aa41c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:38:29.994041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:29.995127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:29.996380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:29.996380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:29.996380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:38:29.996380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:38:29.996380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:38:29.996380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:38:29.996380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:38:29.996380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:38:29.996380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 13:38:29.996380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:29.996380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 629/1267] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:30.002846 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aefa60-4ac0-420f-a5a4-85a68e8c84cb None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:30.097051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aefa60-4ac0-420f-a5a4-85a68e8c84cb None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:30.128764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d273-855c-4386-b095-cf3320aeb720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:30.129414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d273-855c-4386-b095-cf3320aeb720 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:30.129693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d273-855c-4386-b095-cf3320aeb720 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:30.129967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5d273-855c-4386-b095-cf3320aeb720 None admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:30.130794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5d273-855c-4386-b095-cf3320aeb720 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:30.131099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5d273-855c-4386-b095-cf3320aeb720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:30.132521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5d273-855c-4386-b095-cf3320aeb720 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:30.149087 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 639/1268] 10.222.0.73 () {56 vars in 1143 bytes} [Wed May 4 13:38:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:30.154702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b9925-a8eb-48cb-8587-79dc181aa41c None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:30.249239 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b9925-a8eb-48cb-8587-79dc181aa41c None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:30.280125 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e1054-bdc0-4b48-8275-17bf15152d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:30.280895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e1054-bdc0-4b48-8275-17bf15152d66 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:30.281177 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e1054-bdc0-4b48-8275-17bf15152d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:30.281453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e1054-bdc0-4b48-8275-17bf15152d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:30.291345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e1054-bdc0-4b48-8275-17bf15152d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:30.292767 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e1054-bdc0-4b48-8275-17bf15152d66 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-1e4e1054-bdc0-4b48-8275-17bf15152d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:30.309592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:30.310657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:30.311970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:30.311970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:30.311970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:30.311970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:30.311970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 630/1269] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:30.316548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d273-855c-4386-b095-cf3320aeb720 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:30.408955 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5d273-855c-4386-b095-cf3320aeb720 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:30.440551 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd6cf2-4c53-48db-9072-66d59565a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:30.441196 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6cf2-4c53-48db-9072-66d59565a802 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:30.441477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6cf2-4c53-48db-9072-66d59565a802 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:30.441754 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd6cf2-4c53-48db-9072-66d59565a802 None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:30.442459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd6cf2-4c53-48db-9072-66d59565a802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:30.442761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd6cf2-4c53-48db-9072-66d59565a802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:30.444153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd6cf2-4c53-48db-9072-66d59565a802 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:30.455588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 640/1270] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:30.461015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e1054-bdc0-4b48-8275-17bf15152d66 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:30.553971 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e1054-bdc0-4b48-8275-17bf15152d66 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:30.585098 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05708d95-b2c7-4a6e-9365-c46f4f9801fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:30.585857 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05708d95-b2c7-4a6e-9365-c46f4f9801fb None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:30.586135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05708d95-b2c7-4a6e-9365-c46f4f9801fb None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:30.586407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05708d95-b2c7-4a6e-9365-c46f4f9801fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:30.592749 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05708d95-b2c7-4a6e-9365-c46f4f9801fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:30.594159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05708d95-b2c7-4a6e-9365-c46f4f9801fb None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-05708d95-b2c7-4a6e-9365-c46f4f9801fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:38:30.608566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:30.609581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:30.610757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:38:30.610757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:38:30.610757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:38:30.610757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:38:30.610757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:38:30.610757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:38:30.610757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:38:30.610757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:30.610757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 631/1271] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:38:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:30.615373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd6cf2-4c53-48db-9072-66d59565a802 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:30.709689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd6cf2-4c53-48db-9072-66d59565a802 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:30.746869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345ca38-a579-41c2-b213-11c0e81c73f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:30.747642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345ca38-a579-41c2-b213-11c0e81c73f4 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:30.747952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345ca38-a579-41c2-b213-11c0e81c73f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:30.748234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345ca38-a579-41c2-b213-11c0e81c73f4 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:30.749136 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345ca38-a579-41c2-b213-11c0e81c73f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:30.749445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345ca38-a579-41c2-b213-11c0e81c73f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:30.751101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345ca38-a579-41c2-b213-11c0e81c73f4 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:30.764813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 641/1272] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:38:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:30.771037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05708d95-b2c7-4a6e-9365-c46f4f9801fb None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:30.864855 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05708d95-b2c7-4a6e-9365-c46f4f9801fb None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:30.896771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf83da0-8f68-45be-8e41-758bd523e6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:30.897640 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf83da0-8f68-45be-8e41-758bd523e6ef None admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:30.897921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf83da0-8f68-45be-8e41-758bd523e6ef None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:30.898195 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf83da0-8f68-45be-8e41-758bd523e6ef None admin] PATH_INFO: `/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/735744b9ea1f429399b914f3e00d166f/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:30.900203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf83da0-8f68-45be-8e41-758bd523e6ef None admin] RBAC: Authorizing `identity:create_grant(project_id=fbace3b0d2f54a408012ccc368865c82, user_id=735744b9ea1f429399b914f3e00d166f, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:30.901624 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf83da0-8f68-45be-8e41-758bd523e6ef None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:30.915000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 632/1273] 10.222.0.73 () {58 vars in 1439 bytes} [Wed May 4 13:38:30 2022] PUT /identity/v3/projects/fbace3b0d2f54a408012ccc368865c82/users/735744b9ea1f429399b914f3e00d166f/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:38:33.121105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021012a5-6b54-4921-bd92-5083ca923d93 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:33.121646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021012a5-6b54-4921-bd92-5083ca923d93 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:33.121646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021012a5-6b54-4921-bd92-5083ca923d93 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:33.122970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 642/1274] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:38:33.127964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360070ae-e58d-4e7c-8bd5-9b886da4325b None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:33.128404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360070ae-e58d-4e7c-8bd5-9b886da4325b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:33.128499 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360070ae-e58d-4e7c-8bd5-9b886da4325b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:33.146308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-360070ae-e58d-4e7c-8bd5-9b886da4325b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:38:33.147528 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-360070ae-e58d-4e7c-8bd5-9b886da4325b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:38:33.209766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 633/1275] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:38:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:38:33.232272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021012a5-6b54-4921-bd92-5083ca923d93 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:33.327439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021012a5-6b54-4921-bd92-5083ca923d93 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:33.358218 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097cc04-12dd-434d-b127-d1590279c741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:33.358988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097cc04-12dd-434d-b127-d1590279c741 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:33.359289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097cc04-12dd-434d-b127-d1590279c741 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:33.359558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097cc04-12dd-434d-b127-d1590279c741 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:33.368968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097cc04-12dd-434d-b127-d1590279c741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-9097cc04-12dd-434d-b127-d1590279c741 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 13:38:33.378516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:33.379646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:33.380561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 643/1276] 10.222.0.73 () {56 vars in 1096 bytes} [Wed May 4 13:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:33.385484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360070ae-e58d-4e7c-8bd5-9b886da4325b None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:33.483450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360070ae-e58d-4e7c-8bd5-9b886da4325b None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:33.514632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf407c-afa0-400e-a05f-f2f5350a8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:33.515312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf407c-afa0-400e-a05f-f2f5350a8917 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:33.515591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf407c-afa0-400e-a05f-f2f5350a8917 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:33.515860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf407c-afa0-400e-a05f-f2f5350a8917 None admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:33.516592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf407c-afa0-400e-a05f-f2f5350a8917 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:33.516893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf407c-afa0-400e-a05f-f2f5350a8917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:33.518242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf407c-afa0-400e-a05f-f2f5350a8917 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:33.525727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 634/1277] 10.222.0.73 () {56 vars in 1099 bytes} [Wed May 4 13:38:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:33.531411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097cc04-12dd-434d-b127-d1590279c741 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:33.625170 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097cc04-12dd-434d-b127-d1590279c741 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:33.656008 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf010c3-1c3a-4dd4-8aed-fa33fd3277a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:33.656750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf010c3-1c3a-4dd4-8aed-fa33fd3277a1 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:33.657030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf010c3-1c3a-4dd4-8aed-fa33fd3277a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:33.657317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf010c3-1c3a-4dd4-8aed-fa33fd3277a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:33.667249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf010c3-1c3a-4dd4-8aed-fa33fd3277a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:33.669173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf010c3-1c3a-4dd4-8aed-fa33fd3277a1 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-cbf010c3-1c3a-4dd4-8aed-fa33fd3277a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:33.685885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:33.686942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:33.688066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:33.688066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:33.688066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:33.688066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:33.688066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 644/1278] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:33.694063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf407c-afa0-400e-a05f-f2f5350a8917 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:33.809896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf407c-afa0-400e-a05f-f2f5350a8917 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:33.840758 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a717f3-6ae8-4943-ac4c-182f3ddbc329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:33.841398 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a717f3-6ae8-4943-ac4c-182f3ddbc329 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:33.841680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a717f3-6ae8-4943-ac4c-182f3ddbc329 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:33.841952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a717f3-6ae8-4943-ac4c-182f3ddbc329 None admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:33.842657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a717f3-6ae8-4943-ac4c-182f3ddbc329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:33.842963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a717f3-6ae8-4943-ac4c-182f3ddbc329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:33.844342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a717f3-6ae8-4943-ac4c-182f3ddbc329 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:33.855842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 635/1279] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:33.861477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf010c3-1c3a-4dd4-8aed-fa33fd3277a1 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:33.955840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf010c3-1c3a-4dd4-8aed-fa33fd3277a1 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:33.987592 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8773d1-c814-4573-8344-d03d6c1e42fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:33.988367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8773d1-c814-4573-8344-d03d6c1e42fa None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:33.988646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8773d1-c814-4573-8344-d03d6c1e42fa None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:33.988914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8773d1-c814-4573-8344-d03d6c1e42fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:33.996108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8773d1-c814-4573-8344-d03d6c1e42fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:33.998319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8773d1-c814-4573-8344-d03d6c1e42fa None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-6e8773d1-c814-4573-8344-d03d6c1e42fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 13:38:34.019747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:34.020901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:34.022098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:34.022098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:34.022098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 13:38:34.022098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 13:38:34.022098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 13:38:34.022098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 13:38:34.022098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 13:38:34.022098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 13:38:34.022098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 13:38:34.022098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:34.022098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 645/1280] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:34.027484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a717f3-6ae8-4943-ac4c-182f3ddbc329 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:34.124668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a717f3-6ae8-4943-ac4c-182f3ddbc329 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:34.158509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb08715-8630-456f-9975-451a98bae701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:34.159169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb08715-8630-456f-9975-451a98bae701 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:34.159479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb08715-8630-456f-9975-451a98bae701 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:34.159753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb08715-8630-456f-9975-451a98bae701 None admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:34.160580 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb08715-8630-456f-9975-451a98bae701 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:34.160886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb08715-8630-456f-9975-451a98bae701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:34.162305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb08715-8630-456f-9975-451a98bae701 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:34.179258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 636/1281] 10.222.0.73 () {56 vars in 1143 bytes} [Wed May 4 13:38:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:34.185065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8773d1-c814-4573-8344-d03d6c1e42fa None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:34.282599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8773d1-c814-4573-8344-d03d6c1e42fa None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:34.313334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb471c-20c3-4b8c-a1de-bfedefa8b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:34.314037 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb471c-20c3-4b8c-a1de-bfedefa8b930 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:34.314235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb471c-20c3-4b8c-a1de-bfedefa8b930 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:34.314505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb471c-20c3-4b8c-a1de-bfedefa8b930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:34.378489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb471c-20c3-4b8c-a1de-bfedefa8b930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:34.379955 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb471c-20c3-4b8c-a1de-bfedefa8b930 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:34.471872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 646/1282] 10.222.0.73 () {58 vars in 1282 bytes} [Wed May 4 13:38:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 13:38:34.477740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb08715-8630-456f-9975-451a98bae701 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:34.568541 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb08715-8630-456f-9975-451a98bae701 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:34.600343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344c866-a850-4f3e-a829-d5b187b94a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:34.601105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344c866-a850-4f3e-a829-d5b187b94a3b None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:34.601381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344c866-a850-4f3e-a829-d5b187b94a3b None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:34.601675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344c866-a850-4f3e-a829-d5b187b94a3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:34.610951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344c866-a850-4f3e-a829-d5b187b94a3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:34.612398 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344c866-a850-4f3e-a829-d5b187b94a3b None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-f344c866-a850-4f3e-a829-d5b187b94a3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 13:38:34.629229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:34.630254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:34.631397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 13:38:34.631397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 13:38:34.631397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 13:38:34.631397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:34.631397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 637/1283] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:34.635946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb471c-20c3-4b8c-a1de-bfedefa8b930 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:34.730181 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb471c-20c3-4b8c-a1de-bfedefa8b930 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:34.763623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9305179-a37d-4df1-9c94-ff5aa8e6394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:34.764268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9305179-a37d-4df1-9c94-ff5aa8e6394e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:34.764547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9305179-a37d-4df1-9c94-ff5aa8e6394e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:34.764818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9305179-a37d-4df1-9c94-ff5aa8e6394e None admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:34.765526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9305179-a37d-4df1-9c94-ff5aa8e6394e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:34.765826 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9305179-a37d-4df1-9c94-ff5aa8e6394e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:34.767171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9305179-a37d-4df1-9c94-ff5aa8e6394e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:34.777759 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 647/1284] 10.222.0.73 () {56 vars in 1109 bytes} [Wed May 4 13:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:38:34.783523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344c866-a850-4f3e-a829-d5b187b94a3b None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:34.875776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344c866-a850-4f3e-a829-d5b187b94a3b None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:34.906963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e7fd9-ea2a-4260-a0a7-c1bc965eec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:34.907820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e7fd9-ea2a-4260-a0a7-c1bc965eec69 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:34.908108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e7fd9-ea2a-4260-a0a7-c1bc965eec69 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:34.908381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e7fd9-ea2a-4260-a0a7-c1bc965eec69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:34.914655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e7fd9-ea2a-4260-a0a7-c1bc965eec69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:34.916110 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e7fd9-ea2a-4260-a0a7-c1bc965eec69 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application [None req-598e7fd9-ea2a-4260-a0a7-c1bc965eec69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 13:38:34.929728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application with Lock( May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:34.930635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:34.931707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 13:38:34.931707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 13:38:34.931707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 13:38:34.931707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 13:38:34.931707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 13:38:34.931707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 13:38:34.931707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 13:38:34.931707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: ERROR keystone.server.flask.application May 04 13:38:34.931707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 638/1285] 10.222.0.73 () {56 vars in 1111 bytes} [Wed May 4 13:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:34.937218 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9305179-a37d-4df1-9c94-ff5aa8e6394e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:35.029887 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9305179-a37d-4df1-9c94-ff5aa8e6394e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:35.061304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5253c09-09d4-48c4-bb48-9d9b72ea6795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:35.061938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5253c09-09d4-48c4-bb48-9d9b72ea6795 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:35.062216 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5253c09-09d4-48c4-bb48-9d9b72ea6795 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:35.062488 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5253c09-09d4-48c4-bb48-9d9b72ea6795 None admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:35.063279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5253c09-09d4-48c4-bb48-9d9b72ea6795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:35.063584 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5253c09-09d4-48c4-bb48-9d9b72ea6795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:35.064957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5253c09-09d4-48c4-bb48-9d9b72ea6795 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:35.076500 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 648/1286] 10.222.0.73 () {56 vars in 1148 bytes} [Wed May 4 13:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:35.082369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e7fd9-ea2a-4260-a0a7-c1bc965eec69 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:35.176319 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e7fd9-ea2a-4260-a0a7-c1bc965eec69 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:35.208005 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f0c30-7071-4476-977b-bbe93cadb4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:35.208647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f0c30-7071-4476-977b-bbe93cadb4f5 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:35.208929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f0c30-7071-4476-977b-bbe93cadb4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:35.209204 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f0c30-7071-4476-977b-bbe93cadb4f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:35.210028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f0c30-7071-4476-977b-bbe93cadb4f5 None admin] RBAC: Adding query filter params (role.id=70e67f35994843ae942d4f1703d5619e, scope.project.id=fbace3b0d2f54a408012ccc368865c82, user.id=735744b9ea1f429399b914f3e00d166f) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:35.210342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f0c30-7071-4476-977b-bbe93cadb4f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:35.211813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f0c30-7071-4476-977b-bbe93cadb4f5 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:35.217366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 639/1287] 10.222.0.73 () {56 vars in 1374 bytes} [Wed May 4 13:38:35 2022] GET /identity/v3/role_assignments?user.id=735744b9ea1f429399b914f3e00d166f&scope.project.id=fbace3b0d2f54a408012ccc368865c82&role.id=70e67f35994843ae942d4f1703d5619e => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:37.430753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d46b1-b64a-4f44-98d8-2e122cfe7aa2 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:37.431306 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d46b1-b64a-4f44-98d8-2e122cfe7aa2 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:37.431400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d46b1-b64a-4f44-98d8-2e122cfe7aa2 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:37.432675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 649/1288] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:38:37.437669 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2349f-053f-4b14-a4ae-101487b7ba31 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:37.438059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2349f-053f-4b14-a4ae-101487b7ba31 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:37.438224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2349f-053f-4b14-a4ae-101487b7ba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:37.455217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-04c2349f-053f-4b14-a4ae-101487b7ba31 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:38:37.456384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-04c2349f-053f-4b14-a4ae-101487b7ba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:38:37.517733 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 640/1289] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:38:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:38:37.539595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d46b1-b64a-4f44-98d8-2e122cfe7aa2 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:37.634066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d46b1-b64a-4f44-98d8-2e122cfe7aa2 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:37.665340 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee32005-3064-43f1-9f22-f8697447fc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:37.666102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee32005-3064-43f1-9f22-f8697447fc9e None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:37.666378 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee32005-3064-43f1-9f22-f8697447fc9e None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:37.666645 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee32005-3064-43f1-9f22-f8697447fc9e None admin] PATH_INFO: `/v3/services/placement` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:37.667304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee32005-3064-43f1-9f22-f8697447fc9e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:37.668659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee32005-3064-43f1-9f22-f8697447fc9e None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-4ee32005-3064-43f1-9f22-f8697447fc9e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:37.679918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:37.681135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:37.682220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 650/1290] 10.222.0.73 () {56 vars in 1117 bytes} [Wed May 4 13:38:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:37.687559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2349f-053f-4b14-a4ae-101487b7ba31 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:37.790661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2349f-053f-4b14-a4ae-101487b7ba31 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:37.824562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee36db-5e3f-4ecd-8e1f-930be68d5303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:37.825205 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee36db-5e3f-4ecd-8e1f-930be68d5303 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:37.825480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee36db-5e3f-4ecd-8e1f-930be68d5303 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:37.825748 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee36db-5e3f-4ecd-8e1f-930be68d5303 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:37.826439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee36db-5e3f-4ecd-8e1f-930be68d5303 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:37.826738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee36db-5e3f-4ecd-8e1f-930be68d5303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:37.828111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee36db-5e3f-4ecd-8e1f-930be68d5303 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:37.832661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 641/1291] 10.222.0.73 () {56 vars in 1116 bytes} [Wed May 4 13:38:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:37.838349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee32005-3064-43f1-9f22-f8697447fc9e None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:37.931007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee32005-3064-43f1-9f22-f8697447fc9e None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:37.963387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3051188-2929-4893-b391-91c00ad4c7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:37.964026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3051188-2929-4893-b391-91c00ad4c7fd None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:37.964349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3051188-2929-4893-b391-91c00ad4c7fd None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:37.964620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3051188-2929-4893-b391-91c00ad4c7fd None admin] PATH_INFO: `/v3/services` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:37.965312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3051188-2929-4893-b391-91c00ad4c7fd None admin] RBAC: Adding query filter params (type=placement) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:37.965610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3051188-2929-4893-b391-91c00ad4c7fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:37.966939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3051188-2929-4893-b391-91c00ad4c7fd None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:37.971113 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 651/1292] 10.222.0.73 () {56 vars in 1116 bytes} [Wed May 4 13:38:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:38:40.155101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c59d9-1006-4d02-8427-259dd1e3c712 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:40.155666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c59d9-1006-4d02-8427-259dd1e3c712 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:40.155666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c59d9-1006-4d02-8427-259dd1e3c712 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:40.157034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 642/1293] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:38:40.162210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c86842-218f-4195-b304-4b4cbcce37e2 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:40.162636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c86842-218f-4195-b304-4b4cbcce37e2 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:40.162779 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c86842-218f-4195-b304-4b4cbcce37e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:40.180040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-13c86842-218f-4195-b304-4b4cbcce37e2 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:38:40.181226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-13c86842-218f-4195-b304-4b4cbcce37e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:38:40.246738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 652/1294] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:38:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:38:40.272942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c59d9-1006-4d02-8427-259dd1e3c712 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:40.368515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c59d9-1006-4d02-8427-259dd1e3c712 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:40.400218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16017a97-673c-49bf-8b72-25f12f6f8b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:40.400865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017a97-673c-49bf-8b72-25f12f6f8b13 None admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:40.401149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017a97-673c-49bf-8b72-25f12f6f8b13 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:40.401426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017a97-673c-49bf-8b72-25f12f6f8b13 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:40.402143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16017a97-673c-49bf-8b72-25f12f6f8b13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:40.403532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16017a97-673c-49bf-8b72-25f12f6f8b13 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:40.415936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 643/1295] 10.222.0.73 () {60 vars in 1141 bytes} [Wed May 4 13:38:40 2022] POST /identity/v3/services => generated 246 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:38:42.638213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900f9a6-e05a-41c4-9675-c408fb084336 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:42.638774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900f9a6-e05a-41c4-9675-c408fb084336 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:42.638774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900f9a6-e05a-41c4-9675-c408fb084336 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:42.640071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 653/1296] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:38:42.645272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffbe25-452a-4da9-8b16-c1cc2f8ece1f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:42.645698 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffbe25-452a-4da9-8b16-c1cc2f8ece1f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:42.645828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffbe25-452a-4da9-8b16-c1cc2f8ece1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:42.662476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-37ffbe25-452a-4da9-8b16-c1cc2f8ece1f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:38:42.663675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-37ffbe25-452a-4da9-8b16-c1cc2f8ece1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:38:42.733519 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 644/1297] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:38:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:38:42.758986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900f9a6-e05a-41c4-9675-c408fb084336 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:42.859268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900f9a6-e05a-41c4-9675-c408fb084336 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:42.891341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fbcd3-c319-4b32-b9ae-dd49bbb173d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:42.892057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fbcd3-c319-4b32-b9ae-dd49bbb173d5 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:42.892334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fbcd3-c319-4b32-b9ae-dd49bbb173d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:42.892604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fbcd3-c319-4b32-b9ae-dd49bbb173d5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:42.893241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fbcd3-c319-4b32-b9ae-dd49bbb173d5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:42.894593 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fbcd3-c319-4b32-b9ae-dd49bbb173d5 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-b29fbcd3-c319-4b32-b9ae-dd49bbb173d5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:42.905992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:42.907152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:42.908307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 654/1298] 10.222.0.73 () {56 vars in 1117 bytes} [Wed May 4 13:38:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:42.913363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffbe25-452a-4da9-8b16-c1cc2f8ece1f None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:43.004215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffbe25-452a-4da9-8b16-c1cc2f8ece1f None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:43.035704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e3b98-ff45-459a-80ae-d5a6e8122c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:43.036350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e3b98-ff45-459a-80ae-d5a6e8122c64 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:43.036632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e3b98-ff45-459a-80ae-d5a6e8122c64 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:43.036910 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e3b98-ff45-459a-80ae-d5a6e8122c64 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:43.037605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e3b98-ff45-459a-80ae-d5a6e8122c64 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:43.037913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e3b98-ff45-459a-80ae-d5a6e8122c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:43.039287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e3b98-ff45-459a-80ae-d5a6e8122c64 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:43.044194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 645/1299] 10.222.0.73 () {56 vars in 1116 bytes} [Wed May 4 13:38:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:43.049925 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fbcd3-c319-4b32-b9ae-dd49bbb173d5 None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:43.144605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fbcd3-c319-4b32-b9ae-dd49bbb173d5 None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:43.175666 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d852b-5737-4079-b353-a6ee01259894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:43.176307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d852b-5737-4079-b353-a6ee01259894 None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:43.176584 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d852b-5737-4079-b353-a6ee01259894 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:43.176851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d852b-5737-4079-b353-a6ee01259894 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:43.177626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d852b-5737-4079-b353-a6ee01259894 None admin] RBAC: Adding query filter params (interface=public, service_id=4a93aa918157498d88809df05e1eddb8, region_id=RegionOne) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:43.177930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d852b-5737-4079-b353-a6ee01259894 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:43.179281 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d852b-5737-4079-b353-a6ee01259894 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:43.184543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 655/1300] 10.222.0.73 () {56 vars in 1251 bytes} [Wed May 4 13:38:43 2022] GET /identity/v3/endpoints?service_id=4a93aa918157498d88809df05e1eddb8&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:43.190267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e3b98-ff45-459a-80ae-d5a6e8122c64 None admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:43.282790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e3b98-ff45-459a-80ae-d5a6e8122c64 None admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:43.315582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937df59-8dd9-49af-92d2-15c1c1c68a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:43.316240 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937df59-8dd9-49af-92d2-15c1c1c68a59 None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:43.316520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937df59-8dd9-49af-92d2-15c1c1c68a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:43.316794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937df59-8dd9-49af-92d2-15c1c1c68a59 None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:43.317463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937df59-8dd9-49af-92d2-15c1c1c68a59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:43.318807 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937df59-8dd9-49af-92d2-15c1c1c68a59 None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:43.325632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 646/1301] 10.222.0.73 () {56 vars in 1087 bytes} [Wed May 4 13:38:43 2022] GET /identity/v3/services => generated 2191 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:38:45.553653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a9dea-9420-4a2e-b1af-c7dcf8de4c41 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:45.554177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a9dea-9420-4a2e-b1af-c7dcf8de4c41 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:45.554271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a9dea-9420-4a2e-b1af-c7dcf8de4c41 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:45.555595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 656/1302] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:38:45.560696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7073-a340-4483-85f0-e6bf058ae50a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:45.561142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7073-a340-4483-85f0-e6bf058ae50a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:45.561262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c7073-a340-4483-85f0-e6bf058ae50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:45.578289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-1f3c7073-a340-4483-85f0-e6bf058ae50a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:38:45.579434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1f3c7073-a340-4483-85f0-e6bf058ae50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:38:45.641538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 647/1303] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:38:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 13:38:45.664149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a9dea-9420-4a2e-b1af-c7dcf8de4c41 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:45.760400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a9dea-9420-4a2e-b1af-c7dcf8de4c41 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:45.792936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9983d41-49fc-4e93-b4de-19cb89a1b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:45.793709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9983d41-49fc-4e93-b4de-19cb89a1b01c None admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:45.793990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9983d41-49fc-4e93-b4de-19cb89a1b01c None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:45.794262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9983d41-49fc-4e93-b4de-19cb89a1b01c None admin] PATH_INFO: `/v3/services/placement` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:45.794902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9983d41-49fc-4e93-b4de-19cb89a1b01c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:45.796272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9983d41-49fc-4e93-b4de-19cb89a1b01c None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application [None req-a9983d41-49fc-4e93-b4de-19cb89a1b01c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 13:38:45.807711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 13:38:45.808869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.get_or_create( May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application with Lock( May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self._enter() May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application return self.creator() May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application created_value = creator( May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: ERROR keystone.server.flask.application May 04 13:38:45.809768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 657/1304] 10.222.0.73 () {56 vars in 1117 bytes} [Wed May 4 13:38:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 13:38:45.814631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c7073-a340-4483-85f0-e6bf058ae50a None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:45.907122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c7073-a340-4483-85f0-e6bf058ae50a None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:45.939247 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984062ac-5228-4cc5-81b7-e22257974ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:45.939896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984062ac-5228-4cc5-81b7-e22257974ffd None admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:45.940179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984062ac-5228-4cc5-81b7-e22257974ffd None admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:45.940455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984062ac-5228-4cc5-81b7-e22257974ffd None admin] PATH_INFO: `/v3/services` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:45.941146 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984062ac-5228-4cc5-81b7-e22257974ffd None admin] RBAC: Adding query filter params (name=placement) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:38:45.941450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984062ac-5228-4cc5-81b7-e22257974ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:45.942812 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984062ac-5228-4cc5-81b7-e22257974ffd None admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:45.947940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 648/1305] 10.222.0.73 () {56 vars in 1116 bytes} [Wed May 4 13:38:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:38:45.953986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9983d41-49fc-4e93-b4de-19cb89a1b01c None admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:38:46.047959 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9983d41-49fc-4e93-b4de-19cb89a1b01c None admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:38:46.080658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c15c-929d-447a-8a1f-fb2ab16df7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:38:46.081296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c15c-929d-447a-8a1f-fb2ab16df7f8 None admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:38:46.081581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c15c-929d-447a-8a1f-fb2ab16df7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:38:46.081859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c15c-929d-447a-8a1f-fb2ab16df7f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:38:46.082589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66c15c-929d-447a-8a1f-fb2ab16df7f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:38:46.083960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66c15c-929d-447a-8a1f-fb2ab16df7f8 None admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:38:46.101677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 658/1306] 10.222.0.73 () {60 vars in 1144 bytes} [Wed May 4 13:38:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:39:49.115631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102f80a-4d1e-47f8-88e8-5d102dd09c61 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:49.116609 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102f80a-4d1e-47f8-88e8-5d102dd09c61 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:49.117071 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102f80a-4d1e-47f8-88e8-5d102dd09c61 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:49.119380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 649/1307] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:39:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:39:49.124913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dafbc2-623b-4df4-a49b-492e8622bd95 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:49.125850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dafbc2-623b-4df4-a49b-492e8622bd95 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:49.126335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dafbc2-623b-4df4-a49b-492e8622bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:49.211565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d5dafbc2-623b-4df4-a49b-492e8622bd95 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:39:49.213103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d5dafbc2-623b-4df4-a49b-492e8622bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:49.455170 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 659/1308] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:39:49.516924 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287625e5-32bf-4218-9c58-c88b942aa46e None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:49.517213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287625e5-32bf-4218-9c58-c88b942aa46e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:49.517490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287625e5-32bf-4218-9c58-c88b942aa46e None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:49.519158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 650/1309] 10.222.0.73 () {54 vars in 964 bytes} [Wed May 4 13:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:39:49.528180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035e643-04d7-4ddb-9519-712e0fe2c8f1 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:49.528699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035e643-04d7-4ddb-9519-712e0fe2c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:49.529184 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035e643-04d7-4ddb-9519-712e0fe2c8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:49.706971 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-0035e643-04d7-4ddb-9519-712e0fe2c8f1 None None] MFA Rules not processed for user `963a38e769674dbba95a231e47a7191f`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:39:49.708270 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0035e643-04d7-4ddb-9519-712e0fe2c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:49.834082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 660/1310] 10.222.0.73 () {58 vars in 1061 bytes} [Wed May 4 13:39:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:39:49.844130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287625e5-32bf-4218-9c58-c88b942aa46e None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:39:49.846092 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-287625e5-32bf-4218-9c58-c88b942aa46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:49.960221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287625e5-32bf-4218-9c58-c88b942aa46e None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:39:50.041535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94836a-4f03-4a14-a560-253719e8ba1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:39:50.042540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94836a-4f03-4a14-a560-253719e8ba1b service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:50.042982 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94836a-4f03-4a14-a560-253719e8ba1b service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:50.043605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94836a-4f03-4a14-a560-253719e8ba1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:50.048214 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8c94836a-4f03-4a14-a560-253719e8ba1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:50.160668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94836a-4f03-4a14-a560-253719e8ba1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:39:50.162795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94836a-4f03-4a14-a560-253719e8ba1b service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:39:50.182218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 651/1311] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:39:52.859855 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d69ec-a5d4-4123-987d-33156a76d30e None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:52.860367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d69ec-a5d4-4123-987d-33156a76d30e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:52.860367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d69ec-a5d4-4123-987d-33156a76d30e None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:52.861683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 661/1312] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:39:52.866937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f221f57-23e0-4e69-bd56-08a9a1ea7a73 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:52.867391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f221f57-23e0-4e69-bd56-08a9a1ea7a73 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:52.867581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f221f57-23e0-4e69-bd56-08a9a1ea7a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:52.934743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-7f221f57-23e0-4e69-bd56-08a9a1ea7a73 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:39:52.935950 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7f221f57-23e0-4e69-bd56-08a9a1ea7a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:53.029130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 652/1313] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:39:53.066121 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d69ec-a5d4-4123-987d-33156a76d30e None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:39:53.067662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c97d69ec-a5d4-4123-987d-33156a76d30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:53.168608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d69ec-a5d4-4123-987d-33156a76d30e None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:39:53.239886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2ecf9-e433-4771-b531-561045030ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:39:53.240533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2ecf9-e433-4771-b531-561045030ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:53.240809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2ecf9-e433-4771-b531-561045030ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:53.241077 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2ecf9-e433-4771-b531-561045030ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:53.242683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2de2ecf9-e433-4771-b531-561045030ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:53.351600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2ecf9-e433-4771-b531-561045030ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:39:53.353037 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2ecf9-e433-4771-b531-561045030ad6 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:39:53.372171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 662/1314] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:39:55.907901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3ebe-9967-4afa-8e27-26439bd8628b None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:55.908478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3ebe-9967-4afa-8e27-26439bd8628b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:55.908478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f3ebe-9967-4afa-8e27-26439bd8628b None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:55.909821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 653/1315] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:39:55.915012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f7368-5853-4faf-990a-40d0ff5c85c9 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:55.915460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f7368-5853-4faf-990a-40d0ff5c85c9 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:55.915598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f7368-5853-4faf-990a-40d0ff5c85c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:55.977321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-3c2f7368-5853-4faf-990a-40d0ff5c85c9 None None] MFA Rules not processed for user `d7c7a65e48834491a829f72b9785f1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:39:55.978491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3c2f7368-5853-4faf-990a-40d0ff5c85c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:56.069842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 663/1316] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:39:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:39:56.109734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3ebe-9967-4afa-8e27-26439bd8628b None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:39:56.111289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-257f3ebe-9967-4afa-8e27-26439bd8628b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:56.209199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f3ebe-9967-4afa-8e27-26439bd8628b None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:39:56.277902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fe589-e7ed-4cb6-b8c6-2dfc9826062d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:39:56.278539 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fe589-e7ed-4cb6-b8c6-2dfc9826062d service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:56.278819 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fe589-e7ed-4cb6-b8c6-2dfc9826062d service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:56.279091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fe589-e7ed-4cb6-b8c6-2dfc9826062d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:56.280726 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9c8fe589-e7ed-4cb6-b8c6-2dfc9826062d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:56.383058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fe589-e7ed-4cb6-b8c6-2dfc9826062d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:39:56.384529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fe589-e7ed-4cb6-b8c6-2dfc9826062d service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:39:56.402062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 654/1317] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:39:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:39:59.128842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2aa511-698f-4047-90ce-4c0f09825dce None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:59.129387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2aa511-698f-4047-90ce-4c0f09825dce None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:59.129387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2aa511-698f-4047-90ce-4c0f09825dce None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:59.130737 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 664/1318] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:39:59.135933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24c98-de11-45b0-8816-cbd6574f139a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:59.136340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24c98-de11-45b0-8816-cbd6574f139a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:59.136496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24c98-de11-45b0-8816-cbd6574f139a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:59.197994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6fe24c98-de11-45b0-8816-cbd6574f139a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:39:59.199165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6fe24c98-de11-45b0-8816-cbd6574f139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:59.288542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 655/1319] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:39:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:39:59.327181 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2aa511-698f-4047-90ce-4c0f09825dce None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:39:59.328737 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2d2aa511-698f-4047-90ce-4c0f09825dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:59.426694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2aa511-698f-4047-90ce-4c0f09825dce None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:39:59.496140 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4bd15-0d3c-4e3f-b780-e612aec05ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:39:59.496777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4bd15-0d3c-4e3f-b780-e612aec05ebc service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:39:59.497055 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4bd15-0d3c-4e3f-b780-e612aec05ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:39:59.497327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4bd15-0d3c-4e3f-b780-e612aec05ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:39:59.498935 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-24a4bd15-0d3c-4e3f-b780-e612aec05ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:39:59.602125 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4bd15-0d3c-4e3f-b780-e612aec05ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:39:59.603519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4bd15-0d3c-4e3f-b780-e612aec05ebc service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:39:59.621304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 665/1320] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:39:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:02.500891 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a28ac4-000c-4fc1-a983-acb47b0f29ab None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:02.501448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a28ac4-000c-4fc1-a983-acb47b0f29ab None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:02.501448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a28ac4-000c-4fc1-a983-acb47b0f29ab None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:02.502840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 656/1321] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:02.508107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c48a7-a942-4744-94ca-98d21b03ae39 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:02.508544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c48a7-a942-4744-94ca-98d21b03ae39 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:02.508793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c48a7-a942-4744-94ca-98d21b03ae39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:02.572377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-4e3c48a7-a942-4744-94ca-98d21b03ae39 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:02.573562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4e3c48a7-a942-4744-94ca-98d21b03ae39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:02.664302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 666/1322] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:02.701648 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a28ac4-000c-4fc1-a983-acb47b0f29ab None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:02.703192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-93a28ac4-000c-4fc1-a983-acb47b0f29ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:02.807140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a28ac4-000c-4fc1-a983-acb47b0f29ab None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:02.876690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29236b3c-8322-40bd-952c-83fb78bbe285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:02.877250 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29236b3c-8322-40bd-952c-83fb78bbe285 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:02.877531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29236b3c-8322-40bd-952c-83fb78bbe285 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:02.877805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29236b3c-8322-40bd-952c-83fb78bbe285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:02.879453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-29236b3c-8322-40bd-952c-83fb78bbe285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:02.984034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29236b3c-8322-40bd-952c-83fb78bbe285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:02.985498 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29236b3c-8322-40bd-952c-83fb78bbe285 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:03.004154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 657/1323] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:05.332624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e61df4-aedf-4531-a2a8-543e11f410d7 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:05.333085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e61df4-aedf-4531-a2a8-543e11f410d7 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:05.333085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e61df4-aedf-4531-a2a8-543e11f410d7 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:05.334451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 667/1324] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:40:05.340329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3e8e-af43-4368-bc14-07fcf3661a4e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:05.340746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3e8e-af43-4368-bc14-07fcf3661a4e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:05.340928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3e8e-af43-4368-bc14-07fcf3661a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:05.402314 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b53a3e8e-af43-4368-bc14-07fcf3661a4e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:05.403521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b53a3e8e-af43-4368-bc14-07fcf3661a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:05.496372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 658/1325] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:05.532513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e61df4-aedf-4531-a2a8-543e11f410d7 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:05.534007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-49e61df4-aedf-4531-a2a8-543e11f410d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:05.633518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e61df4-aedf-4531-a2a8-543e11f410d7 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:05.703280 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf806c-6bd0-4064-b296-5ac61920499f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:05.703920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf806c-6bd0-4064-b296-5ac61920499f service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:05.704199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf806c-6bd0-4064-b296-5ac61920499f service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:05.704471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf806c-6bd0-4064-b296-5ac61920499f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:05.706066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1ebf806c-6bd0-4064-b296-5ac61920499f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:05.813990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf806c-6bd0-4064-b296-5ac61920499f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:05.815457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf806c-6bd0-4064-b296-5ac61920499f service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:05.834174 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 668/1326] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:08.161916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fb61f-8976-4b66-b6e9-8c2fa45a62d1 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:08.162485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fb61f-8976-4b66-b6e9-8c2fa45a62d1 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:08.162485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fb61f-8976-4b66-b6e9-8c2fa45a62d1 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:08.163871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 659/1327] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:08.169136 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e930b2a-0fa5-4570-a9e8-2b6fa6beb3a5 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:08.169566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e930b2a-0fa5-4570-a9e8-2b6fa6beb3a5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:08.169761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e930b2a-0fa5-4570-a9e8-2b6fa6beb3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:08.234051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-3e930b2a-0fa5-4570-a9e8-2b6fa6beb3a5 None None] MFA Rules not processed for user `d7c7a65e48834491a829f72b9785f1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:08.235306 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3e930b2a-0fa5-4570-a9e8-2b6fa6beb3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:08.330798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 669/1328] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:08.368094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fb61f-8976-4b66-b6e9-8c2fa45a62d1 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:08.369678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-fd4fb61f-8976-4b66-b6e9-8c2fa45a62d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:08.469961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fb61f-8976-4b66-b6e9-8c2fa45a62d1 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:08.540996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c2f5f-6b82-49ba-b29f-f00255c4641b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:08.541632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c2f5f-6b82-49ba-b29f-f00255c4641b service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:08.541965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c2f5f-6b82-49ba-b29f-f00255c4641b service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:08.542239 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c2f5f-6b82-49ba-b29f-f00255c4641b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:08.543892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-003c2f5f-6b82-49ba-b29f-f00255c4641b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:08.648387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c2f5f-6b82-49ba-b29f-f00255c4641b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:08.649823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c2f5f-6b82-49ba-b29f-f00255c4641b service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:08.666926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 660/1329] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:11.156011 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a49881-ad9f-40a0-8bb5-c60eeb4a31af None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:11.156518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a49881-ad9f-40a0-8bb5-c60eeb4a31af None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:11.156636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a49881-ad9f-40a0-8bb5-c60eeb4a31af None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:11.157918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 670/1330] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:11.163419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41415514-e85f-46dd-aafd-76962dfcc5ef None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:11.163899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41415514-e85f-46dd-aafd-76962dfcc5ef None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:11.163990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41415514-e85f-46dd-aafd-76962dfcc5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:11.228172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-41415514-e85f-46dd-aafd-76962dfcc5ef None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:11.229400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-41415514-e85f-46dd-aafd-76962dfcc5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:11.328078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 661/1331] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:11.381014 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cc00d-fa06-48d5-92e7-95ba5e84c53d None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:11.381305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cc00d-fa06-48d5-92e7-95ba5e84c53d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:11.381577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cc00d-fa06-48d5-92e7-95ba5e84c53d None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:11.383273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 671/1332] 10.222.0.73 () {54 vars in 964 bytes} [Wed May 4 13:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:11.390527 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7609676-3028-4de1-8bd8-6a4c33b3b225 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:11.390817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7609676-3028-4de1-8bd8-6a4c33b3b225 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:11.391097 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7609676-3028-4de1-8bd8-6a4c33b3b225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:11.465854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f7609676-3028-4de1-8bd8-6a4c33b3b225 None None] MFA Rules not processed for user `963a38e769674dbba95a231e47a7191f`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:11.467033 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f7609676-3028-4de1-8bd8-6a4c33b3b225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:11.540798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 662/1333] 10.222.0.73 () {58 vars in 1061 bytes} [Wed May 4 13:40:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:40:11.550327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cc00d-fa06-48d5-92e7-95ba5e84c53d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:11.552046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-165cc00d-fa06-48d5-92e7-95ba5e84c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:11.656786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cc00d-fa06-48d5-92e7-95ba5e84c53d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:11.731382 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46634a6a-fa56-4a88-b251-b9de7a926882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:11.732159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46634a6a-fa56-4a88-b251-b9de7a926882 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:11.732504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46634a6a-fa56-4a88-b251-b9de7a926882 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:11.732783 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46634a6a-fa56-4a88-b251-b9de7a926882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:11.734422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-46634a6a-fa56-4a88-b251-b9de7a926882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:11.840056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46634a6a-fa56-4a88-b251-b9de7a926882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:11.841495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46634a6a-fa56-4a88-b251-b9de7a926882 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:11.860906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 672/1334] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:14.365348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389b2ac-c9e5-49eb-8227-d4ec2bc250f0 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:14.365892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389b2ac-c9e5-49eb-8227-d4ec2bc250f0 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:14.365892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389b2ac-c9e5-49eb-8227-d4ec2bc250f0 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:14.367297 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 663/1335] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:14.372948 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c27bc4-785a-4fa9-9963-025bb10dd3e0 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:14.373428 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c27bc4-785a-4fa9-9963-025bb10dd3e0 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:14.373545 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c27bc4-785a-4fa9-9963-025bb10dd3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:14.434642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d1c27bc4-785a-4fa9-9963-025bb10dd3e0 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:14.435853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d1c27bc4-785a-4fa9-9963-025bb10dd3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:14.527398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 673/1336] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:14.566235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389b2ac-c9e5-49eb-8227-d4ec2bc250f0 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:14.567721 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c389b2ac-c9e5-49eb-8227-d4ec2bc250f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:14.667145 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389b2ac-c9e5-49eb-8227-d4ec2bc250f0 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:14.737654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72239821-acb3-4171-b706-b82ccd413309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:14.738296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72239821-acb3-4171-b706-b82ccd413309 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:14.738572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72239821-acb3-4171-b706-b82ccd413309 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:14.738842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72239821-acb3-4171-b706-b82ccd413309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:14.740519 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-72239821-acb3-4171-b706-b82ccd413309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:14.845230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72239821-acb3-4171-b706-b82ccd413309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:14.846576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72239821-acb3-4171-b706-b82ccd413309 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:14.863996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 664/1337] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:17.721767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13433-6579-4405-8f60-a7b5e698c7a0 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:17.722313 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13433-6579-4405-8f60-a7b5e698c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:17.722313 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13433-6579-4405-8f60-a7b5e698c7a0 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:17.723743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 674/1338] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:17.730964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55d50-a24f-43ee-afa5-451dc01e4b26 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:17.731456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55d50-a24f-43ee-afa5-451dc01e4b26 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:17.731760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55d50-a24f-43ee-afa5-451dc01e4b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:17.794757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f6e55d50-a24f-43ee-afa5-451dc01e4b26 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:17.795970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f6e55d50-a24f-43ee-afa5-451dc01e4b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:17.888461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 665/1339] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:17.923969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13433-6579-4405-8f60-a7b5e698c7a0 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:17.925478 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-eeb13433-6579-4405-8f60-a7b5e698c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:18.024917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13433-6579-4405-8f60-a7b5e698c7a0 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:18.094892 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9a12-a4bf-4037-a878-e723d4694bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:18.095561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9a12-a4bf-4037-a878-e723d4694bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:18.095847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9a12-a4bf-4037-a878-e723d4694bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:18.096125 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9a12-a4bf-4037-a878-e723d4694bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:18.097726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-35fe9a12-a4bf-4037-a878-e723d4694bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:18.201548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe9a12-a4bf-4037-a878-e723d4694bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:18.202959 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe9a12-a4bf-4037-a878-e723d4694bb4 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:18.221096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 675/1340] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:22.527359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a945910-6f67-44dd-9811-ebe9d8f88f98 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:22.527876 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a945910-6f67-44dd-9811-ebe9d8f88f98 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:22.527876 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a945910-6f67-44dd-9811-ebe9d8f88f98 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:22.529202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 666/1341] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:22.534265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2753b-0b31-4fa2-888d-7208237ce8ca None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:22.534706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2753b-0b31-4fa2-888d-7208237ce8ca None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:22.534994 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2753b-0b31-4fa2-888d-7208237ce8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:22.606140 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-9ac2753b-0b31-4fa2-888d-7208237ce8ca None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:22.607401 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-9ac2753b-0b31-4fa2-888d-7208237ce8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:22.709867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 676/1342] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:22.749027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a945910-6f67-44dd-9811-ebe9d8f88f98 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:22.751333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7a945910-6f67-44dd-9811-ebe9d8f88f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:22.848513 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a945910-6f67-44dd-9811-ebe9d8f88f98 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:22.851916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026e219-9761-4842-adce-28a7670c4d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:22.852552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026e219-9761-4842-adce-28a7670c4d0a service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:22.852833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026e219-9761-4842-adce-28a7670c4d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:22.853106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026e219-9761-4842-adce-28a7670c4d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:22.862566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026e219-9761-4842-adce-28a7670c4d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:22.864051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026e219-9761-4842-adce-28a7670c4d0a service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:22.873272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 667/1343] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:25.670424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ec922-8fa4-4a62-87ad-6e143c0f7d14 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:25.670938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ec922-8fa4-4a62-87ad-6e143c0f7d14 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:25.670938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ec922-8fa4-4a62-87ad-6e143c0f7d14 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:25.672268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 677/1344] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:25.677476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd0b5-72f3-4c17-86ba-d23f7c88cb7b None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:25.677911 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd0b5-72f3-4c17-86ba-d23f7c88cb7b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:25.678039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfd0b5-72f3-4c17-86ba-d23f7c88cb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:25.705012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-badfd0b5-72f3-4c17-86ba-d23f7c88cb7b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:25.706208 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-badfd0b5-72f3-4c17-86ba-d23f7c88cb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:25.782065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 668/1345] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:25.826054 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ec922-8fa4-4a62-87ad-6e143c0f7d14 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:25.827763 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-890ec922-8fa4-4a62-87ad-6e143c0f7d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:25.840909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ec922-8fa4-4a62-87ad-6e143c0f7d14 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:25.844346 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c210c4-6948-4e41-8be7-b223995edfab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:25.844981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c210c4-6948-4e41-8be7-b223995edfab service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:25.845261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c210c4-6948-4e41-8be7-b223995edfab service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:25.845532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c210c4-6948-4e41-8be7-b223995edfab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:25.854041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c210c4-6948-4e41-8be7-b223995edfab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:25.856080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c210c4-6948-4e41-8be7-b223995edfab service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:25.865112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 678/1346] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:40:30.325101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94944c-2587-4e77-ab11-fea317278675 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:30.325611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94944c-2587-4e77-ab11-fea317278675 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:30.325717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94944c-2587-4e77-ab11-fea317278675 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:30.327033 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 669/1347] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:30.332078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e289bb-5339-417b-b003-e22cb4e2a563 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:30.332535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e289bb-5339-417b-b003-e22cb4e2a563 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:30.332638 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e289bb-5339-417b-b003-e22cb4e2a563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:30.350434 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-87e289bb-5339-417b-b003-e22cb4e2a563 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:30.351650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-87e289bb-5339-417b-b003-e22cb4e2a563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:30.359945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 679/1348] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:30.396475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94944c-2587-4e77-ab11-fea317278675 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:30.407558 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94944c-2587-4e77-ab11-fea317278675 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:30.410974 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17309c3d-b8be-4962-b6b7-7e00fa61d014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:30.411639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17309c3d-b8be-4962-b6b7-7e00fa61d014 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:30.411925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17309c3d-b8be-4962-b6b7-7e00fa61d014 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:30.412199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17309c3d-b8be-4962-b6b7-7e00fa61d014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:30.421497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17309c3d-b8be-4962-b6b7-7e00fa61d014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:30.422922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17309c3d-b8be-4962-b6b7-7e00fa61d014 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:30.432037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 670/1349] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:35.781689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a899d6-8e9c-4eb7-a6aa-a9d78ccca1d1 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:35.781689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a899d6-8e9c-4eb7-a6aa-a9d78ccca1d1 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:35.781689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a899d6-8e9c-4eb7-a6aa-a9d78ccca1d1 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:35.787802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 680/1350] 10.222.0.73 () {54 vars in 921 bytes} [Wed May 4 13:40:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:35.802195 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d1863-dae2-4b36-bacb-1316020a5ec7 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:35.803081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d1863-dae2-4b36-bacb-1316020a5ec7 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:35.803610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d1863-dae2-4b36-bacb-1316020a5ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:35.884296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-de0d1863-dae2-4b36-bacb-1316020a5ec7 None None] MFA Rules not processed for user `735744b9ea1f429399b914f3e00d166f`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:35.886038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-de0d1863-dae2-4b36-bacb-1316020a5ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:35.967289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 671/1351] 10.222.0.73 () {58 vars in 1018 bytes} [Wed May 4 13:40:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:40.160899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc30935-2e0b-40d5-bebb-12eecab0752c None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:40.161447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc30935-2e0b-40d5-bebb-12eecab0752c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:40.161753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc30935-2e0b-40d5-bebb-12eecab0752c None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:40.163175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 681/1352] 10.222.0.73 () {54 vars in 921 bytes} [Wed May 4 13:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:40.168381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508f0f5-870d-459a-ba1d-8746e402bdbc None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:40.168830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508f0f5-870d-459a-ba1d-8746e402bdbc None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:40.168938 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508f0f5-870d-459a-ba1d-8746e402bdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:40.189068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-c508f0f5-870d-459a-ba1d-8746e402bdbc None None] MFA Rules not processed for user `735744b9ea1f429399b914f3e00d166f`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:40.190387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c508f0f5-870d-459a-ba1d-8746e402bdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:40.200995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 672/1353] 10.222.0.73 () {58 vars in 1018 bytes} [Wed May 4 13:40:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:41.886319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abbd06-5d5c-46ee-a57c-2260a347cccf None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:41.886875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abbd06-5d5c-46ee-a57c-2260a347cccf None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:41.886875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abbd06-5d5c-46ee-a57c-2260a347cccf None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:41.888243 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 682/1354] 10.222.0.73 () {54 vars in 921 bytes} [Wed May 4 13:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:41.893164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037e030-b567-4ff1-b13c-57705bf987b7 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:41.893609 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037e030-b567-4ff1-b13c-57705bf987b7 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:41.893720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037e030-b567-4ff1-b13c-57705bf987b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:41.911542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-0037e030-b567-4ff1-b13c-57705bf987b7 None None] MFA Rules not processed for user `735744b9ea1f429399b914f3e00d166f`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:41.912724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0037e030-b567-4ff1-b13c-57705bf987b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:41.921833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 673/1355] 10.222.0.73 () {58 vars in 1018 bytes} [Wed May 4 13:40:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:40:45.810571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1eaf7-0366-48e3-bcbd-1b5dd134f737 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.811109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1eaf7-0366-48e3-bcbd-1b5dd134f737 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.811109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1eaf7-0366-48e3-bcbd-1b5dd134f737 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.812756 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 683/1356] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:45.818063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eb730-ecae-4d51-a9d4-52c5addd5ed2 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.818476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eb730-ecae-4d51-a9d4-52c5addd5ed2 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.818669 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eb730-ecae-4d51-a9d4-52c5addd5ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.837181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-746eb730-ecae-4d51-a9d4-52c5addd5ed2 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:45.839229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-746eb730-ecae-4d51-a9d4-52c5addd5ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:45.847016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 674/1357] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:45.895516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2247c-9b64-4c0c-85f7-82e34e013704 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.895813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2247c-9b64-4c0c-85f7-82e34e013704 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.896095 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2247c-9b64-4c0c-85f7-82e34e013704 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.897989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 684/1358] 10.222.0.73 () {54 vars in 960 bytes} [Wed May 4 13:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:45.903602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe063196-5ac3-4d02-8bca-489232ff3a4e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:45.903964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe063196-5ac3-4d02-8bca-489232ff3a4e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:45.904320 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe063196-5ac3-4d02-8bca-489232ff3a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:45.953066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-fe063196-5ac3-4d02-8bca-489232ff3a4e None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:45.954313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-fe063196-5ac3-4d02-8bca-489232ff3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:46.032444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 675/1359] 10.222.0.73 () {58 vars in 1057 bytes} [Wed May 4 13:40:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:46.040549 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2247c-9b64-4c0c-85f7-82e34e013704 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:46.055376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2247c-9b64-4c0c-85f7-82e34e013704 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:46.061560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789207d5-0829-4e64-8748-78c91eda17b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:46.062336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789207d5-0829-4e64-8748-78c91eda17b1 service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:46.062696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789207d5-0829-4e64-8748-78c91eda17b1 service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:46.063046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789207d5-0829-4e64-8748-78c91eda17b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:46.071498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789207d5-0829-4e64-8748-78c91eda17b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:46.074063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789207d5-0829-4e64-8748-78c91eda17b1 service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:46.084602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 685/1360] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:48.557140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984a57d-b1f0-4ac1-99c4-1d5cad55ce5c None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:48.557671 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984a57d-b1f0-4ac1-99c4-1d5cad55ce5c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:48.557671 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984a57d-b1f0-4ac1-99c4-1d5cad55ce5c None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:48.559022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 676/1361] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:48.564294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdf790-4733-4e5f-8c17-b9a7f53e9b6a None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:48.564697 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdf790-4733-4e5f-8c17-b9a7f53e9b6a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:48.564842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdf790-4733-4e5f-8c17-b9a7f53e9b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:48.584071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-6cfdf790-4733-4e5f-8c17-b9a7f53e9b6a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:48.585388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6cfdf790-4733-4e5f-8c17-b9a7f53e9b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:48.596207 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 686/1362] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:48.640370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984a57d-b1f0-4ac1-99c4-1d5cad55ce5c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:48.654741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984a57d-b1f0-4ac1-99c4-1d5cad55ce5c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:48.660164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0aff0-ec14-4e0c-bf42-6f6177929357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:48.660784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0aff0-ec14-4e0c-bf42-6f6177929357 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:48.661065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0aff0-ec14-4e0c-bf42-6f6177929357 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:48.661336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0aff0-ec14-4e0c-bf42-6f6177929357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:48.669294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0aff0-ec14-4e0c-bf42-6f6177929357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:48.670864 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0aff0-ec14-4e0c-bf42-6f6177929357 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:48.680668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 677/1363] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:51.237547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e801b8-17f6-40bc-98df-8a8ca1bad2c1 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:51.238599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e801b8-17f6-40bc-98df-8a8ca1bad2c1 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:51.239101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e801b8-17f6-40bc-98df-8a8ca1bad2c1 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:51.241007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 687/1364] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:51.246575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b03fe-e0dc-48de-9139-edc8d1069741 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:51.247430 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b03fe-e0dc-48de-9139-edc8d1069741 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:51.247781 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b03fe-e0dc-48de-9139-edc8d1069741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:51.265456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-9d4b03fe-e0dc-48de-9139-edc8d1069741 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:51.266529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9d4b03fe-e0dc-48de-9139-edc8d1069741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:51.287963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 678/1365] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:51.322445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4251771-eda0-4737-9c36-eac8895aee88 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:51.322779 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4251771-eda0-4737-9c36-eac8895aee88 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:51.323056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4251771-eda0-4737-9c36-eac8895aee88 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:51.324595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 688/1366] 10.222.0.73 () {54 vars in 960 bytes} [Wed May 4 13:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:51.329905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e326c-bdae-4409-8332-af08f38f332a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:51.330195 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e326c-bdae-4409-8332-af08f38f332a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:51.330479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e326c-bdae-4409-8332-af08f38f332a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:51.348572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f28e326c-bdae-4409-8332-af08f38f332a None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:51.349737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f28e326c-bdae-4409-8332-af08f38f332a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:51.359390 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 679/1367] 10.222.0.73 () {58 vars in 1057 bytes} [Wed May 4 13:40:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:40:51.366973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4251771-eda0-4737-9c36-eac8895aee88 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:51.380885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4251771-eda0-4737-9c36-eac8895aee88 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:51.386322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fa6f8-b7ce-4d71-b418-da0e3f4cce4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:51.386950 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fa6f8-b7ce-4d71-b418-da0e3f4cce4d service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:51.387272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fa6f8-b7ce-4d71-b418-da0e3f4cce4d service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:51.387553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fa6f8-b7ce-4d71-b418-da0e3f4cce4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:51.395510 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075fa6f8-b7ce-4d71-b418-da0e3f4cce4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:51.397052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075fa6f8-b7ce-4d71-b418-da0e3f4cce4d service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:51.406614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 689/1368] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:53.751990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2209d5-6e51-4266-8199-e3921b539127 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:53.752578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2209d5-6e51-4266-8199-e3921b539127 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:53.752817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2209d5-6e51-4266-8199-e3921b539127 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:53.754434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 680/1369] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:53.759823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6658f8b-e71a-40a0-b15d-7fb8427b8c75 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:53.760274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6658f8b-e71a-40a0-b15d-7fb8427b8c75 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:53.760608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6658f8b-e71a-40a0-b15d-7fb8427b8c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:53.778867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a6658f8b-e71a-40a0-b15d-7fb8427b8c75 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:53.780318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a6658f8b-e71a-40a0-b15d-7fb8427b8c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:53.793701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 690/1370] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:53.838780 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2209d5-6e51-4266-8199-e3921b539127 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:53.853406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2209d5-6e51-4266-8199-e3921b539127 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:53.859514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a032e-ae76-4f68-9d5f-d0db95802aa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:53.860161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a032e-ae76-4f68-9d5f-d0db95802aa2 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:53.860440 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a032e-ae76-4f68-9d5f-d0db95802aa2 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:53.860713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a032e-ae76-4f68-9d5f-d0db95802aa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:53.870254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a032e-ae76-4f68-9d5f-d0db95802aa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:53.871854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a032e-ae76-4f68-9d5f-d0db95802aa2 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:53.881566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 681/1371] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:54.017964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b63e0b-faa8-4cfb-9df9-22296d0d5d55 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.018155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b63e0b-faa8-4cfb-9df9-22296d0d5d55 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.018434 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b63e0b-faa8-4cfb-9df9-22296d0d5d55 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.019977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 691/1372] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:54.025360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48c208-1060-4dc7-97ba-9b95142712f7 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.025725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48c208-1060-4dc7-97ba-9b95142712f7 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.026004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48c208-1060-4dc7-97ba-9b95142712f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.046071 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-bf48c208-1060-4dc7-97ba-9b95142712f7 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:54.047342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bf48c208-1060-4dc7-97ba-9b95142712f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:54.055899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 682/1373] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:54.381454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9c51c-722e-4f36-afc9-587832954443 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.381740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9c51c-722e-4f36-afc9-587832954443 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.382012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9c51c-722e-4f36-afc9-587832954443 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.383641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 692/1374] 10.222.0.73 () {54 vars in 963 bytes} [Wed May 4 13:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:54.388459 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f4862-8330-4573-b714-a8a776b8a2ec None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.388741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f4862-8330-4573-b714-a8a776b8a2ec None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.389011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f4862-8330-4573-b714-a8a776b8a2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.436851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-eb5f4862-8330-4573-b714-a8a776b8a2ec None None] MFA Rules not processed for user `962dca9381254a08b18ea171183190d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:54.438007 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-eb5f4862-8330-4573-b714-a8a776b8a2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:54.496100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 683/1375] 10.222.0.73 () {58 vars in 1060 bytes} [Wed May 4 13:40:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:40:54.504201 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9c51c-722e-4f36-afc9-587832954443 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:54.515650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9c51c-722e-4f36-afc9-587832954443 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:54.519352 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573db984-b6eb-485f-877d-b0e467758719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:54.520081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573db984-b6eb-485f-877d-b0e467758719 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:54.520433 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573db984-b6eb-485f-877d-b0e467758719 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:54.520781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573db984-b6eb-485f-877d-b0e467758719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:54.530628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573db984-b6eb-485f-877d-b0e467758719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:54.532288 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573db984-b6eb-485f-877d-b0e467758719 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:54.541834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 693/1376] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:40:56.184081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884346c-b832-4a8b-820a-f60ed6f58585 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:56.184615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884346c-b832-4a8b-820a-f60ed6f58585 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:56.184710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884346c-b832-4a8b-820a-f60ed6f58585 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:56.186142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 684/1377] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:56.192070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74cccb-7809-433c-b51a-69ce789b9309 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:56.192628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74cccb-7809-433c-b51a-69ce789b9309 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:56.192628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74cccb-7809-433c-b51a-69ce789b9309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:56.211408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-8b74cccb-7809-433c-b51a-69ce789b9309 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:56.212635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-8b74cccb-7809-433c-b51a-69ce789b9309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:56.221202 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 694/1378] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:56.265347 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884346c-b832-4a8b-820a-f60ed6f58585 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:56.280750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884346c-b832-4a8b-820a-f60ed6f58585 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:56.286383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291f06d-41a8-43eb-9e10-7278ec79ed15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:56.287169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f06d-41a8-43eb-9e10-7278ec79ed15 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:56.287483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f06d-41a8-43eb-9e10-7278ec79ed15 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:56.287761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f06d-41a8-43eb-9e10-7278ec79ed15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:56.297446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291f06d-41a8-43eb-9e10-7278ec79ed15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:56.299044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291f06d-41a8-43eb-9e10-7278ec79ed15 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:56.310160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 685/1379] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:40:58.591940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b302e69-eff8-4479-a8d5-c76725e723c0 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:58.592459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b302e69-eff8-4479-a8d5-c76725e723c0 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:58.592459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b302e69-eff8-4479-a8d5-c76725e723c0 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:58.593769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 695/1380] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:40:58.598898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a34ad9-dcc7-4570-923a-363fab7d6c0a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:58.599363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a34ad9-dcc7-4570-923a-363fab7d6c0a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:58.599479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a34ad9-dcc7-4570-923a-363fab7d6c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:58.617946 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-44a34ad9-dcc7-4570-923a-363fab7d6c0a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:40:58.619684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-44a34ad9-dcc7-4570-923a-363fab7d6c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:40:58.627915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 686/1381] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:40:58.672180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b302e69-eff8-4479-a8d5-c76725e723c0 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:40:58.687080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b302e69-eff8-4479-a8d5-c76725e723c0 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:40:58.696853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9337655-b0d3-46ec-a5ad-fbf23f2abf97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:40:58.698342 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9337655-b0d3-46ec-a5ad-fbf23f2abf97 service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:40:58.698630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9337655-b0d3-46ec-a5ad-fbf23f2abf97 service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:40:58.698908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9337655-b0d3-46ec-a5ad-fbf23f2abf97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:40:58.709728 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9337655-b0d3-46ec-a5ad-fbf23f2abf97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:40:58.711332 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9337655-b0d3-46ec-a5ad-fbf23f2abf97 service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:40:58.721063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 696/1382] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:00.990169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77184c46-1c7b-454e-9c7d-acb8d5a5427d None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:00.990760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77184c46-1c7b-454e-9c7d-acb8d5a5427d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:00.990760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77184c46-1c7b-454e-9c7d-acb8d5a5427d None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:00.992125 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 687/1383] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:00.997309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00a95a-b6ed-4494-a15f-49a867e8dcc1 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:00.997755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00a95a-b6ed-4494-a15f-49a867e8dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:00.997870 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00a95a-b6ed-4494-a15f-49a867e8dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:01.015988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ef00a95a-b6ed-4494-a15f-49a867e8dcc1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:01.017352 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ef00a95a-b6ed-4494-a15f-49a867e8dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:01.026356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 697/1384] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:01.068475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77184c46-1c7b-454e-9c7d-acb8d5a5427d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:01.083721 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77184c46-1c7b-454e-9c7d-acb8d5a5427d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:01.089861 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823ce20-0488-47d3-87bb-9ca3dd9b3a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:01.090498 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ce20-0488-47d3-87bb-9ca3dd9b3a1a service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:01.090782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ce20-0488-47d3-87bb-9ca3dd9b3a1a service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:01.091056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823ce20-0488-47d3-87bb-9ca3dd9b3a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:01.099399 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823ce20-0488-47d3-87bb-9ca3dd9b3a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:01.100972 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823ce20-0488-47d3-87bb-9ca3dd9b3a1a service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:01.111466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 688/1385] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:03.623639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb4ce6-b685-4dc0-a241-bcf20fd0e469 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:03.624203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb4ce6-b685-4dc0-a241-bcf20fd0e469 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:03.624203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb4ce6-b685-4dc0-a241-bcf20fd0e469 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:03.625464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 698/1386] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:03.631339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e353a1-942c-40ee-a619-2f289243d0e5 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:03.631995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e353a1-942c-40ee-a619-2f289243d0e5 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:03.631995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e353a1-942c-40ee-a619-2f289243d0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:03.652345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-98e353a1-942c-40ee-a619-2f289243d0e5 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:03.656710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-98e353a1-942c-40ee-a619-2f289243d0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:03.667027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 689/1387] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:41:03.713978 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb4ce6-b685-4dc0-a241-bcf20fd0e469 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:03.728210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb4ce6-b685-4dc0-a241-bcf20fd0e469 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:03.733683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755dc42-210c-4ea7-a6be-ed869f0ab78e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:03.734325 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755dc42-210c-4ea7-a6be-ed869f0ab78e service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:03.734621 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755dc42-210c-4ea7-a6be-ed869f0ab78e service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:03.734890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755dc42-210c-4ea7-a6be-ed869f0ab78e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:03.743139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755dc42-210c-4ea7-a6be-ed869f0ab78e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:03.744826 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755dc42-210c-4ea7-a6be-ed869f0ab78e service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:03.754229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 699/1388] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:06.256410 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0ba2d-f6e6-4c7b-9750-bbabf48098e4 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:06.256968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0ba2d-f6e6-4c7b-9750-bbabf48098e4 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:06.257100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0ba2d-f6e6-4c7b-9750-bbabf48098e4 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:06.258902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 690/1389] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:06.264597 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85468e24-8c77-4911-a841-39f22e332f6d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:06.265189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85468e24-8c77-4911-a841-39f22e332f6d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:06.265189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85468e24-8c77-4911-a841-39f22e332f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:06.284025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-85468e24-8c77-4911-a841-39f22e332f6d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:06.285306 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-85468e24-8c77-4911-a841-39f22e332f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:06.294103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 700/1390] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:06.346865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0ba2d-f6e6-4c7b-9750-bbabf48098e4 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:06.363656 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0ba2d-f6e6-4c7b-9750-bbabf48098e4 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:06.369376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d020c-ada6-4be7-ba4f-1f352117eb05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:06.370021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d020c-ada6-4be7-ba4f-1f352117eb05 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:06.370305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d020c-ada6-4be7-ba4f-1f352117eb05 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:06.370582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d020c-ada6-4be7-ba4f-1f352117eb05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:06.379174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d020c-ada6-4be7-ba4f-1f352117eb05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:06.380783 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d020c-ada6-4be7-ba4f-1f352117eb05 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:06.390466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 691/1391] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:08.860285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10486a4-09ef-4c93-b25a-2a27b53da915 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.860909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10486a4-09ef-4c93-b25a-2a27b53da915 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.860909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10486a4-09ef-4c93-b25a-2a27b53da915 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.862193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 701/1392] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:08.867292 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdbf16-ddd5-4922-ad92-d0ea8a8820af None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.867713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdbf16-ddd5-4922-ad92-d0ea8a8820af None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.867830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdbf16-ddd5-4922-ad92-d0ea8a8820af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.885560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-79fdbf16-ddd5-4922-ad92-d0ea8a8820af None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:08.886731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-79fdbf16-ddd5-4922-ad92-d0ea8a8820af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:08.894560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 692/1393] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:08.937548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10486a4-09ef-4c93-b25a-2a27b53da915 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:08.951795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10486a4-09ef-4c93-b25a-2a27b53da915 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:08.957064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a70aa-e6be-4996-a3cb-3694947d0dc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:08.957693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a70aa-e6be-4996-a3cb-3694947d0dc1 service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:08.957970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a70aa-e6be-4996-a3cb-3694947d0dc1 service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:08.958243 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a70aa-e6be-4996-a3cb-3694947d0dc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:08.966270 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a70aa-e6be-4996-a3cb-3694947d0dc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:08.967859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a70aa-e6be-4996-a3cb-3694947d0dc1 service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:08.977067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 702/1394] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:10.224495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329a43-7604-4cda-b078-677ce39f2dec None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:10.225072 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329a43-7604-4cda-b078-677ce39f2dec None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:10.225072 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05329a43-7604-4cda-b078-677ce39f2dec None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:10.226583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 693/1395] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:10.232280 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418b1c-8072-403a-a5eb-ee5df82e80af None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:10.232750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418b1c-8072-403a-a5eb-ee5df82e80af None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:10.232859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16418b1c-8072-403a-a5eb-ee5df82e80af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:10.251479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-16418b1c-8072-403a-a5eb-ee5df82e80af None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:10.252718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-16418b1c-8072-403a-a5eb-ee5df82e80af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:10.260835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 703/1396] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:10.316470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4147fa-154c-4d07-86d1-bcf8acb3c514 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:10.316760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4147fa-154c-4d07-86d1-bcf8acb3c514 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:10.317064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4147fa-154c-4d07-86d1-bcf8acb3c514 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:10.318434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 694/1397] 10.222.0.73 () {54 vars in 962 bytes} [Wed May 4 13:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:10.323678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f12fa-f2a6-456a-97f1-64919cfa945e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:10.324043 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f12fa-f2a6-456a-97f1-64919cfa945e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:10.324387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f12fa-f2a6-456a-97f1-64919cfa945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:10.371864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-259f12fa-f2a6-456a-97f1-64919cfa945e None None] MFA Rules not processed for user `bbf2b88cc78d4defa7cefb7bf0ae6144`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:10.373047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-259f12fa-f2a6-456a-97f1-64919cfa945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:10.430391 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 704/1398] 10.222.0.73 () {58 vars in 1059 bytes} [Wed May 4 13:41:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:10.438468 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4147fa-154c-4d07-86d1-bcf8acb3c514 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:10.449088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4147fa-154c-4d07-86d1-bcf8acb3c514 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:10.452534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94554b45-4ddc-4714-96b6-8e89fe23b902 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf2b88cc78d4defa7cefb7bf0ae6144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:10.453378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94554b45-4ddc-4714-96b6-8e89fe23b902 service glance] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:10.453659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94554b45-4ddc-4714-96b6-8e89fe23b902 service glance] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:10.453934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94554b45-4ddc-4714-96b6-8e89fe23b902 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:10.462665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94554b45-4ddc-4714-96b6-8e89fe23b902 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:10.464121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94554b45-4ddc-4714-96b6-8e89fe23b902 service glance] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:10.473311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 695/1399] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:41:10.901145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24b73b-dcce-41a6-a3a8-2306d8acf96e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:10.901513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24b73b-dcce-41a6-a3a8-2306d8acf96e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:10.901864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24b73b-dcce-41a6-a3a8-2306d8acf96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:10.949406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-1d24b73b-dcce-41a6-a3a8-2306d8acf96e None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:10.950605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1d24b73b-dcce-41a6-a3a8-2306d8acf96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:11.013015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 705/1400] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:41:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:11.054698 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da47de2-7a20-48d6-980f-64aab41bb2e6 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.054983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da47de2-7a20-48d6-980f-64aab41bb2e6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.055296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da47de2-7a20-48d6-980f-64aab41bb2e6 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.056736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 696/1401] 10.222.0.73 () {54 vars in 942 bytes} [Wed May 4 13:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:11.064066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc2dd9-10b1-43c5-9ee4-12882cae342a None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.064386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc2dd9-10b1-43c5-9ee4-12882cae342a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.064666 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc2dd9-10b1-43c5-9ee4-12882cae342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.114543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-3fdc2dd9-10b1-43c5-9ee4-12882cae342a None None] MFA Rules not processed for user `773a01334f8a41d4bf94c5aa205d70ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:11.115668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3fdc2dd9-10b1-43c5-9ee4-12882cae342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:11.187630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 706/1402] 10.222.0.73 () {58 vars in 1039 bytes} [Wed May 4 13:41:11 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:11.197828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da47de2-7a20-48d6-980f-64aab41bb2e6 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:11.211029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da47de2-7a20-48d6-980f-64aab41bb2e6 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:11.216646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe027e7-1ccf-4408-9bc5-696fcff11e5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:11.217280 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe027e7-1ccf-4408-9bc5-696fcff11e5a service swift] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.217591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe027e7-1ccf-4408-9bc5-696fcff11e5a service swift] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.218086 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe027e7-1ccf-4408-9bc5-696fcff11e5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.226047 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe027e7-1ccf-4408-9bc5-696fcff11e5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:11.227672 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe027e7-1ccf-4408-9bc5-696fcff11e5a service swift] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:11.235488 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 697/1403] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:41:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:41:11.244073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cee490-97ca-4a9a-9c80-2ef3688a1478 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.244543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cee490-97ca-4a9a-9c80-2ef3688a1478 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.244751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cee490-97ca-4a9a-9c80-2ef3688a1478 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.245973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 707/1404] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:41:11.251020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b6ea1-8a26-4c1e-a5e1-33703a849a4a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.251343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b6ea1-8a26-4c1e-a5e1-33703a849a4a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.251644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b6ea1-8a26-4c1e-a5e1-33703a849a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.271606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-ac3b6ea1-8a26-4c1e-a5e1-33703a849a4a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:11.272806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ac3b6ea1-8a26-4c1e-a5e1-33703a849a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:11.281288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 698/1405] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:11.326050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cee490-97ca-4a9a-9c80-2ef3688a1478 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:11.351152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cee490-97ca-4a9a-9c80-2ef3688a1478 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:11.357706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c5dc8-e927-4af0-aba0-a922d620b83a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:11.358353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c5dc8-e927-4af0-aba0-a922d620b83a service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:11.358634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c5dc8-e927-4af0-aba0-a922d620b83a service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:11.358909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c5dc8-e927-4af0-aba0-a922d620b83a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:11.367877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c5dc8-e927-4af0-aba0-a922d620b83a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:11.369929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c5dc8-e927-4af0-aba0-a922d620b83a service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:11.379938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 708/1406] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:13.708612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e980a-c09f-4867-857a-7dfd31ad3201 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:13.709159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e980a-c09f-4867-857a-7dfd31ad3201 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:13.709159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e980a-c09f-4867-857a-7dfd31ad3201 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:13.710532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 699/1407] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:13.715776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8e8d7-fe75-46a9-949f-886877a14d52 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:13.716204 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8e8d7-fe75-46a9-949f-886877a14d52 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:13.716363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8e8d7-fe75-46a9-949f-886877a14d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:13.734963 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-98e8e8d7-fe75-46a9-949f-886877a14d52 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:13.736756 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-98e8e8d7-fe75-46a9-949f-886877a14d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:13.748777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 709/1408] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:41:13.792788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e980a-c09f-4867-857a-7dfd31ad3201 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:13.809720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e980a-c09f-4867-857a-7dfd31ad3201 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:13.815006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfd33e-fca4-4666-b63c-9396f7174bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:13.815746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfd33e-fca4-4666-b63c-9396f7174bc1 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:13.816090 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfd33e-fca4-4666-b63c-9396f7174bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:13.816441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfd33e-fca4-4666-b63c-9396f7174bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:13.825742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfd33e-fca4-4666-b63c-9396f7174bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:13.827430 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfd33e-fca4-4666-b63c-9396f7174bc1 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:13.836928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 700/1409] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:34.637451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98dff6-de46-405e-902e-ec82e34b40f2 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:34.638053 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98dff6-de46-405e-902e-ec82e34b40f2 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:34.638053 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98dff6-de46-405e-902e-ec82e34b40f2 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:34.639693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 710/1410] 10.222.0.73 () {54 vars in 918 bytes} [Wed May 4 13:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:34.644720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536619-b3be-425e-99f8-1d0bce59d44b None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:34.645183 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536619-b3be-425e-99f8-1d0bce59d44b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:34.645288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50536619-b3be-425e-99f8-1d0bce59d44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:34.662822 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-50536619-b3be-425e-99f8-1d0bce59d44b None None] MFA Rules not processed for user `735744b9ea1f429399b914f3e00d166f`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:34.664035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-50536619-b3be-425e-99f8-1d0bce59d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:34.672818 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 701/1411] 10.222.0.73 () {58 vars in 1015 bytes} [Wed May 4 13:41:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:34.686532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb39c5f-321a-4e99-bad1-8c70187f9969 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:34.686825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb39c5f-321a-4e99-bad1-8c70187f9969 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:34.687105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb39c5f-321a-4e99-bad1-8c70187f9969 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:34.688461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 711/1412] 10.222.0.73 () {54 vars in 918 bytes} [Wed May 4 13:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:34.692977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4769-e8f9-4313-98ae-eadd3f2cd97e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:34.693267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4769-e8f9-4313-98ae-eadd3f2cd97e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:34.693548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4769-e8f9-4313-98ae-eadd3f2cd97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:34.710994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-4d5e4769-e8f9-4313-98ae-eadd3f2cd97e None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:34.712702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4d5e4769-e8f9-4313-98ae-eadd3f2cd97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:34.721610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 702/1413] 10.222.0.73 () {58 vars in 1015 bytes} [Wed May 4 13:41:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:37.414487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eb719-496c-4d8b-8c89-4d5b13d583a1 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:37.415605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eb719-496c-4d8b-8c89-4d5b13d583a1 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:37.415605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eb719-496c-4d8b-8c89-4d5b13d583a1 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:37.416825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:37.421994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187c81b-0c20-42b8-86e9-539d3f4033b5 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:37.422447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187c81b-0c20-42b8-86e9-539d3f4033b5 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:37.422560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187c81b-0c20-42b8-86e9-539d3f4033b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:37.440445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6187c81b-0c20-42b8-86e9-539d3f4033b5 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:37.441611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6187c81b-0c20-42b8-86e9-539d3f4033b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:37.449425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:37.490015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3eb719-496c-4d8b-8c89-4d5b13d583a1 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:37.504558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3eb719-496c-4d8b-8c89-4d5b13d583a1 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:37.509869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a4150-8fe1-44f9-8ab6-54ae89ff1faa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:37.510501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a4150-8fe1-44f9-8ab6-54ae89ff1faa service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:37.510788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a4150-8fe1-44f9-8ab6-54ae89ff1faa service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:37.511063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a4150-8fe1-44f9-8ab6-54ae89ff1faa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:37.518969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a4150-8fe1-44f9-8ab6-54ae89ff1faa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:37.520579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a4150-8fe1-44f9-8ab6-54ae89ff1faa service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:37.529689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 713/1416] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:38.819336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3e47-4445-4607-9cd2-dcaab2e6ea81 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:38.819893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3e47-4445-4607-9cd2-dcaab2e6ea81 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:38.819893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b3e47-4445-4607-9cd2-dcaab2e6ea81 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:38.821614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:38.826676 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6368df-6319-442e-b154-687a197a0cfd None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:38.827114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6368df-6319-442e-b154-687a197a0cfd None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:38.827249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6368df-6319-442e-b154-687a197a0cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:38.844666 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-fa6368df-6319-442e-b154-687a197a0cfd None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:38.845828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fa6368df-6319-442e-b154-687a197a0cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:38.853946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:39.017115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b3e47-4445-4607-9cd2-dcaab2e6ea81 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:39.030939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b3e47-4445-4607-9cd2-dcaab2e6ea81 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:39.036316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a95c4-8491-4d38-931d-8fd34df44567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:39.036942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a95c4-8491-4d38-931d-8fd34df44567 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:39.037224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a95c4-8491-4d38-931d-8fd34df44567 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:39.037501 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a95c4-8491-4d38-931d-8fd34df44567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:39.046152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a95c4-8491-4d38-931d-8fd34df44567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:39.047782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a95c4-8491-4d38-931d-8fd34df44567 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:39.057329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 705/1419] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:40.319913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63d841-0d2a-4c4a-b76d-3f684d524107 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:40.320405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63d841-0d2a-4c4a-b76d-3f684d524107 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:40.320767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63d841-0d2a-4c4a-b76d-3f684d524107 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:40.322103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:40.326897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1654d9-2f82-4e94-b105-8bdd59560dfe None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:40.327361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1654d9-2f82-4e94-b105-8bdd59560dfe None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:40.327475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1654d9-2f82-4e94-b105-8bdd59560dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:40.344640 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-8b1654d9-2f82-4e94-b105-8bdd59560dfe None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:40.345804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8b1654d9-2f82-4e94-b105-8bdd59560dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:40.353906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:40.500578 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63d841-0d2a-4c4a-b76d-3f684d524107 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:40.515171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63d841-0d2a-4c4a-b76d-3f684d524107 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:40.520497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e1c29-3294-4b9c-9b59-3cb4291350b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:40.521123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e1c29-3294-4b9c-9b59-3cb4291350b7 service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:40.521402 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e1c29-3294-4b9c-9b59-3cb4291350b7 service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:40.521675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e1c29-3294-4b9c-9b59-3cb4291350b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:40.530140 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e1c29-3294-4b9c-9b59-3cb4291350b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:40.531731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e1c29-3294-4b9c-9b59-3cb4291350b7 service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:40.540771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 716/1422] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:41.767093 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df4b2-9c02-4a7b-8469-c18c028c6778 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.767680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df4b2-9c02-4a7b-8469-c18c028c6778 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.767680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8df4b2-9c02-4a7b-8469-c18c028c6778 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.769104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:41.773934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856053-a400-4816-8199-31ba650390e0 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.774388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856053-a400-4816-8199-31ba650390e0 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.774621 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856053-a400-4816-8199-31ba650390e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.792692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ea856053-a400-4816-8199-31ba650390e0 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:41.793881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ea856053-a400-4816-8199-31ba650390e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:41.801483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:41:41.950290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8df4b2-9c02-4a7b-8469-c18c028c6778 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:41.965010 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8df4b2-9c02-4a7b-8469-c18c028c6778 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:41.970255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919736a-a1b9-4855-bf6f-4021b431ec63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:41.970903 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919736a-a1b9-4855-bf6f-4021b431ec63 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:41.971180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919736a-a1b9-4855-bf6f-4021b431ec63 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:41.971480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919736a-a1b9-4855-bf6f-4021b431ec63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:41.979329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919736a-a1b9-4855-bf6f-4021b431ec63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:41.980988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919736a-a1b9-4855-bf6f-4021b431ec63 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:41.990222 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 708/1425] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:43.215399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59073dc-f033-42fe-9557-0785445c49f4 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:43.215970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59073dc-f033-42fe-9557-0785445c49f4 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:43.215970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59073dc-f033-42fe-9557-0785445c49f4 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:43.217337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:43.222042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2581d-e1ba-4ff2-be5f-d34076efb0f6 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:43.222453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2581d-e1ba-4ff2-be5f-d34076efb0f6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:43.222599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2581d-e1ba-4ff2-be5f-d34076efb0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:43.241354 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-c1f2581d-e1ba-4ff2-be5f-d34076efb0f6 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:43.242528 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c1f2581d-e1ba-4ff2-be5f-d34076efb0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:43.250179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:41:43.402951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59073dc-f033-42fe-9557-0785445c49f4 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:43.416926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59073dc-f033-42fe-9557-0785445c49f4 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:43.422236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfeff98-3cfc-4e60-bd98-f2562501234c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:43.422865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfeff98-3cfc-4e60-bd98-f2562501234c service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:43.423150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfeff98-3cfc-4e60-bd98-f2562501234c service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:43.423455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfeff98-3cfc-4e60-bd98-f2562501234c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:43.431407 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfeff98-3cfc-4e60-bd98-f2562501234c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:43.432970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfeff98-3cfc-4e60-bd98-f2562501234c service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:43.442051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 719/1428] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:44.626554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aed3c-ccad-45b3-ae4e-9fc5929bdfb1 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.627081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aed3c-ccad-45b3-ae4e-9fc5929bdfb1 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.627081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aed3c-ccad-45b3-ae4e-9fc5929bdfb1 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.628461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:44.633829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dedc9-7a92-43f1-a469-0b4682651d32 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.634306 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dedc9-7a92-43f1-a469-0b4682651d32 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.634414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3dedc9-7a92-43f1-a469-0b4682651d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.651669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ce3dedc9-7a92-43f1-a469-0b4682651d32 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:44.652835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ce3dedc9-7a92-43f1-a469-0b4682651d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:44.660312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:44.811293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443aed3c-ccad-45b3-ae4e-9fc5929bdfb1 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:44.825322 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443aed3c-ccad-45b3-ae4e-9fc5929bdfb1 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:44.830845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934078d-9051-4f46-af7a-9bde57b9526e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:44.831513 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934078d-9051-4f46-af7a-9bde57b9526e service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:44.831794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934078d-9051-4f46-af7a-9bde57b9526e service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:44.832067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934078d-9051-4f46-af7a-9bde57b9526e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:44.840077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934078d-9051-4f46-af7a-9bde57b9526e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:44.841644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934078d-9051-4f46-af7a-9bde57b9526e service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:44.850732 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 711/1431] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:46.034019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058e2dd-ae14-4788-ba00-122512d6486c None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:46.034615 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058e2dd-ae14-4788-ba00-122512d6486c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:46.034615 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058e2dd-ae14-4788-ba00-122512d6486c None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:46.035946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:46.040928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdb210-3d4d-4e2d-b12a-d199b06f4149 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:46.041374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdb210-3d4d-4e2d-b12a-d199b06f4149 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:46.041473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdb210-3d4d-4e2d-b12a-d199b06f4149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:46.059227 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-75fdb210-3d4d-4e2d-b12a-d199b06f4149 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:46.060418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-75fdb210-3d4d-4e2d-b12a-d199b06f4149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:46.068131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:46.219976 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058e2dd-ae14-4788-ba00-122512d6486c None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:46.234643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058e2dd-ae14-4788-ba00-122512d6486c None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:46.239933 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd718200-a682-455f-8f8b-27faf5e0cd9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:46.240557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd718200-a682-455f-8f8b-27faf5e0cd9e service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:46.240861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd718200-a682-455f-8f8b-27faf5e0cd9e service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:46.241131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd718200-a682-455f-8f8b-27faf5e0cd9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:46.249431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd718200-a682-455f-8f8b-27faf5e0cd9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:46.250980 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd718200-a682-455f-8f8b-27faf5e0cd9e service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:46.259959 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 722/1434] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:47.446885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819e077-5efc-4b33-bea8-a9019b9dce64 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:47.447477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819e077-5efc-4b33-bea8-a9019b9dce64 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:47.447477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819e077-5efc-4b33-bea8-a9019b9dce64 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:47.448738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:47.453775 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c0e96-af43-4218-908c-504af1add47a None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:47.454205 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c0e96-af43-4218-908c-504af1add47a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:47.454330 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c0e96-af43-4218-908c-504af1add47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:47.471772 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-4b6c0e96-af43-4218-908c-504af1add47a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:47.472948 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4b6c0e96-af43-4218-908c-504af1add47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:47.480814 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:47.627764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819e077-5efc-4b33-bea8-a9019b9dce64 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:47.642890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819e077-5efc-4b33-bea8-a9019b9dce64 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:47.648218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4fc0b-65f0-4b60-87ba-4ea53df024ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:47.648851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4fc0b-65f0-4b60-87ba-4ea53df024ca service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:47.649689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4fc0b-65f0-4b60-87ba-4ea53df024ca service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:47.649689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4fc0b-65f0-4b60-87ba-4ea53df024ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:47.657484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4fc0b-65f0-4b60-87ba-4ea53df024ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:47.659049 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4fc0b-65f0-4b60-87ba-4ea53df024ca service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:47.668193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 714/1437] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:48.860586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d00f85-0c0e-409b-880f-eb84bac0ed0d None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.861158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d00f85-0c0e-409b-880f-eb84bac0ed0d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.861158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d00f85-0c0e-409b-880f-eb84bac0ed0d None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.862538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:48.867888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed30274-dfd9-46d2-94f2-1d5628a61ac3 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:48.868302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed30274-dfd9-46d2-94f2-1d5628a61ac3 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:48.868427 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed30274-dfd9-46d2-94f2-1d5628a61ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:48.886144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-1ed30274-dfd9-46d2-94f2-1d5628a61ac3 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:48.887338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1ed30274-dfd9-46d2-94f2-1d5628a61ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:48.894766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:49.042102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d00f85-0c0e-409b-880f-eb84bac0ed0d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:49.056495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d00f85-0c0e-409b-880f-eb84bac0ed0d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:49.061739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7211f01-e76e-424a-afad-04c0a636a54f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:49.062373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7211f01-e76e-424a-afad-04c0a636a54f service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:49.062659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7211f01-e76e-424a-afad-04c0a636a54f service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:49.062935 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7211f01-e76e-424a-afad-04c0a636a54f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:49.071657 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7211f01-e76e-424a-afad-04c0a636a54f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:49.073235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7211f01-e76e-424a-afad-04c0a636a54f service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:49.082311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 725/1440] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:51.223518 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b548e18-18c8-4715-8812-f8ac3d9cfb43 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.223952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b548e18-18c8-4715-8812-f8ac3d9cfb43 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.224064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b548e18-18c8-4715-8812-f8ac3d9cfb43 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.225430 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:51.230730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c83e9-43fe-4487-8418-f6defe3b8314 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.231149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c83e9-43fe-4487-8418-f6defe3b8314 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.231316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c83e9-43fe-4487-8418-f6defe3b8314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.249971 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-1e8c83e9-43fe-4487-8418-f6defe3b8314 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:51.251169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1e8c83e9-43fe-4487-8418-f6defe3b8314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:51.259533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:41:51.296633 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b548e18-18c8-4715-8812-f8ac3d9cfb43 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:51.307386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b548e18-18c8-4715-8812-f8ac3d9cfb43 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:51.310786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b28ca3-7777-48b6-9601-baaf6e9b9700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:51.311435 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b28ca3-7777-48b6-9601-baaf6e9b9700 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:51.311720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b28ca3-7777-48b6-9601-baaf6e9b9700 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:51.311992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b28ca3-7777-48b6-9601-baaf6e9b9700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:51.321522 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b28ca3-7777-48b6-9601-baaf6e9b9700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:51.323336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b28ca3-7777-48b6-9601-baaf6e9b9700 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:51.334826 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 717/1443] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:53.744646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812e001-e434-4271-91a0-e166d7e8c6ed None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:53.745222 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812e001-e434-4271-91a0-e166d7e8c6ed None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:53.745222 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812e001-e434-4271-91a0-e166d7e8c6ed None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:53.746534 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:53.751759 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725c096-a834-4e27-afa2-f4d8a2bc5aae None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:53.752193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725c096-a834-4e27-afa2-f4d8a2bc5aae None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:53.752303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725c096-a834-4e27-afa2-f4d8a2bc5aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:53.769502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-3725c096-a834-4e27-afa2-f4d8a2bc5aae None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:53.770681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3725c096-a834-4e27-afa2-f4d8a2bc5aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:53.778282 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:53.815926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812e001-e434-4271-91a0-e166d7e8c6ed None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:53.826608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812e001-e434-4271-91a0-e166d7e8c6ed None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:53.830066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ec3ff-d733-4e03-9119-2b138fc85c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:53.830692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ec3ff-d733-4e03-9119-2b138fc85c47 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:53.830972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ec3ff-d733-4e03-9119-2b138fc85c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:53.831263 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ec3ff-d733-4e03-9119-2b138fc85c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:53.839710 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ec3ff-d733-4e03-9119-2b138fc85c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:53.841110 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ec3ff-d733-4e03-9119-2b138fc85c47 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:53.850055 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 728/1446] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:41:56.406305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0862d6-9ee3-4f6e-ba13-46ec154f22bb None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.406871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0862d6-9ee3-4f6e-ba13-46ec154f22bb None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.406871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0862d6-9ee3-4f6e-ba13-46ec154f22bb None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.408265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:56.413453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392149-ffdb-43ee-b535-3fa0ce9a8b87 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.414533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392149-ffdb-43ee-b535-3fa0ce9a8b87 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.414650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392149-ffdb-43ee-b535-3fa0ce9a8b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.431811 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-70392149-ffdb-43ee-b535-3fa0ce9a8b87 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:56.433007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-70392149-ffdb-43ee-b535-3fa0ce9a8b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:56.440698 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:41:56.479519 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0862d6-9ee3-4f6e-ba13-46ec154f22bb None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:56.489714 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0862d6-9ee3-4f6e-ba13-46ec154f22bb None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:56.493731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03c09d-dae2-4a00-b402-353cb952af7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:56.494357 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03c09d-dae2-4a00-b402-353cb952af7e service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:56.494639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03c09d-dae2-4a00-b402-353cb952af7e service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:56.494915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03c09d-dae2-4a00-b402-353cb952af7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:56.503549 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03c09d-dae2-4a00-b402-353cb952af7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:56.504976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03c09d-dae2-4a00-b402-353cb952af7e service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:56.514480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 720/1449] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:41:58.840745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d82f-609b-4926-b279-ab0e5d2cd993 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.841365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d82f-609b-4926-b279-ab0e5d2cd993 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.841365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d82f-609b-4926-b279-ab0e5d2cd993 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.842640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:41:58.847771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7562034-d75d-4f4e-a91c-3b7ea941d952 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.848184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7562034-d75d-4f4e-a91c-3b7ea941d952 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.848333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7562034-d75d-4f4e-a91c-3b7ea941d952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.865480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-a7562034-d75d-4f4e-a91c-3b7ea941d952 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:41:58.867301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a7562034-d75d-4f4e-a91c-3b7ea941d952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:41:58.874907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:41:58.912515 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d82f-609b-4926-b279-ab0e5d2cd993 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:41:58.922700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d82f-609b-4926-b279-ab0e5d2cd993 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:41:58.926099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0dc5e-ff09-47bc-9d16-c93149df8615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:41:58.926718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0dc5e-ff09-47bc-9d16-c93149df8615 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:41:58.926994 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0dc5e-ff09-47bc-9d16-c93149df8615 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:41:58.927297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0dc5e-ff09-47bc-9d16-c93149df8615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:41:58.936581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0dc5e-ff09-47bc-9d16-c93149df8615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:41:58.937985 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0dc5e-ff09-47bc-9d16-c93149df8615 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:41:58.947917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 731/1452] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:42:01.208243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65804e81-44e3-4a23-90f5-61c0f93d23cb None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:01.208734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65804e81-44e3-4a23-90f5-61c0f93d23cb None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:01.208860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65804e81-44e3-4a23-90f5-61c0f93d23cb None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:01.210151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:01.215396 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f17d9-bead-4764-9148-604c6083bc9a None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:01.215834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f17d9-bead-4764-9148-604c6083bc9a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:01.215941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f17d9-bead-4764-9148-604c6083bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:01.233671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-3e0f17d9-bead-4764-9148-604c6083bc9a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:01.234861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3e0f17d9-bead-4764-9148-604c6083bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:01.243153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:42:01.280423 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65804e81-44e3-4a23-90f5-61c0f93d23cb None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:01.291298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65804e81-44e3-4a23-90f5-61c0f93d23cb None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:01.294665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849e265-0a90-4572-9eb1-7bfda6c64c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:01.295415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849e265-0a90-4572-9eb1-7bfda6c64c82 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:01.295696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849e265-0a90-4572-9eb1-7bfda6c64c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:01.295968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849e265-0a90-4572-9eb1-7bfda6c64c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:01.305276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849e265-0a90-4572-9eb1-7bfda6c64c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:01.306693 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849e265-0a90-4572-9eb1-7bfda6c64c82 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:01.315867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 723/1455] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:42:03.615655 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da284c07-56d3-4f49-8b48-8e0518abd169 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:03.616258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da284c07-56d3-4f49-8b48-8e0518abd169 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:03.616258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da284c07-56d3-4f49-8b48-8e0518abd169 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:03.617577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:03.622833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754f998-5ee9-45e9-bbf4-342c1b3dbe68 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:03.623299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754f998-5ee9-45e9-bbf4-342c1b3dbe68 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:03.623408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754f998-5ee9-45e9-bbf4-342c1b3dbe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:03.641123 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-0754f998-5ee9-45e9-bbf4-342c1b3dbe68 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:03.642283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0754f998-5ee9-45e9-bbf4-342c1b3dbe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:03.650511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:42:03.687990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da284c07-56d3-4f49-8b48-8e0518abd169 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:03.700229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da284c07-56d3-4f49-8b48-8e0518abd169 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:03.703708 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c7656-4b8a-4e67-ac5e-2a61a50a121b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:03.704344 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c7656-4b8a-4e67-ac5e-2a61a50a121b service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:03.704619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c7656-4b8a-4e67-ac5e-2a61a50a121b service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:03.704889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c7656-4b8a-4e67-ac5e-2a61a50a121b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:03.716799 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c7656-4b8a-4e67-ac5e-2a61a50a121b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:03.718611 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c7656-4b8a-4e67-ac5e-2a61a50a121b service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:03.727902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 734/1458] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:42:06.026271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0c2e-cfd5-40b8-83a2-ed9fad674dc4 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.026854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0c2e-cfd5-40b8-83a2-ed9fad674dc4 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.026854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef0c2e-cfd5-40b8-83a2-ed9fad674dc4 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.028237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:06.033561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25c09a-eb20-4c73-ba2e-843e5cd65183 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.034005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25c09a-eb20-4c73-ba2e-843e5cd65183 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.034103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25c09a-eb20-4c73-ba2e-843e5cd65183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.051643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-bf25c09a-eb20-4c73-ba2e-843e5cd65183 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:06.052805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-bf25c09a-eb20-4c73-ba2e-843e5cd65183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:06.060915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:42:06.097488 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0c2e-cfd5-40b8-83a2-ed9fad674dc4 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:06.108434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef0c2e-cfd5-40b8-83a2-ed9fad674dc4 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:06.111910 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947321b3-7d92-4585-89af-88ecf10a4642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:06.112535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947321b3-7d92-4585-89af-88ecf10a4642 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:06.112820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947321b3-7d92-4585-89af-88ecf10a4642 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:06.113098 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947321b3-7d92-4585-89af-88ecf10a4642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:06.121852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947321b3-7d92-4585-89af-88ecf10a4642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:06.123308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947321b3-7d92-4585-89af-88ecf10a4642 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:06.132386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 726/1461] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:42:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:42:08.386504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76592-0040-462e-a444-458121137d03 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:08.387052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76592-0040-462e-a444-458121137d03 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:08.387052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76592-0040-462e-a444-458121137d03 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:08.388426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:08.393479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab66a7-9bac-4d6b-9422-ffd761520b92 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:08.393891 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab66a7-9bac-4d6b-9422-ffd761520b92 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:08.394034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab66a7-9bac-4d6b-9422-ffd761520b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:08.411533 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f2ab66a7-9bac-4d6b-9422-ffd761520b92 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:08.412695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f2ab66a7-9bac-4d6b-9422-ffd761520b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:08.420826 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:42:08.456812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f76592-0040-462e-a444-458121137d03 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:08.467951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f76592-0040-462e-a444-458121137d03 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:08.471422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f3f24-cc9f-4ac5-90d1-9e941443ca49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:08.472052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3f24-cc9f-4ac5-90d1-9e941443ca49 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:08.472334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3f24-cc9f-4ac5-90d1-9e941443ca49 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:08.472611 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f3f24-cc9f-4ac5-90d1-9e941443ca49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:08.481950 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f3f24-cc9f-4ac5-90d1-9e941443ca49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:08.483393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f3f24-cc9f-4ac5-90d1-9e941443ca49 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:08.493042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 737/1464] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:42:10.828401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aec689-22e9-4eda-9a88-05feca30fed2 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:10.828970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aec689-22e9-4eda-9a88-05feca30fed2 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:10.828970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aec689-22e9-4eda-9a88-05feca30fed2 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:10.830315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:10.835894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1836-9811-490d-af8a-829c49d67e87 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:10.836317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1836-9811-490d-af8a-829c49d67e87 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:10.836438 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb1836-9811-490d-af8a-829c49d67e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:10.854190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-2fdb1836-9811-490d-af8a-829c49d67e87 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:10.855392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2fdb1836-9811-490d-af8a-829c49d67e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:10.862884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:42:10.899008 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aec689-22e9-4eda-9a88-05feca30fed2 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:10.909232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aec689-22e9-4eda-9a88-05feca30fed2 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:10.912643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea17e4-0c9a-423b-80db-444e11915555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:10.913880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea17e4-0c9a-423b-80db-444e11915555 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:10.914157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea17e4-0c9a-423b-80db-444e11915555 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:10.914428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea17e4-0c9a-423b-80db-444e11915555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:10.922839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea17e4-0c9a-423b-80db-444e11915555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:10.924292 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea17e4-0c9a-423b-80db-444e11915555 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:10.933256 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 729/1467] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:42:13.292935 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ede98-a4d1-40c3-90cb-418a0859744d None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.293507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ede98-a4d1-40c3-90cb-418a0859744d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.293507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ede98-a4d1-40c3-90cb-418a0859744d None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.295044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:13.300335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531c48f-0b6c-4d62-b8ad-74eca63bec4d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.300773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531c48f-0b6c-4d62-b8ad-74eca63bec4d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.300900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531c48f-0b6c-4d62-b8ad-74eca63bec4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.318799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-3531c48f-0b6c-4d62-b8ad-74eca63bec4d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:13.320306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3531c48f-0b6c-4d62-b8ad-74eca63bec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:13.327910 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:42:13.363808 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ede98-a4d1-40c3-90cb-418a0859744d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:13.374676 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ede98-a4d1-40c3-90cb-418a0859744d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:13.378108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d895c1f-aa11-43e7-b9c0-63e37dd9e782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:13.378735 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895c1f-aa11-43e7-b9c0-63e37dd9e782 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:13.379015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895c1f-aa11-43e7-b9c0-63e37dd9e782 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:13.379317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895c1f-aa11-43e7-b9c0-63e37dd9e782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:13.387802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d895c1f-aa11-43e7-b9c0-63e37dd9e782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:13.389199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d895c1f-aa11-43e7-b9c0-63e37dd9e782 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:13.398111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 740/1470] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:42:46.474893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727d965-8cc9-4704-860b-cfd8bdd299a3 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:46.475499 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727d965-8cc9-4704-860b-cfd8bdd299a3 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:46.475499 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727d965-8cc9-4704-860b-cfd8bdd299a3 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:46.476757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 731/1471] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:46.482653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bde2f-5618-44b2-bfe7-ec79b430492c None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:46.483104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bde2f-5618-44b2-bfe7-ec79b430492c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:46.483254 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bde2f-5618-44b2-bfe7-ec79b430492c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:46.501041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-736bde2f-5618-44b2-bfe7-ec79b430492c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:46.502222 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-736bde2f-5618-44b2-bfe7-ec79b430492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:46.510479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 741/1472] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:42:46.556152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b3550-b74b-4a03-93f0-2f9c142d7986 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:46.556459 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b3550-b74b-4a03-93f0-2f9c142d7986 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:46.556723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b3550-b74b-4a03-93f0-2f9c142d7986 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:46.558077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 732/1473] 10.222.0.73 () {54 vars in 962 bytes} [Wed May 4 13:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:46.562898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639cec2-dd6f-419f-b7fe-c01d08c6c769 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:46.563194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639cec2-dd6f-419f-b7fe-c01d08c6c769 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:46.563508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639cec2-dd6f-419f-b7fe-c01d08c6c769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:46.581681 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a639cec2-dd6f-419f-b7fe-c01d08c6c769 None None] MFA Rules not processed for user `bbf2b88cc78d4defa7cefb7bf0ae6144`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:46.582885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a639cec2-dd6f-419f-b7fe-c01d08c6c769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:46.589884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 742/1474] 10.222.0.73 () {58 vars in 1059 bytes} [Wed May 4 13:42:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:42:46.596871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b3550-b74b-4a03-93f0-2f9c142d7986 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:46.607356 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b3550-b74b-4a03-93f0-2f9c142d7986 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:46.610745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdd922-3233-4062-9498-1672fa14cb47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf2b88cc78d4defa7cefb7bf0ae6144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:46.611397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdd922-3233-4062-9498-1672fa14cb47 service glance] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:46.611680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdd922-3233-4062-9498-1672fa14cb47 service glance] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:46.611955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdd922-3233-4062-9498-1672fa14cb47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:46.621514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdd922-3233-4062-9498-1672fa14cb47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:46.622937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdd922-3233-4062-9498-1672fa14cb47 service glance] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:46.632749 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 733/1475] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:42:48.945323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b67cd-1996-4fc8-a9c7-8082ba583818 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:48.945897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b67cd-1996-4fc8-a9c7-8082ba583818 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:48.945897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b67cd-1996-4fc8-a9c7-8082ba583818 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:48.947256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 743/1476] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:48.952419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737426c3-f5de-4ce3-a594-3f65d690394c None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:48.952868 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737426c3-f5de-4ce3-a594-3f65d690394c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:48.952977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737426c3-f5de-4ce3-a594-3f65d690394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:48.969990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-737426c3-f5de-4ce3-a594-3f65d690394c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:48.971149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-737426c3-f5de-4ce3-a594-3f65d690394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:48.978678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 734/1477] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:42:49.001900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b67cd-1996-4fc8-a9c7-8082ba583818 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:49.014586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b67cd-1996-4fc8-a9c7-8082ba583818 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:49.018884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f061fb1-4a26-4574-8501-c2c6e0755aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:49.019557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f061fb1-4a26-4574-8501-c2c6e0755aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:49.019842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f061fb1-4a26-4574-8501-c2c6e0755aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:49.020121 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f061fb1-4a26-4574-8501-c2c6e0755aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:49.020853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f061fb1-4a26-4574-8501-c2c6e0755aa1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:49.022560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: WARNING py.warnings [None req-3f061fb1-4a26-4574-8501-c2c6e0755aa1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:42:49.022560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: warnings.warn(msg) May 04 13:42:49.022560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: May 04 13:42:49.023736 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f061fb1-4a26-4574-8501-c2c6e0755aa1 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:49.042063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 744/1478] 10.222.0.73 () {56 vars in 1108 bytes} [Wed May 4 13:42:49 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:42:51.295864 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838031ab-859b-44e9-b8ec-a62b48d9149c None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:51.296421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838031ab-859b-44e9-b8ec-a62b48d9149c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:51.296536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838031ab-859b-44e9-b8ec-a62b48d9149c None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:51.297859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 735/1479] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:51.303815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c1114-6ad5-4269-a297-0a77221a632f None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:51.304264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c1114-6ad5-4269-a297-0a77221a632f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:51.304374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c1114-6ad5-4269-a297-0a77221a632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:51.322876 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-878c1114-6ad5-4269-a297-0a77221a632f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:51.324114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-878c1114-6ad5-4269-a297-0a77221a632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:51.331833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 745/1480] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:42:51.373377 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838031ab-859b-44e9-b8ec-a62b48d9149c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:51.387932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838031ab-859b-44e9-b8ec-a62b48d9149c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:51.393234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff9ac-dc06-402a-8b6c-68e74c33eb08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:51.393858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff9ac-dc06-402a-8b6c-68e74c33eb08 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:51.394141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff9ac-dc06-402a-8b6c-68e74c33eb08 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:51.394417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff9ac-dc06-402a-8b6c-68e74c33eb08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:51.402235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ff9ac-dc06-402a-8b6c-68e74c33eb08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:51.403844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ff9ac-dc06-402a-8b6c-68e74c33eb08 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:51.412791 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 736/1481] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:42:53.832726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678afb6-84e2-40fe-b678-580cd925f8fe None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:53.833279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678afb6-84e2-40fe-b678-580cd925f8fe None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:53.833279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678afb6-84e2-40fe-b678-580cd925f8fe None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:53.834641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 746/1482] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:42:53.839921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d8842-8cb4-4bf8-a9d2-85cf57420897 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:53.840360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d8842-8cb4-4bf8-a9d2-85cf57420897 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:53.840465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d8842-8cb4-4bf8-a9d2-85cf57420897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:53.858251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-429d8842-8cb4-4bf8-a9d2-85cf57420897 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:53.859454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-429d8842-8cb4-4bf8-a9d2-85cf57420897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:53.867755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 737/1483] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:42:53.902241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678afb6-84e2-40fe-b678-580cd925f8fe None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:53.913072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678afb6-84e2-40fe-b678-580cd925f8fe None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:53.916614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7419bc-2867-421f-b67e-1051bf453cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:53.917239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7419bc-2867-421f-b67e-1051bf453cca service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:53.917527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7419bc-2867-421f-b67e-1051bf453cca service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:53.917801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7419bc-2867-421f-b67e-1051bf453cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:53.926387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7419bc-2867-421f-b67e-1051bf453cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:53.928448 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7419bc-2867-421f-b67e-1051bf453cca service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:53.937813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 747/1484] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:42:56.226513 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b6761-9b5e-49b6-ab39-dd2265a3a35c None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:56.227172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b6761-9b5e-49b6-ab39-dd2265a3a35c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:56.227172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b6761-9b5e-49b6-ab39-dd2265a3a35c None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:56.228466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 738/1485] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:56.233563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6e5ec-af02-472c-ba36-aec2377816b4 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:56.233968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6e5ec-af02-472c-ba36-aec2377816b4 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:56.234114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6e5ec-af02-472c-ba36-aec2377816b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:56.251515 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-9ec6e5ec-af02-472c-ba36-aec2377816b4 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:56.252686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-9ec6e5ec-af02-472c-ba36-aec2377816b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:56.260749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 748/1486] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:42:56.297807 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b6761-9b5e-49b6-ab39-dd2265a3a35c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:56.308383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b6761-9b5e-49b6-ab39-dd2265a3a35c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:56.311864 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d40f3-fe05-45e6-9f1f-ffbd51b6be20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:56.312489 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d40f3-fe05-45e6-9f1f-ffbd51b6be20 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:56.312775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d40f3-fe05-45e6-9f1f-ffbd51b6be20 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:56.313036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d40f3-fe05-45e6-9f1f-ffbd51b6be20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:56.322408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d40f3-fe05-45e6-9f1f-ffbd51b6be20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:56.323888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d40f3-fe05-45e6-9f1f-ffbd51b6be20 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:56.332763 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 739/1487] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:42:58.645147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e4506-cff5-41c3-b283-53a75d7df4f4 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:58.645684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e4506-cff5-41c3-b283-53a75d7df4f4 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:58.645684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e4506-cff5-41c3-b283-53a75d7df4f4 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:58.647030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 749/1488] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:42:58.652130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e53f0-0809-40e0-b56e-773be32a0bd1 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:58.652577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e53f0-0809-40e0-b56e-773be32a0bd1 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:58.652675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e53f0-0809-40e0-b56e-773be32a0bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:58.669588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-657e53f0-0809-40e0-b56e-773be32a0bd1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:42:58.670751 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-657e53f0-0809-40e0-b56e-773be32a0bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:42:58.678826 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 740/1489] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:42:58.718164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e4506-cff5-41c3-b283-53a75d7df4f4 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:42:58.728477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e4506-cff5-41c3-b283-53a75d7df4f4 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:42:58.731923 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39f5ef-6e88-4ece-a343-9e19493b8f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:42:58.732559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f5ef-6e88-4ece-a343-9e19493b8f45 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:42:58.732842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f5ef-6e88-4ece-a343-9e19493b8f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:42:58.733118 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39f5ef-6e88-4ece-a343-9e19493b8f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:42:58.742389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39f5ef-6e88-4ece-a343-9e19493b8f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:42:58.743824 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39f5ef-6e88-4ece-a343-9e19493b8f45 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:42:58.753010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 750/1490] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:43:01.133572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8a00d-27e2-474f-8601-5973824a8c42 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:01.134164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8a00d-27e2-474f-8601-5973824a8c42 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:01.134164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8a00d-27e2-474f-8601-5973824a8c42 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:01.135598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 741/1491] 10.222.0.73 () {54 vars in 926 bytes} [Wed May 4 13:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:43:01.140626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73434d9a-5200-4fa3-97c1-51053579bac1 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:01.141031 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73434d9a-5200-4fa3-97c1-51053579bac1 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:01.141186 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73434d9a-5200-4fa3-97c1-51053579bac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:01.159043 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-73434d9a-5200-4fa3-97c1-51053579bac1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:43:01.160252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-73434d9a-5200-4fa3-97c1-51053579bac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:43:01.168512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 751/1492] 10.222.0.73 () {58 vars in 1023 bytes} [Wed May 4 13:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:43:01.206458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8a00d-27e2-474f-8601-5973824a8c42 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:43:01.217371 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8a00d-27e2-474f-8601-5973824a8c42 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:43:01.220916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7b716-5450-49c7-87ff-c2474cbcac9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:43:01.221543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7b716-5450-49c7-87ff-c2474cbcac9b service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:43:01.221825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7b716-5450-49c7-87ff-c2474cbcac9b service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:43:01.222101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7b716-5450-49c7-87ff-c2474cbcac9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:43:01.231715 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7b716-5450-49c7-87ff-c2474cbcac9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:43:01.233138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7b716-5450-49c7-87ff-c2474cbcac9b service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:43:01.242258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 742/1493] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:44:27.954411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c35f5-7c21-443d-88b4-21112972a0e3 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:27.955624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c35f5-7c21-443d-88b4-21112972a0e3 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:27.955624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c35f5-7c21-443d-88b4-21112972a0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:27.980513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-734c35f5-7c21-443d-88b4-21112972a0e3 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:44:27.983252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-734c35f5-7c21-443d-88b4-21112972a0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:44:27.999799 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 752/1494] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:44:28.007920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5b45b-288b-418b-b5cd-9742cc849519 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.008424 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5b45b-288b-418b-b5cd-9742cc849519 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.008533 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5b45b-288b-418b-b5cd-9742cc849519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.026242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f3d5b45b-288b-418b-b5cd-9742cc849519 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:44:28.027503 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f3d5b45b-288b-418b-b5cd-9742cc849519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:44:28.035748 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 743/1495] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:44:28.040135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c35f5-7c21-443d-88b4-21112972a0e3 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:44:28.049579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c35f5-7c21-443d-88b4-21112972a0e3 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:44:28.054029 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e2b0e-551e-42d1-a10f-94cf245160e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:44:28.054707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e2b0e-551e-42d1-a10f-94cf245160e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.054986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e2b0e-551e-42d1-a10f-94cf245160e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.055316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e2b0e-551e-42d1-a10f-94cf245160e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.056042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e2b0e-551e-42d1-a10f-94cf245160e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:44:28.056350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e2b0e-551e-42d1-a10f-94cf245160e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:44:28.057375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: WARNING py.warnings [None req-7b5e2b0e-551e-42d1-a10f-94cf245160e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 13:44:28.057375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: warnings.warn(msg) May 04 13:44:28.057375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: May 04 13:44:28.058250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e2b0e-551e-42d1-a10f-94cf245160e4 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:44:28.069722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 753/1496] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:44:28.077878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5b45b-288b-418b-b5cd-9742cc849519 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:44:28.087272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5b45b-288b-418b-b5cd-9742cc849519 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:44:28.091725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034ca9-da53-4381-8415-35d793e1191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:44:28.092360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034ca9-da53-4381-8415-35d793e1191d admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.092635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034ca9-da53-4381-8415-35d793e1191d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.092906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034ca9-da53-4381-8415-35d793e1191d admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.093585 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034ca9-da53-4381-8415-35d793e1191d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:44:28.095372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: WARNING py.warnings [None req-a0034ca9-da53-4381-8415-35d793e1191d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:44:28.095372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: warnings.warn(msg) May 04 13:44:28.095372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: May 04 13:44:28.097152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034ca9-da53-4381-8415-35d793e1191d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:44:28.131555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 744/1497] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:44:28 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:44:28.135642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e2b0e-551e-42d1-a10f-94cf245160e4 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:44:28.145685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e2b0e-551e-42d1-a10f-94cf245160e4 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:44:28.200893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d2104-efc0-4735-884b-20bf92c68ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:44:28.201547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d2104-efc0-4735-884b-20bf92c68ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.201824 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d2104-efc0-4735-884b-20bf92c68ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.202098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d2104-efc0-4735-884b-20bf92c68ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.202769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d2104-efc0-4735-884b-20bf92c68ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:44:28.203791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: WARNING py.warnings [None req-a18d2104-efc0-4735-884b-20bf92c68ee8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:44:28.203791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: warnings.warn(msg) May 04 13:44:28.203791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: May 04 13:44:28.205524 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d2104-efc0-4735-884b-20bf92c68ee8 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:44:28.225286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 754/1498] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:44:28 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:44:28.229319 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034ca9-da53-4381-8415-35d793e1191d admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:44:28.239124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034ca9-da53-4381-8415-35d793e1191d admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:44:28.243517 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef5c5a-cc02-4d21-9756-fbc62f05106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:44:28.244166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef5c5a-cc02-4d21-9756-fbc62f05106a admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.244448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef5c5a-cc02-4d21-9756-fbc62f05106a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.244720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef5c5a-cc02-4d21-9756-fbc62f05106a admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.245428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef5c5a-cc02-4d21-9756-fbc62f05106a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:44:28.246422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: WARNING py.warnings [None req-98ef5c5a-cc02-4d21-9756-fbc62f05106a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 13:44:28.246422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: warnings.warn(msg) May 04 13:44:28.246422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: May 04 13:44:28.247311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef5c5a-cc02-4d21-9756-fbc62f05106a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:44:28.260044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 745/1499] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:44:28.264026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d2104-efc0-4735-884b-20bf92c68ee8 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:44:28.274274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d2104-efc0-4735-884b-20bf92c68ee8 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:44:28.278828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232fcfb-e218-4803-a7b2-d6b7b0d594a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:44:28.279521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232fcfb-e218-4803-a7b2-d6b7b0d594a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.279803 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232fcfb-e218-4803-a7b2-d6b7b0d594a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.280085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232fcfb-e218-4803-a7b2-d6b7b0d594a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.280808 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232fcfb-e218-4803-a7b2-d6b7b0d594a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:44:28.281804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: WARNING py.warnings [None req-b232fcfb-e218-4803-a7b2-d6b7b0d594a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 13:44:28.281804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: warnings.warn(msg) May 04 13:44:28.281804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: May 04 13:44:28.282739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232fcfb-e218-4803-a7b2-d6b7b0d594a1 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:44:28.296282 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 755/1500] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:44:28.300541 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef5c5a-cc02-4d21-9756-fbc62f05106a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:44:28.311726 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef5c5a-cc02-4d21-9756-fbc62f05106a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:44:28.318458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48bf02-c9aa-47de-97b5-219817575b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:44:28.319378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48bf02-c9aa-47de-97b5-219817575b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.319655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48bf02-c9aa-47de-97b5-219817575b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.319928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48bf02-c9aa-47de-97b5-219817575b97 admin admin] PATH_INFO: `/v3/projects/b9f7cf5f5e7d4330b48f130799044caa/users/68dbaf10430c49e39c9c61c0a00ec743/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.338192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48bf02-c9aa-47de-97b5-219817575b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f7cf5f5e7d4330b48f130799044caa, user_id=68dbaf10430c49e39c9c61c0a00ec743, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:44:28.339269 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: WARNING py.warnings [None req-6e48bf02-c9aa-47de-97b5-219817575b97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:44:28.339269 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: warnings.warn(msg) May 04 13:44:28.339269 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: May 04 13:44:28.341238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48bf02-c9aa-47de-97b5-219817575b97 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:44:28.358431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 746/1501] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:44:28 2022] PUT /identity/v3/projects/b9f7cf5f5e7d4330b48f130799044caa/users/68dbaf10430c49e39c9c61c0a00ec743/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:44:28.369860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa967d-c1fa-4469-957e-ee540b5de55e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.370156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa967d-c1fa-4469-957e-ee540b5de55e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.370441 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa967d-c1fa-4469-957e-ee540b5de55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.396734 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-21fa967d-c1fa-4469-957e-ee540b5de55e None None] MFA Rules not processed for user `68dbaf10430c49e39c9c61c0a00ec743`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:44:28.397943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-21fa967d-c1fa-4469-957e-ee540b5de55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:44:28.458787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 756/1502] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:44:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:44:28.469646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48bf02-c9aa-47de-97b5-219817575b97 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:44:28.535460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48bf02-c9aa-47de-97b5-219817575b97 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:44:28.540755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb4f81-948f-463b-9e1b-30a79dcdd5f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:44:28.541384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb4f81-948f-463b-9e1b-30a79dcdd5f1 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.541661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb4f81-948f-463b-9e1b-30a79dcdd5f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.541933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb4f81-948f-463b-9e1b-30a79dcdd5f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.549241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb4f81-948f-463b-9e1b-30a79dcdd5f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:44:28.550804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb4f81-948f-463b-9e1b-30a79dcdd5f1 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:44:28.559094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 747/1503] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:44:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:44:28.629916 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be61351-3a31-4c4d-bc28-4aa938e57618 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.630213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be61351-3a31-4c4d-bc28-4aa938e57618 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.630496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be61351-3a31-4c4d-bc28-4aa938e57618 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.631865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 757/1504] 10.222.0.73 () {52 vars in 829 bytes} [Wed May 4 13:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:44:28.635837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb4f81-948f-463b-9e1b-30a79dcdd5f1 service nova] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:44:28.696789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb4f81-948f-463b-9e1b-30a79dcdd5f1 service nova] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:44:28.701242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:44:28.702100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.702374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.702639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] PATH_INFO: `/v3/users/68dbaf10430c49e39c9c61c0a00ec743` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.703845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68dbaf10430c49e39c9c61c0a00ec743)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:44:28.704845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: WARNING py.warnings [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:44:28.704845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: warnings.warn(msg) May 04 13:44:28.704845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: May 04 13:44:28.706018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:44:28.771033 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68dbaf10430c49e39c9c61c0a00ec743'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:44:28.781095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68dbaf10430c49e39c9c61c0a00ec743'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:44:28.792869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68dbaf10430c49e39c9c61c0a00ec743'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:44:28.793608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68dbaf10430c49e39c9c61c0a00ec743'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:44:28.794224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68dbaf10430c49e39c9c61c0a00ec743'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:44:28.817982 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 748/1505] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:44:28 2022] DELETE /identity/v3/users/68dbaf10430c49e39c9c61c0a00ec743 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:44:28.822313 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20748598-97e4-483e-90af-003af3dbf66d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.822600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20748598-97e4-483e-90af-003af3dbf66d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.822875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20748598-97e4-483e-90af-003af3dbf66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.839884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-20748598-97e4-483e-90af-003af3dbf66d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:44:28.841045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-20748598-97e4-483e-90af-003af3dbf66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:44:28.896182 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 758/1506] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:44:28.906010 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:44:28.907432 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:44:28.969358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887724a-f848-479d-a456-dd6f0534c9d8 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:44:28.973438 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fed1c-b5fa-477d-a6b5-22d24b7fef0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:44:28.974081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fed1c-b5fa-477d-a6b5-22d24b7fef0a service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:28.974379 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fed1c-b5fa-477d-a6b5-22d24b7fef0a service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:28.974677 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fed1c-b5fa-477d-a6b5-22d24b7fef0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:28.986226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fed1c-b5fa-477d-a6b5-22d24b7fef0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:44:28.988359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fed1c-b5fa-477d-a6b5-22d24b7fef0a service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:44:28.997680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 749/1507] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:44:29.305992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20748598-97e4-483e-90af-003af3dbf66d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:44:29.307595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-20748598-97e4-483e-90af-003af3dbf66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:44:29.320081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20748598-97e4-483e-90af-003af3dbf66d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:44:29.327041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:44:29.328003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:44:29.328285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:44:29.328558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] PATH_INFO: `/v3/projects/b9f7cf5f5e7d4330b48f130799044caa` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:44:29.329729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f7cf5f5e7d4330b48f130799044caa)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:44:29.332458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: WARNING py.warnings [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:44:29.332458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: warnings.warn(msg) May 04 13:44:29.332458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: May 04 13:44:29.333751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:44:29.393289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f7cf5f5e7d4330b48f130799044caa', 'request_id': 'req-df7a637d-3052-4898-aba5-a160e188bc40'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:44:29.406149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f7cf5f5e7d4330b48f130799044caa', 'request_id': 'req-df7a637d-3052-4898-aba5-a160e188bc40'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:44:29.416052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f7cf5f5e7d4330b48f130799044caa', 'request_id': 'req-df7a637d-3052-4898-aba5-a160e188bc40'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:44:29.426467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] The token cache is being invalidate because project b9f7cf5f5e7d4330b48f130799044caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:44:29.426745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:44:29.427393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-df7a637d-3052-4898-aba5-a160e188bc40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:44:29.429009 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 759/1508] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:44:29 2022] DELETE /identity/v3/projects/b9f7cf5f5e7d4330b48f130799044caa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:46:10.988545 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c4d10-cdff-41df-ad7d-8bae01acf9e6 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:10.989226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c4d10-cdff-41df-ad7d-8bae01acf9e6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:10.989226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c4d10-cdff-41df-ad7d-8bae01acf9e6 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:10.990462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 750/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:46:10.995648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe342f-488c-4b9b-ba8c-82b0d751ed22 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:10.996138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe342f-488c-4b9b-ba8c-82b0d751ed22 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:10.996366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe342f-488c-4b9b-ba8c-82b0d751ed22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:11.016509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-2ebe342f-488c-4b9b-ba8c-82b0d751ed22 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:46:11.017784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2ebe342f-488c-4b9b-ba8c-82b0d751ed22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:11.074941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 760/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:46:11.230821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c4d10-cdff-41df-ad7d-8bae01acf9e6 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:46:11.232603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bd3c4d10-cdff-41df-ad7d-8bae01acf9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:11.303782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c4d10-cdff-41df-ad7d-8bae01acf9e6 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:46:11.309042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050a5e2-0011-4f4d-8bc3-d60dfa7f3a7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:46:11.309702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050a5e2-0011-4f4d-8bc3-d60dfa7f3a7d service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:11.309980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050a5e2-0011-4f4d-8bc3-d60dfa7f3a7d service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:11.310254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050a5e2-0011-4f4d-8bc3-d60dfa7f3a7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:11.318728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050a5e2-0011-4f4d-8bc3-d60dfa7f3a7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:46:11.320319 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050a5e2-0011-4f4d-8bc3-d60dfa7f3a7d service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:46:11.329341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 751/1511] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:46:11.793524 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1672d-ae4b-439d-b886-b120f57320ce None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:11.793923 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1672d-ae4b-439d-b886-b120f57320ce None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:11.794277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1672d-ae4b-439d-b886-b120f57320ce None None] PATH_INFO: `/v3` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:11.795666 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 761/1512] 10.222.0.23 () {54 vars in 925 bytes} [Wed May 4 13:46:11 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:46:11.801799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17d0d3-3bbe-4956-a26b-1e69159e7d6c None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:11.802087 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17d0d3-3bbe-4956-a26b-1e69159e7d6c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:11.802360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17d0d3-3bbe-4956-a26b-1e69159e7d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:11.821112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-1e17d0d3-3bbe-4956-a26b-1e69159e7d6c None None] MFA Rules not processed for user `735744b9ea1f429399b914f3e00d166f`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:46:11.822306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1e17d0d3-3bbe-4956-a26b-1e69159e7d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:11.884265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 752/1513] 10.222.0.23 () {58 vars in 1015 bytes} [Wed May 4 13:46:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:46:12.559564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8858a-1811-49e0-97e1-d062931bb724 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:12.560143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8858a-1811-49e0-97e1-d062931bb724 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:12.560143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8858a-1811-49e0-97e1-d062931bb724 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:12.561452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:46:12.566641 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4aed-8bbe-49cc-b1df-d02c83edaad6 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:12.567061 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4aed-8bbe-49cc-b1df-d02c83edaad6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:12.567168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea4aed-8bbe-49cc-b1df-d02c83edaad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:12.584691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-edea4aed-8bbe-49cc-b1df-d02c83edaad6 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:46:12.585890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-edea4aed-8bbe-49cc-b1df-d02c83edaad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:12.593583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:46:12.742567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8858a-1811-49e0-97e1-d062931bb724 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:46:12.756737 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8858a-1811-49e0-97e1-d062931bb724 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:46:12.761991 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dcfd95-4653-4b40-9168-79897ab47b9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:46:12.762623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcfd95-4653-4b40-9168-79897ab47b9f service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:12.762901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcfd95-4653-4b40-9168-79897ab47b9f service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:12.763179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcfd95-4653-4b40-9168-79897ab47b9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:12.771699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dcfd95-4653-4b40-9168-79897ab47b9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:46:12.773269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dcfd95-4653-4b40-9168-79897ab47b9f service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:46:12.782371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 763/1516] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:46:15.741135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948b229-23d0-45dd-aa6a-53bd55f87e22 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:15.741689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948b229-23d0-45dd-aa6a-53bd55f87e22 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:15.741689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948b229-23d0-45dd-aa6a-53bd55f87e22 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:15.742962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 754/1517] 10.222.0.73 () {54 vars in 960 bytes} [Wed May 4 13:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:46:15.747839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6694f77-46f4-47af-beff-8a60867bae76 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:15.748288 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6694f77-46f4-47af-beff-8a60867bae76 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:15.748397 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6694f77-46f4-47af-beff-8a60867bae76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:15.766172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-e6694f77-46f4-47af-beff-8a60867bae76 None None] MFA Rules not processed for user `735744b9ea1f429399b914f3e00d166f`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:46:15.767923 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e6694f77-46f4-47af-beff-8a60867bae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:15.776723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 764/1518] 10.222.0.73 () {58 vars in 1057 bytes} [Wed May 4 13:46:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:46:15.784980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948b229-23d0-45dd-aa6a-53bd55f87e22 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:46:15.799775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948b229-23d0-45dd-aa6a-53bd55f87e22 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:46:15.805083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b515099-7236-4737-8b1f-c3f3f863cb98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735744b9ea1f429399b914f3e00d166f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:46:15.805869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b515099-7236-4737-8b1f-c3f3f863cb98 service placement] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:15.806141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b515099-7236-4737-8b1f-c3f3f863cb98 service placement] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:15.806414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b515099-7236-4737-8b1f-c3f3f863cb98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:15.815191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b515099-7236-4737-8b1f-c3f3f863cb98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:46:15.817143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b515099-7236-4737-8b1f-c3f3f863cb98 service placement] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:46:15.827262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 755/1519] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:46:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:46:24.395560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013330cd-9855-4757-8197-f373bf683dcd None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:24.396128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013330cd-9855-4757-8197-f373bf683dcd None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:24.396128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013330cd-9855-4757-8197-f373bf683dcd None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:24.397455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 765/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:46:24.402228 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d46a4-500e-4ae9-9766-56df1a2c478b None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:24.402644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d46a4-500e-4ae9-9766-56df1a2c478b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:24.402783 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d46a4-500e-4ae9-9766-56df1a2c478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:24.420482 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-e52d46a4-500e-4ae9-9766-56df1a2c478b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:46:24.421638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e52d46a4-500e-4ae9-9766-56df1a2c478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:24.429755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 756/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:46:24.582436 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013330cd-9855-4757-8197-f373bf683dcd None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:46:24.596678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013330cd-9855-4757-8197-f373bf683dcd None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:46:24.602572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2050be-5ac8-4ba4-ac12-94d44b1d7a45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:46:24.603236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2050be-5ac8-4ba4-ac12-94d44b1d7a45 service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:24.603525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2050be-5ac8-4ba4-ac12-94d44b1d7a45 service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:24.603802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2050be-5ac8-4ba4-ac12-94d44b1d7a45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:24.611731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2050be-5ac8-4ba4-ac12-94d44b1d7a45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:46:24.613896 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2050be-5ac8-4ba4-ac12-94d44b1d7a45 service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:46:24.623040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 766/1522] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:46:25.837692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b7a97-d866-4cb9-a330-b4eab7e7a45b None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:25.838349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b7a97-d866-4cb9-a330-b4eab7e7a45b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:25.838349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b7a97-d866-4cb9-a330-b4eab7e7a45b None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:25.839708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 757/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 13:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:46:25.844610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522c136-975e-4276-adeb-94c1dc5c57bd None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:25.845050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522c136-975e-4276-adeb-94c1dc5c57bd None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:25.845181 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522c136-975e-4276-adeb-94c1dc5c57bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:25.864965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a522c136-975e-4276-adeb-94c1dc5c57bd None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:46:25.866145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a522c136-975e-4276-adeb-94c1dc5c57bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:25.874172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 767/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 13:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:46:26.025582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b7a97-d866-4cb9-a330-b4eab7e7a45b None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:46:26.039631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b7a97-d866-4cb9-a330-b4eab7e7a45b None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:46:26.044933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986d3d1-2c1c-477f-9a69-2bb4448347a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:46:26.045559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986d3d1-2c1c-477f-9a69-2bb4448347a5 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:26.045842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986d3d1-2c1c-477f-9a69-2bb4448347a5 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:26.046117 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986d3d1-2c1c-477f-9a69-2bb4448347a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:26.053895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986d3d1-2c1c-477f-9a69-2bb4448347a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:46:26.055495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986d3d1-2c1c-477f-9a69-2bb4448347a5 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:46:26.064520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 758/1525] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:46:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:46:30.138906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70025f-ea1f-4793-b136-c18e6d6e9cef None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:30.139587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70025f-ea1f-4793-b136-c18e6d6e9cef None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:30.139587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70025f-ea1f-4793-b136-c18e6d6e9cef None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:30.140821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 768/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:46:30.146382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28253e56-bdbf-41a4-a76d-040d18f60706 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:30.146819 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28253e56-bdbf-41a4-a76d-040d18f60706 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:30.146925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28253e56-bdbf-41a4-a76d-040d18f60706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:30.164801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-28253e56-bdbf-41a4-a76d-040d18f60706 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:46:30.165975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-28253e56-bdbf-41a4-a76d-040d18f60706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:30.173670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 759/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:46:30.209356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70025f-ea1f-4793-b136-c18e6d6e9cef None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:46:30.210967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ff70025f-ea1f-4793-b136-c18e6d6e9cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:30.264850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70025f-ea1f-4793-b136-c18e6d6e9cef None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:46:30.268269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b854ee-fa15-4c0d-ac8e-372cd67fa606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:46:30.269429 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b854ee-fa15-4c0d-ac8e-372cd67fa606 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:30.269703 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b854ee-fa15-4c0d-ac8e-372cd67fa606 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:30.269969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b854ee-fa15-4c0d-ac8e-372cd67fa606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:30.278522 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b854ee-fa15-4c0d-ac8e-372cd67fa606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:46:30.279951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b854ee-fa15-4c0d-ac8e-372cd67fa606 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:46:30.289500 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 769/1528] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:46:32.542013 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20caab-27b8-4f86-900e-c33b4da904fc None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:32.542613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20caab-27b8-4f86-900e-c33b4da904fc None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:32.542613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20caab-27b8-4f86-900e-c33b4da904fc None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:32.544013 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 760/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:46:32.549114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e3f2f-dd0d-4446-b6c6-89b978dee11a None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:32.549562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e3f2f-dd0d-4446-b6c6-89b978dee11a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:32.549697 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e3f2f-dd0d-4446-b6c6-89b978dee11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:32.568256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ca4e3f2f-dd0d-4446-b6c6-89b978dee11a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:46:32.569389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ca4e3f2f-dd0d-4446-b6c6-89b978dee11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:32.577969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 770/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:46:32.613461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20caab-27b8-4f86-900e-c33b4da904fc None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:46:32.623824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20caab-27b8-4f86-900e-c33b4da904fc None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:46:32.627236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0f538-8324-47ca-b0b1-34247bfe11d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:46:32.628373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0f538-8324-47ca-b0b1-34247bfe11d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:32.628649 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0f538-8324-47ca-b0b1-34247bfe11d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:32.628917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0f538-8324-47ca-b0b1-34247bfe11d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:32.637511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0f538-8324-47ca-b0b1-34247bfe11d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:46:32.638923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0f538-8324-47ca-b0b1-34247bfe11d4 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:46:32.648683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 761/1531] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:46:36.354517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc5594-856f-4c4a-a9da-6c0cad8a765c None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:36.355073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc5594-856f-4c4a-a9da-6c0cad8a765c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:36.355073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc5594-856f-4c4a-a9da-6c0cad8a765c None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:36.356458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 771/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:46:36.361527 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05b0a0-41b2-469f-a4a4-81d3e592c5e1 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:36.361976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05b0a0-41b2-469f-a4a4-81d3e592c5e1 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:36.362083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05b0a0-41b2-469f-a4a4-81d3e592c5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:36.379830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-cc05b0a0-41b2-469f-a4a4-81d3e592c5e1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:46:36.380994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cc05b0a0-41b2-469f-a4a4-81d3e592c5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:36.388546 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 762/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:46:36.657482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc5594-856f-4c4a-a9da-6c0cad8a765c None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:46:36.659679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-58fc5594-856f-4c4a-a9da-6c0cad8a765c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:36.714890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc5594-856f-4c4a-a9da-6c0cad8a765c None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:46:36.718603 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865b7be-35c6-4b37-b5d7-99191ffb4ab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:46:36.719259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865b7be-35c6-4b37-b5d7-99191ffb4ab3 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:36.719544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865b7be-35c6-4b37-b5d7-99191ffb4ab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:36.719819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865b7be-35c6-4b37-b5d7-99191ffb4ab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:36.728819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865b7be-35c6-4b37-b5d7-99191ffb4ab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:46:36.730219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865b7be-35c6-4b37-b5d7-99191ffb4ab3 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:46:36.740065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 772/1534] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:46:39.010529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dc48d-c284-4cde-9519-a8b5f54cfb02 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:39.011111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dc48d-c284-4cde-9519-a8b5f54cfb02 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:39.011111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dc48d-c284-4cde-9519-a8b5f54cfb02 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:39.012518 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 763/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 13:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:46:39.017527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86bc4-b605-4220-8104-30a2080e80b5 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:39.017972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86bc4-b605-4220-8104-30a2080e80b5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:39.018091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e86bc4-b605-4220-8104-30a2080e80b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:39.036578 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-82e86bc4-b605-4220-8104-30a2080e80b5 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:46:39.037750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-82e86bc4-b605-4220-8104-30a2080e80b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:39.045257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 773/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:46:39.316176 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a7ec8-0d2c-46b3-a1c7-4c2040a67b31 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:39.316565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a7ec8-0d2c-46b3-a1c7-4c2040a67b31 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:39.316787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a7ec8-0d2c-46b3-a1c7-4c2040a67b31 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:39.318217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 764/1537] 10.222.0.73 () {54 vars in 963 bytes} [Wed May 4 13:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:46:39.323194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467c1c1-c8af-4cb8-b5a5-f9e8204520d5 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:39.323513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467c1c1-c8af-4cb8-b5a5-f9e8204520d5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:39.323789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467c1c1-c8af-4cb8-b5a5-f9e8204520d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:39.341581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-2467c1c1-c8af-4cb8-b5a5-f9e8204520d5 None None] MFA Rules not processed for user `962dca9381254a08b18ea171183190d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:46:39.342741 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2467c1c1-c8af-4cb8-b5a5-f9e8204520d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:46:39.349604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 774/1538] 10.222.0.73 () {58 vars in 1060 bytes} [Wed May 4 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:46:39.356973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a7ec8-0d2c-46b3-a1c7-4c2040a67b31 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:46:39.367248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a7ec8-0d2c-46b3-a1c7-4c2040a67b31 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:46:39.370726 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04730ee7-d8bb-493b-92f9-21299324f1ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:46:39.371372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730ee7-d8bb-493b-92f9-21299324f1ff service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:46:39.371656 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730ee7-d8bb-493b-92f9-21299324f1ff service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:46:39.371929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730ee7-d8bb-493b-92f9-21299324f1ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:46:39.380988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04730ee7-d8bb-493b-92f9-21299324f1ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:46:39.382400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04730ee7-d8bb-493b-92f9-21299324f1ff service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:46:39.391720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 765/1539] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:11.169718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffecd5-60ee-4fa0-95d0-efe96eb72e78 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.171291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffecd5-60ee-4fa0-95d0-efe96eb72e78 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.171899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffecd5-60ee-4fa0-95d0-efe96eb72e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.204224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-70ffecd5-60ee-4fa0-95d0-efe96eb72e78 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.205447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-70ffecd5-60ee-4fa0-95d0-efe96eb72e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.222861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 775/1540] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.233378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ffccf-d6d3-411a-b8a0-35ff64ff7276 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.234702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ffccf-d6d3-411a-b8a0-35ff64ff7276 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.235199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ffccf-d6d3-411a-b8a0-35ff64ff7276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.265288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-da5ffccf-d6d3-411a-b8a0-35ff64ff7276 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.266547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-da5ffccf-d6d3-411a-b8a0-35ff64ff7276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.282685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 766/1541] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.288091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffecd5-60ee-4fa0-95d0-efe96eb72e78 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:11.298580 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffecd5-60ee-4fa0-95d0-efe96eb72e78 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:11.312738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf7331-4dee-41d3-b09d-94d7a5e5d079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:11.312738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf7331-4dee-41d3-b09d-94d7a5e5d079 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.313046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf7331-4dee-41d3-b09d-94d7a5e5d079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.313279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf7331-4dee-41d3-b09d-94d7a5e5d079 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.313903 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf7331-4dee-41d3-b09d-94d7a5e5d079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:11.314212 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf7331-4dee-41d3-b09d-94d7a5e5d079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:11.316489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf7331-4dee-41d3-b09d-94d7a5e5d079 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:11.337355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 776/1542] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:11.345246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ffccf-d6d3-411a-b8a0-35ff64ff7276 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:11.361134 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ffccf-d6d3-411a-b8a0-35ff64ff7276 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:11.373613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81160b85-ea78-410e-89e9-5f772e491580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:11.374285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81160b85-ea78-410e-89e9-5f772e491580 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.374566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81160b85-ea78-410e-89e9-5f772e491580 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.374840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81160b85-ea78-410e-89e9-5f772e491580 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.375621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81160b85-ea78-410e-89e9-5f772e491580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:11.377869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81160b85-ea78-410e-89e9-5f772e491580 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:11.441830 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ebd1b-6e7e-45d9-a3d1-b47c0026ecbd None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.442039 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ebd1b-6e7e-45d9-a3d1-b47c0026ecbd None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.442288 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ebd1b-6e7e-45d9-a3d1-b47c0026ecbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.448940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 767/1543] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:11.453451 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81160b85-ea78-410e-89e9-5f772e491580 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:11.479744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-7a0ebd1b-6e7e-45d9-a3d1-b47c0026ecbd None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.481203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7a0ebd1b-6e7e-45d9-a3d1-b47c0026ecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.580434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81160b85-ea78-410e-89e9-5f772e491580 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:11.595015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc326b-6e19-46aa-80ba-0ee42287bcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:11.595960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc326b-6e19-46aa-80ba-0ee42287bcee admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.596095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc326b-6e19-46aa-80ba-0ee42287bcee admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.596382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc326b-6e19-46aa-80ba-0ee42287bcee admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.597151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc326b-6e19-46aa-80ba-0ee42287bcee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:11.598204 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: WARNING py.warnings [None req-d2bc326b-6e19-46aa-80ba-0ee42287bcee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:48:11.598204 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: warnings.warn(msg) May 04 13:48:11.598204 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: May 04 13:48:11.600262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc326b-6e19-46aa-80ba-0ee42287bcee admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:11.622928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 777/1544] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.624223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe307ab-ff63-4911-bb1b-775bd0f9262b None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.624513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe307ab-ff63-4911-bb1b-775bd0f9262b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.624827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe307ab-ff63-4911-bb1b-775bd0f9262b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.659257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 768/1545] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:11.659257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b8398-8a3a-4828-ba95-475b1a897fa1 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.659257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b8398-8a3a-4828-ba95-475b1a897fa1 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.659257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b8398-8a3a-4828-ba95-475b1a897fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.659742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-4fe307ab-ff63-4911-bb1b-775bd0f9262b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.659742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4fe307ab-ff63-4911-bb1b-775bd0f9262b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.675641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 778/1546] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.676844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5a2f6-9e24-4ffa-938a-3930c4d59a11 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.677133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5a2f6-9e24-4ffa-938a-3930c4d59a11 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.677412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5a2f6-9e24-4ffa-938a-3930c4d59a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.680547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b81b8398-8a3a-4828-ba95-475b1a897fa1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.681829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b81b8398-8a3a-4828-ba95-475b1a897fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.692066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 769/1547] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.693680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb9781-8953-46f6-97dc-f55cae496f74 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.693993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb9781-8953-46f6-97dc-f55cae496f74 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.694306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb9781-8953-46f6-97dc-f55cae496f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.700270 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-4bb5a2f6-9e24-4ffa-938a-3930c4d59a11 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.702005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4bb5a2f6-9e24-4ffa-938a-3930c4d59a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.713610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 779/1548] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.714244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5a2f6-9e24-4ffa-938a-3930c4d59a11 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:11.720877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-0fdb9781-8953-46f6-97dc-f55cae496f74 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.722517 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0fdb9781-8953-46f6-97dc-f55cae496f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.724143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5a2f6-9e24-4ffa-938a-3930c4d59a11 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:11.728609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605cd6f-f208-4c8f-87d5-e39b8a84c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:11.729261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605cd6f-f208-4c8f-87d5-e39b8a84c083 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.729542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605cd6f-f208-4c8f-87d5-e39b8a84c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.729844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605cd6f-f208-4c8f-87d5-e39b8a84c083 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.730871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605cd6f-f208-4c8f-87d5-e39b8a84c083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:11.730995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 770/1549] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.732066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e05c93-bf1a-4309-ab39-f52d231b6e7e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.732387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605cd6f-f208-4c8f-87d5-e39b8a84c083 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:11.732503 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e05c93-bf1a-4309-ab39-f52d231b6e7e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.732750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e05c93-bf1a-4309-ab39-f52d231b6e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.745698 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 780/1550] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:11.750527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba778b2e-8142-411c-a2fd-c640fb834be1 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.750836 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba778b2e-8142-411c-a2fd-c640fb834be1 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.751120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba778b2e-8142-411c-a2fd-c640fb834be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.756518 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-79e05c93-bf1a-4309-ab39-f52d231b6e7e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.757690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-79e05c93-bf1a-4309-ab39-f52d231b6e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.766141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 771/1551] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.767871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721da7d0-e748-45c3-872b-0742e0d1f1be None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.768355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721da7d0-e748-45c3-872b-0742e0d1f1be None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.769506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721da7d0-e748-45c3-872b-0742e0d1f1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.770267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ba778b2e-8142-411c-a2fd-c640fb834be1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.771503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ba778b2e-8142-411c-a2fd-c640fb834be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.783829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 781/1552] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.785849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be6148-73d3-4acb-aac3-0634b93e8c61 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.786139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be6148-73d3-4acb-aac3-0634b93e8c61 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.786412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be6148-73d3-4acb-aac3-0634b93e8c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.792807 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-721da7d0-e748-45c3-872b-0742e0d1f1be None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.793992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-721da7d0-e748-45c3-872b-0742e0d1f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.801934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 772/1553] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.807444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f5cf-d5a0-4fbc-814f-c016e891120f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.807444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f5cf-d5a0-4fbc-814f-c016e891120f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.807444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f5cf-d5a0-4fbc-814f-c016e891120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.807735 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-62be6148-73d3-4acb-aac3-0634b93e8c61 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.807735 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-62be6148-73d3-4acb-aac3-0634b93e8c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.817742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 782/1554] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.818541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be6148-73d3-4acb-aac3-0634b93e8c61 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:11.822386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-2d32f5cf-d5a0-4fbc-814f-c016e891120f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.823632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2d32f5cf-d5a0-4fbc-814f-c016e891120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.828096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be6148-73d3-4acb-aac3-0634b93e8c61 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:11.836217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 773/1555] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.836217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32f5cf-d5a0-4fbc-814f-c016e891120f None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:11.837372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc2730-506a-43f5-b66a-1f9568bd2e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:11.838251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc2730-506a-43f5-b66a-1f9568bd2e59 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.838558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc2730-506a-43f5-b66a-1f9568bd2e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.838812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc2730-506a-43f5-b66a-1f9568bd2e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.839737 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc2730-506a-43f5-b66a-1f9568bd2e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:11.840046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc2730-506a-43f5-b66a-1f9568bd2e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:11.841669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc2730-506a-43f5-b66a-1f9568bd2e59 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:11.846645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32f5cf-d5a0-4fbc-814f-c016e891120f None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:11.851239 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1246e25-848a-4215-aa63-c5c25de49217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:11.851904 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1246e25-848a-4215-aa63-c5c25de49217 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.852187 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1246e25-848a-4215-aa63-c5c25de49217 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.852613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1246e25-848a-4215-aa63-c5c25de49217 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.853344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1246e25-848a-4215-aa63-c5c25de49217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:11.854087 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 783/1556] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:11.861166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1246e25-848a-4215-aa63-c5c25de49217 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:11.861283 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e594b08-4081-4f65-9a88-cc7b097ab597 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.861283 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e594b08-4081-4f65-9a88-cc7b097ab597 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.861283 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e594b08-4081-4f65-9a88-cc7b097ab597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.868272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 774/1557] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:11.868272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbfb01-afbf-4d0d-a692-c4cd2d2aa8f2 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.868272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbfb01-afbf-4d0d-a692-c4cd2d2aa8f2 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.868272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbfb01-afbf-4d0d-a692-c4cd2d2aa8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.874044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-0e594b08-4081-4f65-9a88-cc7b097ab597 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.875250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0e594b08-4081-4f65-9a88-cc7b097ab597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.883870 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 784/1558] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.887486 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e594b08-4081-4f65-9a88-cc7b097ab597 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:11.888561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-ddbbfb01-afbf-4d0d-a692-c4cd2d2aa8f2 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.889957 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ddbbfb01-afbf-4d0d-a692-c4cd2d2aa8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.897021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e594b08-4081-4f65-9a88-cc7b097ab597 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:11.899305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 775/1559] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.901535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c9af4-c842-411e-b3e1-be3a93ff02db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:11.902210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c9af4-c842-411e-b3e1-be3a93ff02db admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.902491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c9af4-c842-411e-b3e1-be3a93ff02db admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.902764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c9af4-c842-411e-b3e1-be3a93ff02db admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.903546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c9af4-c842-411e-b3e1-be3a93ff02db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:11.903850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c9af4-c842-411e-b3e1-be3a93ff02db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:11.903945 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf3132-493b-4de9-ae3f-c29565f6b777 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.904218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf3132-493b-4de9-ae3f-c29565f6b777 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.904502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf3132-493b-4de9-ae3f-c29565f6b777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.905462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c9af4-c842-411e-b3e1-be3a93ff02db admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:11.923662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 785/1560] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:11.923662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c9af4-c842-411e-b3e1-be3a93ff02db admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:11.923936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-addf3132-493b-4de9-ae3f-c29565f6b777 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:11.923936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-addf3132-493b-4de9-ae3f-c29565f6b777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:11.927299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c9af4-c842-411e-b3e1-be3a93ff02db admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:11.931611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 776/1561] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:11.931761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1ff16-beef-423c-9c22-455dc91ec682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:11.932342 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1ff16-beef-423c-9c22-455dc91ec682 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.932619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf3132-493b-4de9-ae3f-c29565f6b777 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:11.932729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1ff16-beef-423c-9c22-455dc91ec682 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.932894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1ff16-beef-423c-9c22-455dc91ec682 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.933583 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1ff16-beef-423c-9c22-455dc91ec682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:11.934024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1ff16-beef-423c-9c22-455dc91ec682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:11.935614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1ff16-beef-423c-9c22-455dc91ec682 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:11.942537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf3132-493b-4de9-ae3f-c29565f6b777 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:11.946962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94bf18-d043-4a23-96d8-810e64575526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:11.947625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94bf18-d043-4a23-96d8-810e64575526 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.947910 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94bf18-d043-4a23-96d8-810e64575526 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.948194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94bf18-d043-4a23-96d8-810e64575526 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.948320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 786/1562] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:11.948973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94bf18-d043-4a23-96d8-810e64575526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:11.949098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1ff16-beef-423c-9c22-455dc91ec682 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:11.949292 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94bf18-d043-4a23-96d8-810e64575526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:11.950298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: WARNING py.warnings [None req-ad94bf18-d043-4a23-96d8-810e64575526 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 13:48:11.950298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: warnings.warn(msg) May 04 13:48:11.950298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: May 04 13:48:11.951178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94bf18-d043-4a23-96d8-810e64575526 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:11.962797 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 777/1563] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:11.963748 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94bf18-d043-4a23-96d8-810e64575526 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:11.964325 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1ff16-beef-423c-9c22-455dc91ec682 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:11.969628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f9cef-5b69-4f9c-8b0f-aeb2c596adbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:11.970275 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f9cef-5b69-4f9c-8b0f-aeb2c596adbb admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.970677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f9cef-5b69-4f9c-8b0f-aeb2c596adbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.970960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f9cef-5b69-4f9c-8b0f-aeb2c596adbb admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.971685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f9cef-5b69-4f9c-8b0f-aeb2c596adbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:11.972767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: WARNING py.warnings [None req-054f9cef-5b69-4f9c-8b0f-aeb2c596adbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:48:11.972767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: warnings.warn(msg) May 04 13:48:11.972767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: May 04 13:48:11.973945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f9cef-5b69-4f9c-8b0f-aeb2c596adbb admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:11.976023 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94bf18-d043-4a23-96d8-810e64575526 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:11.980606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb338c-c159-409a-adfb-4b23a9fa866c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:11.981468 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb338c-c159-409a-adfb-4b23a9fa866c admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:11.981760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb338c-c159-409a-adfb-4b23a9fa866c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:11.982042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb338c-c159-409a-adfb-4b23a9fa866c admin admin] PATH_INFO: `/v3/projects/bd253d69509d4f9585349fdeee0899ed/users/dfeb14140e484c7895f59cd95b675a23/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:11.996755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb338c-c159-409a-adfb-4b23a9fa866c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd253d69509d4f9585349fdeee0899ed, user_id=dfeb14140e484c7895f59cd95b675a23, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:11.999431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb338c-c159-409a-adfb-4b23a9fa866c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.004319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 787/1564] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:11 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.004319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f382b2-43f5-4183-859a-dbe6072f871d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.004319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f382b2-43f5-4183-859a-dbe6072f871d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.004319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f382b2-43f5-4183-859a-dbe6072f871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.014362 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 778/1565] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:11 2022] PUT /identity/v3/projects/bd253d69509d4f9585349fdeee0899ed/users/dfeb14140e484c7895f59cd95b675a23/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:12.015448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb338c-c159-409a-adfb-4b23a9fa866c admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.028868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-c6f382b2-43f5-4183-859a-dbe6072f871d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:12.030071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c6f382b2-43f5-4183-859a-dbe6072f871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:12.074964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb338c-c159-409a-adfb-4b23a9fa866c admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.079463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbccc0-e458-4997-a82a-32e2487f33c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.080116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbccc0-e458-4997-a82a-32e2487f33c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.080391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbccc0-e458-4997-a82a-32e2487f33c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.080665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbccc0-e458-4997-a82a-32e2487f33c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.081434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbccc0-e458-4997-a82a-32e2487f33c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:12.081765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbccc0-e458-4997-a82a-32e2487f33c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.083373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbccc0-e458-4997-a82a-32e2487f33c0 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.087651 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 788/1566] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:12.088592 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f382b2-43f5-4183-859a-dbe6072f871d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.102130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 779/1567] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:12.102130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbccc0-e458-4997-a82a-32e2487f33c0 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.102426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f382b2-43f5-4183-859a-dbe6072f871d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.102426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286aaa7-df90-4df2-943a-bbba4f2fba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.102851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286aaa7-df90-4df2-943a-bbba4f2fba41 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.102971 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286aaa7-df90-4df2-943a-bbba4f2fba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.103240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286aaa7-df90-4df2-943a-bbba4f2fba41 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.103933 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286aaa7-df90-4df2-943a-bbba4f2fba41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.105602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbccc0-e458-4997-a82a-32e2487f33c0 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.105812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286aaa7-df90-4df2-943a-bbba4f2fba41 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.110157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd025604-8ca6-49a5-8e0f-acaf0583eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.110790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd025604-8ca6-49a5-8e0f-acaf0583eddd admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.111070 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd025604-8ca6-49a5-8e0f-acaf0583eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.111376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd025604-8ca6-49a5-8e0f-acaf0583eddd admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.112094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd025604-8ca6-49a5-8e0f-acaf0583eddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:12.112935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd025604-8ca6-49a5-8e0f-acaf0583eddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.114511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd025604-8ca6-49a5-8e0f-acaf0583eddd admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.126787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 780/1568] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:12.127590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd025604-8ca6-49a5-8e0f-acaf0583eddd admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.134266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 789/1569] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.135258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286aaa7-df90-4df2-943a-bbba4f2fba41 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.138190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd025604-8ca6-49a5-8e0f-acaf0583eddd admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.192713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b36669-5cae-4583-b1f5-48db700ba053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.193290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36669-5cae-4583-b1f5-48db700ba053 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.193589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36669-5cae-4583-b1f5-48db700ba053 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.193860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36669-5cae-4583-b1f5-48db700ba053 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.194607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b36669-5cae-4583-b1f5-48db700ba053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.195008 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286aaa7-df90-4df2-943a-bbba4f2fba41 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.196563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b36669-5cae-4583-b1f5-48db700ba053 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.199594 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f16b8-eb11-42e0-accf-989332aceb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.200106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f16b8-eb11-42e0-accf-989332aceb7a admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.200388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f16b8-eb11-42e0-accf-989332aceb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.200658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f16b8-eb11-42e0-accf-989332aceb7a admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.201343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f16b8-eb11-42e0-accf-989332aceb7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.203223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f16b8-eb11-42e0-accf-989332aceb7a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.221579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 781/1570] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.224190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b36669-5cae-4583-b1f5-48db700ba053 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.231538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 790/1571] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.231538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876b7ba-1f61-4d00-a003-7b49c488782c None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.231538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876b7ba-1f61-4d00-a003-7b49c488782c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.231538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876b7ba-1f61-4d00-a003-7b49c488782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.255658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-5876b7ba-1f61-4d00-a003-7b49c488782c None None] MFA Rules not processed for user `dfeb14140e484c7895f59cd95b675a23`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:12.256864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5876b7ba-1f61-4d00-a003-7b49c488782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:12.285626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b36669-5cae-4583-b1f5-48db700ba053 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.327008 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 791/1572] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:12.327922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876b7ba-1f61-4d00-a003-7b49c488782c None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.350814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a744326-ae85-4f9e-a1c2-4429be42ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.351533 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a744326-ae85-4f9e-a1c2-4429be42ff9d admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.351815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a744326-ae85-4f9e-a1c2-4429be42ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.352087 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a744326-ae85-4f9e-a1c2-4429be42ff9d admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.352774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a744326-ae85-4f9e-a1c2-4429be42ff9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.354697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a744326-ae85-4f9e-a1c2-4429be42ff9d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.377559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 782/1573] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.377559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a744326-ae85-4f9e-a1c2-4429be42ff9d admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.386147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a744326-ae85-4f9e-a1c2-4429be42ff9d admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.388805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876b7ba-1f61-4d00-a003-7b49c488782c None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.391024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7fde5-70fb-4187-85eb-e04c3b606dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.391774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7fde5-70fb-4187-85eb-e04c3b606dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.392060 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7fde5-70fb-4187-85eb-e04c3b606dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.392336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7fde5-70fb-4187-85eb-e04c3b606dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.393016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7fde5-70fb-4187-85eb-e04c3b606dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.393339 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fd109-e861-4d67-97f1-8937678e82a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.394059 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fd109-e861-4d67-97f1-8937678e82a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.394343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fd109-e861-4d67-97f1-8937678e82a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.394620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fd109-e861-4d67-97f1-8937678e82a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.394932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7fde5-70fb-4187-85eb-e04c3b606dc6 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.395480 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fd109-e861-4d67-97f1-8937678e82a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:12.395785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fd109-e861-4d67-97f1-8937678e82a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.397368 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206fd109-e861-4d67-97f1-8937678e82a5 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.415951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 792/1574] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:12.415951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fd109-e861-4d67-97f1-8937678e82a5 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.419591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fd109-e861-4d67-97f1-8937678e82a5 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.424440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd779457-eb5b-402f-b01f-7051ed5e374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.425642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd779457-eb5b-402f-b01f-7051ed5e374f admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.425933 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd779457-eb5b-402f-b01f-7051ed5e374f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.426208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd779457-eb5b-402f-b01f-7051ed5e374f admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.426889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd779457-eb5b-402f-b01f-7051ed5e374f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.431002 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 783/1575] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.431153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd779457-eb5b-402f-b01f-7051ed5e374f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.431312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7fde5-70fb-4187-85eb-e04c3b606dc6 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.448687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 793/1576] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.449536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd779457-eb5b-402f-b01f-7051ed5e374f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.459013 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd779457-eb5b-402f-b01f-7051ed5e374f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.488869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7fde5-70fb-4187-85eb-e04c3b606dc6 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.493480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6f3a1-1ba8-4714-bee3-24df1658fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.494128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6f3a1-1ba8-4714-bee3-24df1658fb1e admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.494427 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6f3a1-1ba8-4714-bee3-24df1658fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.494695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6f3a1-1ba8-4714-bee3-24df1658fb1e admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.495404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6f3a1-1ba8-4714-bee3-24df1658fb1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.497307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6f3a1-1ba8-4714-bee3-24df1658fb1e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.514731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb02737-aa1b-4ad6-91aa-11233387f808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.515590 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb02737-aa1b-4ad6-91aa-11233387f808 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.515871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb02737-aa1b-4ad6-91aa-11233387f808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.516150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb02737-aa1b-4ad6-91aa-11233387f808 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.516835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb02737-aa1b-4ad6-91aa-11233387f808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.518771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb02737-aa1b-4ad6-91aa-11233387f808 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.521980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 784/1577] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/projects => generated 357 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.522763 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6f3a1-1ba8-4714-bee3-24df1658fb1e admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.542387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 794/1578] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.542387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb02737-aa1b-4ad6-91aa-11233387f808 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.583932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6f3a1-1ba8-4714-bee3-24df1658fb1e admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.588829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14d1e-bbf9-4551-a7ee-d54a87c42bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.589494 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14d1e-bbf9-4551-a7ee-d54a87c42bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.589781 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14d1e-bbf9-4551-a7ee-d54a87c42bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.590102 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14d1e-bbf9-4551-a7ee-d54a87c42bf4 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.590791 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc14d1e-bbf9-4551-a7ee-d54a87c42bf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.593006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc14d1e-bbf9-4551-a7ee-d54a87c42bf4 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.594940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb02737-aa1b-4ad6-91aa-11233387f808 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.612884 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 785/1579] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.613817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14d1e-bbf9-4551-a7ee-d54a87c42bf4 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.623378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14d1e-bbf9-4551-a7ee-d54a87c42bf4 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.627972 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41cfce-1be2-480f-b3c6-a30da91130c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.629139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41cfce-1be2-480f-b3c6-a30da91130c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.629417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41cfce-1be2-480f-b3c6-a30da91130c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.629699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41cfce-1be2-480f-b3c6-a30da91130c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.630431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41cfce-1be2-480f-b3c6-a30da91130c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.632017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41cfce-1be2-480f-b3c6-a30da91130c7 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.642151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 786/1580] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:12.642994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41cfce-1be2-480f-b3c6-a30da91130c7 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.644691 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf480253-c97c-49e3-a433-38c8d4f31e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.645405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf480253-c97c-49e3-a433-38c8d4f31e99 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.645752 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf480253-c97c-49e3-a433-38c8d4f31e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.646086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf480253-c97c-49e3-a433-38c8d4f31e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.652696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41cfce-1be2-480f-b3c6-a30da91130c7 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.657085 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8ec33-3717-4945-b303-a545e4975c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.657696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8ec33-3717-4945-b303-a545e4975c73 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.657978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8ec33-3717-4945-b303-a545e4975c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.658254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb8ec33-3717-4945-b303-a545e4975c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.658923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8ec33-3717-4945-b303-a545e4975c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.660862 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb8ec33-3717-4945-b303-a545e4975c73 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.685490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 787/1581] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/projects => generated 403 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.686395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8ec33-3717-4945-b303-a545e4975c73 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.700711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf480253-c97c-49e3-a433-38c8d4f31e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.702063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf480253-c97c-49e3-a433-38c8d4f31e99 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.710694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 795/1582] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:12.711497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf480253-c97c-49e3-a433-38c8d4f31e99 service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.723450 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf480253-c97c-49e3-a433-38c8d4f31e99 service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.749011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb8ec33-3717-4945-b303-a545e4975c73 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.754306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0b0ea-aafe-42c9-a68e-90888f2106f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.754968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0b0ea-aafe-42c9-a68e-90888f2106f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.755290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0b0ea-aafe-42c9-a68e-90888f2106f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.755677 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0b0ea-aafe-42c9-a68e-90888f2106f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.756328 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0b0ea-aafe-42c9-a68e-90888f2106f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.758419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0b0ea-aafe-42c9-a68e-90888f2106f8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.784345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 788/1583] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.784345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0b0ea-aafe-42c9-a68e-90888f2106f8 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.785858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dbbb0-2afc-4637-a3a9-5fa7ee90948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.787619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dbbb0-2afc-4637-a3a9-5fa7ee90948b admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.788339 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dbbb0-2afc-4637-a3a9-5fa7ee90948b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.788857 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dbbb0-2afc-4637-a3a9-5fa7ee90948b admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.790197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dbbb0-2afc-4637-a3a9-5fa7ee90948b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.791975 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dbbb0-2afc-4637-a3a9-5fa7ee90948b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.794391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0b0ea-aafe-42c9-a68e-90888f2106f8 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.799437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01998f7-9d80-4250-a9d1-f04fe55ec748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.800634 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01998f7-9d80-4250-a9d1-f04fe55ec748 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.800917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01998f7-9d80-4250-a9d1-f04fe55ec748 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.801193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01998f7-9d80-4250-a9d1-f04fe55ec748 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.801872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01998f7-9d80-4250-a9d1-f04fe55ec748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.806278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 796/1584] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:12.806437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01998f7-9d80-4250-a9d1-f04fe55ec748 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.806537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dbbb0-2afc-4637-a3a9-5fa7ee90948b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.816503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dbbb0-2afc-4637-a3a9-5fa7ee90948b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.821889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ada2e-e0f8-4142-9edf-4062c9edf1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.822550 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ada2e-e0f8-4142-9edf-4062c9edf1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.822834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ada2e-e0f8-4142-9edf-4062c9edf1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.823108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ada2e-e0f8-4142-9edf-4062c9edf1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.823896 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ada2e-e0f8-4142-9edf-4062c9edf1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.825466 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ada2e-e0f8-4142-9edf-4062c9edf1e6 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.830935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 789/1585] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/users => generated 279 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.830935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01998f7-9d80-4250-a9d1-f04fe55ec748 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.839475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 797/1586] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:12.839475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ada2e-e0f8-4142-9edf-4062c9edf1e6 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.843675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01998f7-9d80-4250-a9d1-f04fe55ec748 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.847439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ada2e-e0f8-4142-9edf-4062c9edf1e6 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.849000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11ed2-3f1d-439a-8009-d811b601de2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.849830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11ed2-3f1d-439a-8009-d811b601de2f admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.850121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11ed2-3f1d-439a-8009-d811b601de2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.850400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a11ed2-3f1d-439a-8009-d811b601de2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.851132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a11ed2-3f1d-439a-8009-d811b601de2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.852471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7caee-ca48-4307-80fc-1b2691d83de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.852777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a11ed2-3f1d-439a-8009-d811b601de2f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.853119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7caee-ca48-4307-80fc-1b2691d83de9 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.853402 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7caee-ca48-4307-80fc-1b2691d83de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.853676 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7caee-ca48-4307-80fc-1b2691d83de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.854392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7caee-ca48-4307-80fc-1b2691d83de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.855995 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7caee-ca48-4307-80fc-1b2691d83de9 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.867570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 790/1587] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:12.867570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11ed2-3f1d-439a-8009-d811b601de2f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.867915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 798/1588] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:12.868461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7caee-ca48-4307-80fc-1b2691d83de9 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.879246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7caee-ca48-4307-80fc-1b2691d83de9 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.881384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a11ed2-3f1d-439a-8009-d811b601de2f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.884469 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac40225-4ba5-4106-ac6d-9a028078a62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.885171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac40225-4ba5-4106-ac6d-9a028078a62b admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.885453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac40225-4ba5-4106-ac6d-9a028078a62b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.885732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac40225-4ba5-4106-ac6d-9a028078a62b admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.886471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac40225-4ba5-4106-ac6d-9a028078a62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.886664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a9219-14c3-4747-9f0d-18e2fa0ea365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.887386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a9219-14c3-4747-9f0d-18e2fa0ea365 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.887670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a9219-14c3-4747-9f0d-18e2fa0ea365 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.887942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a9219-14c3-4747-9f0d-18e2fa0ea365 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.888188 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac40225-4ba5-4106-ac6d-9a028078a62b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.888646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a9219-14c3-4747-9f0d-18e2fa0ea365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.890610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a9219-14c3-4747-9f0d-18e2fa0ea365 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.899344 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 799/1589] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:12.900610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac40225-4ba5-4106-ac6d-9a028078a62b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.913027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac40225-4ba5-4106-ac6d-9a028078a62b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.916956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 791/1590] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:12 2022] POST /identity/v3/users => generated 302 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:12.918267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a9219-14c3-4747-9f0d-18e2fa0ea365 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.918552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead3199-7cf0-4972-b18c-8fb8cfe540f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.919491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead3199-7cf0-4972-b18c-8fb8cfe540f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.920033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead3199-7cf0-4972-b18c-8fb8cfe540f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.920474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead3199-7cf0-4972-b18c-8fb8cfe540f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.921570 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead3199-7cf0-4972-b18c-8fb8cfe540f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.923692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead3199-7cf0-4972-b18c-8fb8cfe540f2 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.935159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a9219-14c3-4747-9f0d-18e2fa0ea365 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.939256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 800/1591] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:12.939256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead3199-7cf0-4972-b18c-8fb8cfe540f2 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.944458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416f3ec-c06e-47d1-9d57-971d60093d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.945167 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416f3ec-c06e-47d1-9d57-971d60093d37 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.945452 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416f3ec-c06e-47d1-9d57-971d60093d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.945740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416f3ec-c06e-47d1-9d57-971d60093d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.946476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416f3ec-c06e-47d1-9d57-971d60093d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.948177 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416f3ec-c06e-47d1-9d57-971d60093d37 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.950951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead3199-7cf0-4972-b18c-8fb8cfe540f2 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.956178 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240f62-ee98-46d5-a0c6-b9da9a5024f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.956935 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240f62-ee98-46d5-a0c6-b9da9a5024f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.957287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240f62-ee98-46d5-a0c6-b9da9a5024f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.957633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240f62-ee98-46d5-a0c6-b9da9a5024f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.958437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240f62-ee98-46d5-a0c6-b9da9a5024f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.962161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 792/1592] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:12.962161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416f3ec-c06e-47d1-9d57-971d60093d37 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.962430 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240f62-ee98-46d5-a0c6-b9da9a5024f0 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.974672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 801/1593] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:12.974672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240f62-ee98-46d5-a0c6-b9da9a5024f0 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:12.975008 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416f3ec-c06e-47d1-9d57-971d60093d37 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.979384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8846142-b16e-4385-9310-3f6388403c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.980166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8846142-b16e-4385-9310-3f6388403c0e admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.980553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8846142-b16e-4385-9310-3f6388403c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.980938 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8846142-b16e-4385-9310-3f6388403c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.981775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8846142-b16e-4385-9310-3f6388403c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:12.983500 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8846142-b16e-4385-9310-3f6388403c0e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:12.984914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240f62-ee98-46d5-a0c6-b9da9a5024f0 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:12.990522 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b70d8-db22-4a38-ad43-da591741e229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:12.991443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b70d8-db22-4a38-ad43-da591741e229 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:12.991716 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b70d8-db22-4a38-ad43-da591741e229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:12.992112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b70d8-db22-4a38-ad43-da591741e229 admin admin] PATH_INFO: `/v3/projects/cf08d79c8f5b457c93189f884ed3f626/users/9d47939de5324f14a451effd4691ce93/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:12.995703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 793/1594] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:12.996492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8846142-b16e-4385-9310-3f6388403c0e admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.006697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8846142-b16e-4385-9310-3f6388403c0e admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.010908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b70d8-db22-4a38-ad43-da591741e229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf08d79c8f5b457c93189f884ed3f626, user_id=9d47939de5324f14a451effd4691ce93, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.012119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: WARNING py.warnings [None req-542b70d8-db22-4a38-ad43-da591741e229 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:48:13.012119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: warnings.warn(msg) May 04 13:48:13.012119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: May 04 13:48:13.012557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de3742-4a4c-47f2-bf66-30a0ac4fd2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.013299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de3742-4a4c-47f2-bf66-30a0ac4fd2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.013653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de3742-4a4c-47f2-bf66-30a0ac4fd2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.013999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de3742-4a4c-47f2-bf66-30a0ac4fd2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.014667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b70d8-db22-4a38-ad43-da591741e229 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.014864 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de3742-4a4c-47f2-bf66-30a0ac4fd2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.016552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de3742-4a4c-47f2-bf66-30a0ac4fd2d2 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.027040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 794/1595] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:13.027796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de3742-4a4c-47f2-bf66-30a0ac4fd2d2 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.032443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 802/1596] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:12 2022] PUT /identity/v3/projects/cf08d79c8f5b457c93189f884ed3f626/users/9d47939de5324f14a451effd4691ce93/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:13.033078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b70d8-db22-4a38-ad43-da591741e229 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.041927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de3742-4a4c-47f2-bf66-30a0ac4fd2d2 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.101481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b70d8-db22-4a38-ad43-da591741e229 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.103838 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e2ee6-c4db-4def-b92f-3db83b899b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.104594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e2ee6-c4db-4def-b92f-3db83b899b05 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.105018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e2ee6-c4db-4def-b92f-3db83b899b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.105307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e2ee6-c4db-4def-b92f-3db83b899b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.106232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e2ee6-c4db-4def-b92f-3db83b899b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.106851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28015eb4-ecd4-4690-82b0-ad531b6d0fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.107825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28015eb4-ecd4-4690-82b0-ad531b6d0fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.108051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e2ee6-c4db-4def-b92f-3db83b899b05 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.108232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28015eb4-ecd4-4690-82b0-ad531b6d0fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.108605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28015eb4-ecd4-4690-82b0-ad531b6d0fa8 admin admin] PATH_INFO: `/v3/projects/38b1ffd3de524bd9ba04c6477cb588ae/users/52fd78a8cb7742b7937721cd32b0b43a/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.121679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 795/1597] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:13.121679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e2ee6-c4db-4def-b92f-3db83b899b05 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.126922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28015eb4-ecd4-4690-82b0-ad531b6d0fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b1ffd3de524bd9ba04c6477cb588ae, user_id=52fd78a8cb7742b7937721cd32b0b43a, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.129744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28015eb4-ecd4-4690-82b0-ad531b6d0fa8 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.131571 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e2ee6-c4db-4def-b92f-3db83b899b05 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.136687 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f5c68-fe79-4c6c-9c91-75db0adaddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.137326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f5c68-fe79-4c6c-9c91-75db0adaddc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.137611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f5c68-fe79-4c6c-9c91-75db0adaddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.137888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f5c68-fe79-4c6c-9c91-75db0adaddc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.138607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f5c68-fe79-4c6c-9c91-75db0adaddc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.140231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f5c68-fe79-4c6c-9c91-75db0adaddc5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.153977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 803/1598] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:13 2022] PUT /identity/v3/projects/38b1ffd3de524bd9ba04c6477cb588ae/users/52fd78a8cb7742b7937721cd32b0b43a/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:13.153977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28015eb4-ecd4-4690-82b0-ad531b6d0fa8 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.154262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 796/1599] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:13.154262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f5c68-fe79-4c6c-9c91-75db0adaddc5 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.164628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f5c68-fe79-4c6c-9c91-75db0adaddc5 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.220940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28015eb4-ecd4-4690-82b0-ad531b6d0fa8 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.224074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064523b-77d0-4775-9a5d-fd351d6dedb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.225045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064523b-77d0-4775-9a5d-fd351d6dedb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.225406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064523b-77d0-4775-9a5d-fd351d6dedb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.225781 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064523b-77d0-4775-9a5d-fd351d6dedb4 admin admin] PATH_INFO: `/v3/projects/817ff3e189a443a7b1f11e9a016832cc/users/6eb5d685612446d9ab48768c32759bcd/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.226834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9eae6-e122-41b8-80c9-06b652ecc01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.227800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9eae6-e122-41b8-80c9-06b652ecc01f admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.228086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9eae6-e122-41b8-80c9-06b652ecc01f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.228368 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9eae6-e122-41b8-80c9-06b652ecc01f admin admin] PATH_INFO: `/v3/projects/7f0a4bc817ae4546ac2c281eb568cb71/users/1e1d4240e6b346e7b3817fc0b70deb95/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.241965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064523b-77d0-4775-9a5d-fd351d6dedb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=817ff3e189a443a7b1f11e9a016832cc, user_id=6eb5d685612446d9ab48768c32759bcd, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.243921 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9eae6-e122-41b8-80c9-06b652ecc01f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0a4bc817ae4546ac2c281eb568cb71, user_id=1e1d4240e6b346e7b3817fc0b70deb95, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.244694 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064523b-77d0-4775-9a5d-fd351d6dedb4 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.246559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9eae6-e122-41b8-80c9-06b652ecc01f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.258916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 797/1600] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:13 2022] PUT /identity/v3/projects/817ff3e189a443a7b1f11e9a016832cc/users/6eb5d685612446d9ab48768c32759bcd/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:13.259876 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064523b-77d0-4775-9a5d-fd351d6dedb4 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.267415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 804/1601] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:13 2022] PUT /identity/v3/projects/7f0a4bc817ae4546ac2c281eb568cb71/users/1e1d4240e6b346e7b3817fc0b70deb95/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:13.267415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20ae0a-124c-49b7-a2fe-cec45f065eb6 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.267415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20ae0a-124c-49b7-a2fe-cec45f065eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.267415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20ae0a-124c-49b7-a2fe-cec45f065eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.279661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-3a20ae0a-124c-49b7-a2fe-cec45f065eb6 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:13.280889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3a20ae0a-124c-49b7-a2fe-cec45f065eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:13.352376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064523b-77d0-4775-9a5d-fd351d6dedb4 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.355100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 805/1602] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:13.356031 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20ae0a-124c-49b7-a2fe-cec45f065eb6 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.358219 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b0314-4d08-4d83-b9b8-892003473e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.359268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b0314-4d08-4d83-b9b8-892003473e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.359552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b0314-4d08-4d83-b9b8-892003473e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.359826 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b0314-4d08-4d83-b9b8-892003473e3f admin admin] PATH_INFO: `/v3/projects/1640d983430c4897920bf0e36861ff87/users/f97f8fe6fc124c0c8213c5b18b558bfc/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.365905 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20ae0a-124c-49b7-a2fe-cec45f065eb6 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.371070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066f239-6e7a-4798-8113-851b9039d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.371767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066f239-6e7a-4798-8113-851b9039d330 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.372154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066f239-6e7a-4798-8113-851b9039d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.372315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066f239-6e7a-4798-8113-851b9039d330 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.373026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066f239-6e7a-4798-8113-851b9039d330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.374584 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066f239-6e7a-4798-8113-851b9039d330 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.378159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b0314-4d08-4d83-b9b8-892003473e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1640d983430c4897920bf0e36861ff87, user_id=f97f8fe6fc124c0c8213c5b18b558bfc, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.381486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b0314-4d08-4d83-b9b8-892003473e3f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.385366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 806/1603] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:13.386777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c5d5a-424a-485f-a968-aa38c1a38d25 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.387355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c5d5a-424a-485f-a968-aa38c1a38d25 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.387453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c5d5a-424a-485f-a968-aa38c1a38d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.400804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 798/1604] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:13 2022] PUT /identity/v3/projects/1640d983430c4897920bf0e36861ff87/users/f97f8fe6fc124c0c8213c5b18b558bfc/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:13.410902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b0314-4d08-4d83-b9b8-892003473e3f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.434717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-0a8c5d5a-424a-485f-a968-aa38c1a38d25 None None] MFA Rules not processed for user `52fd78a8cb7742b7937721cd32b0b43a`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:13.436136 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0a8c5d5a-424a-485f-a968-aa38c1a38d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:13.463188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b0314-4d08-4d83-b9b8-892003473e3f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.468286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde7913-6d95-4906-adb4-524dc9db76e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.469171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde7913-6d95-4906-adb4-524dc9db76e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.469450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde7913-6d95-4906-adb4-524dc9db76e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.469722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde7913-6d95-4906-adb4-524dc9db76e9 admin admin] PATH_INFO: `/v3/projects/cef39d07b8904c24a580eecab6c81bf4/users/8609ff70f50c448cb4c369309fdf4423/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.485104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde7913-6d95-4906-adb4-524dc9db76e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef39d07b8904c24a580eecab6c81bf4, user_id=8609ff70f50c448cb4c369309fdf4423, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.487831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde7913-6d95-4906-adb4-524dc9db76e9 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.502358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 799/1605] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:13 2022] PUT /identity/v3/projects/cef39d07b8904c24a580eecab6c81bf4/users/8609ff70f50c448cb4c369309fdf4423/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:13.503995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180f78-ec2b-47b9-a6c2-0440d90f277d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.504139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180f78-ec2b-47b9-a6c2-0440d90f277d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.504415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf180f78-ec2b-47b9-a6c2-0440d90f277d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.507902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 807/1606] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:13.509136 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b7bfe-c3a2-4851-811f-1b21117418d6 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.509527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b7bfe-c3a2-4851-811f-1b21117418d6 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.509905 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b7bfe-c3a2-4851-811f-1b21117418d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.525270 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-bf180f78-ec2b-47b9-a6c2-0440d90f277d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:13.526470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bf180f78-ec2b-47b9-a6c2-0440d90f277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:13.535868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-239b7bfe-c3a2-4851-811f-1b21117418d6 None None] MFA Rules not processed for user `1e1d4240e6b346e7b3817fc0b70deb95`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:13.537042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-239b7bfe-c3a2-4851-811f-1b21117418d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:13.582888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 800/1607] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:13.584058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180f78-ec2b-47b9-a6c2-0440d90f277d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.585356 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bf180f78-ec2b-47b9-a6c2-0440d90f277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:13.606374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 808/1608] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:13.607197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b7bfe-c3a2-4851-811f-1b21117418d6 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.621870 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b7bfe-c3a2-4851-811f-1b21117418d6 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.632325 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152d588-a80c-4b42-bf91-979f35522ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.633236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152d588-a80c-4b42-bf91-979f35522ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.633518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152d588-a80c-4b42-bf91-979f35522ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.633791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152d588-a80c-4b42-bf91-979f35522ff6 admin admin] PATH_INFO: `/v3/projects/2ff2928cf83b4a1db8ef973e8415cd66/users/24ad63b06aa8476f81a62b5a72b8b0e1/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.648703 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152d588-a80c-4b42-bf91-979f35522ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff2928cf83b4a1db8ef973e8415cd66, user_id=24ad63b06aa8476f81a62b5a72b8b0e1, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.651405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152d588-a80c-4b42-bf91-979f35522ff6 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.654889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf180f78-ec2b-47b9-a6c2-0440d90f277d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.658598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0200b-bddd-4039-b962-cb12652e4ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.659289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0200b-bddd-4039-b962-cb12652e4ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.660130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0200b-bddd-4039-b962-cb12652e4ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.660401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0200b-bddd-4039-b962-cb12652e4ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.665738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 809/1609] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:13 2022] PUT /identity/v3/projects/2ff2928cf83b4a1db8ef973e8415cd66/users/24ad63b06aa8476f81a62b5a72b8b0e1/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:13.667228 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd7dc-130b-45c1-8a98-5bce52462ee8 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.667596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd7dc-130b-45c1-8a98-5bce52462ee8 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.667943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd7dc-130b-45c1-8a98-5bce52462ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.670930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0200b-bddd-4039-b962-cb12652e4ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.672726 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0200b-bddd-4039-b962-cb12652e4ec2 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.682875 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 801/1610] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:13.688300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0200b-bddd-4039-b962-cb12652e4ec2 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.698378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0200b-bddd-4039-b962-cb12652e4ec2 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.706632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-05cbd7dc-130b-45c1-8a98-5bce52462ee8 None None] MFA Rules not processed for user `f97f8fe6fc124c0c8213c5b18b558bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:13.708103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-05cbd7dc-130b-45c1-8a98-5bce52462ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:13.771548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e6174-4ced-411c-be00-ce61789c670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.772646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6174-4ced-411c-be00-ce61789c670d admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.772926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6174-4ced-411c-be00-ce61789c670d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.773433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6174-4ced-411c-be00-ce61789c670d admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.773938 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e6174-4ced-411c-be00-ce61789c670d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.775924 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e6174-4ced-411c-be00-ce61789c670d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:13.779831 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 810/1611] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:13.781159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefbbd5-8e5c-4e63-abb5-f3c6e7db5a74 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.781519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefbbd5-8e5c-4e63-abb5-f3c6e7db5a74 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.781866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefbbd5-8e5c-4e63-abb5-f3c6e7db5a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.809011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 802/1612] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:13 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:13.809953 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e6174-4ced-411c-be00-ce61789c670d admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:13.821349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-6eefbbd5-8e5c-4e63-abb5-f3c6e7db5a74 None None] MFA Rules not processed for user `8609ff70f50c448cb4c369309fdf4423`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:13.823136 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6eefbbd5-8e5c-4e63-abb5-f3c6e7db5a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:13.880526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e6174-4ced-411c-be00-ce61789c670d admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:13.888478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446f6e2-03ef-440d-b119-92cad32770b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:13.889316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f6e2-03ef-440d-b119-92cad32770b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.889731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f6e2-03ef-440d-b119-92cad32770b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.890103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446f6e2-03ef-440d-b119-92cad32770b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.898853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 811/1613] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:13.900360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569d36e-2182-4c3b-acd9-cb5148255ee3 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.900648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569d36e-2182-4c3b-acd9-cb5148255ee3 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.900935 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569d36e-2182-4c3b-acd9-cb5148255ee3 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.902291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 812/1614] 10.222.0.73 () {54 vars in 960 bytes} [Wed May 4 13:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:48:13.903258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae400-e35c-4565-8f5a-62e276e61ca6 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:13.903521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae400-e35c-4565-8f5a-62e276e61ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:13.903799 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae400-e35c-4565-8f5a-62e276e61ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:13.934106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-fd0ae400-e35c-4565-8f5a-62e276e61ca6 None None] MFA Rules not processed for user `24ad63b06aa8476f81a62b5a72b8b0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:13.935098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fd0ae400-e35c-4565-8f5a-62e276e61ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:13.978453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446f6e2-03ef-440d-b119-92cad32770b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:13.979975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446f6e2-03ef-440d-b119-92cad32770b4 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.006069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 803/1615] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:14.015376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a048328-19f5-4fc0-b97d-13acfcfbf16b None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.015869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a048328-19f5-4fc0-b97d-13acfcfbf16b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.016263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a048328-19f5-4fc0-b97d-13acfcfbf16b None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.017802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 813/1616] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:14.019491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae400-e35c-4565-8f5a-62e276e61ca6 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.022566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 804/1617] 10.222.0.73 () {54 vars in 960 bytes} [Wed May 4 13:48:14 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:48:14.023849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a048328-19f5-4fc0-b97d-13acfcfbf16b None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.030633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae400-e35c-4565-8f5a-62e276e61ca6 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.037045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f457b8-601a-483e-aa64-2035a07ac2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.037517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f457b8-601a-483e-aa64-2035a07ac2ea admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.037811 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f457b8-601a-483e-aa64-2035a07ac2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.038096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f457b8-601a-483e-aa64-2035a07ac2ea admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.038920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f457b8-601a-483e-aa64-2035a07ac2ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.039831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a048328-19f5-4fc0-b97d-13acfcfbf16b None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.041012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f457b8-601a-483e-aa64-2035a07ac2ea admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.045305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fc3f6-13be-4a53-9e06-01f7178f8153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.046006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fc3f6-13be-4a53-9e06-01f7178f8153 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.046292 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fc3f6-13be-4a53-9e06-01f7178f8153 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.046567 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fc3f6-13be-4a53-9e06-01f7178f8153 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.047397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fc3f6-13be-4a53-9e06-01f7178f8153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.049359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fc3f6-13be-4a53-9e06-01f7178f8153 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.069861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 814/1618] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:14 2022] POST /identity/v3/users => generated 294 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:14.070040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408693-0711-40c6-a47d-6a939a2128ac None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.070468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408693-0711-40c6-a47d-6a939a2128ac None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.070663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408693-0711-40c6-a47d-6a939a2128ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.086074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 805/1619] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:14 2022] POST /identity/v3/projects => generated 357 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:14.087469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fc3f6-13be-4a53-9e06-01f7178f8153 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.095505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-2b408693-0711-40c6-a47d-6a939a2128ac None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:14.096726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2b408693-0711-40c6-a47d-6a939a2128ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:14.166520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fc3f6-13be-4a53-9e06-01f7178f8153 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.172914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677affd-2d28-4922-9a9f-20793839c413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.174147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677affd-2d28-4922-9a9f-20793839c413 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.174782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677affd-2d28-4922-9a9f-20793839c413 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.176159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677affd-2d28-4922-9a9f-20793839c413 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.177482 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677affd-2d28-4922-9a9f-20793839c413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.180082 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677affd-2d28-4922-9a9f-20793839c413 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.195385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 815/1620] 10.222.0.73 () {58 vars in 1057 bytes} [Wed May 4 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:14.197015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b36ef-e1e6-4a07-8729-ab7680621237 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.197363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b36ef-e1e6-4a07-8729-ab7680621237 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.197644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b36ef-e1e6-4a07-8729-ab7680621237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.220498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d77b36ef-e1e6-4a07-8729-ab7680621237 None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:14.221686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d77b36ef-e1e6-4a07-8729-ab7680621237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:14.235986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 816/1621] 10.222.0.73 () {58 vars in 1057 bytes} [Wed May 4 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:14.236924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b36ef-e1e6-4a07-8729-ab7680621237 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.255475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b36ef-e1e6-4a07-8729-ab7680621237 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.260152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 806/1622] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:14 2022] POST /identity/v3/projects => generated 403 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:14.262147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677affd-2d28-4922-9a9f-20793839c413 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.334567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e514070-0b7e-44ac-839f-fb77d6cc4905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.335070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e514070-0b7e-44ac-839f-fb77d6cc4905 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.335408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e514070-0b7e-44ac-839f-fb77d6cc4905 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.335689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e514070-0b7e-44ac-839f-fb77d6cc4905 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.337516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e514070-0b7e-44ac-839f-fb77d6cc4905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.339148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e514070-0b7e-44ac-839f-fb77d6cc4905 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.350919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 817/1623] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:14.351816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e514070-0b7e-44ac-839f-fb77d6cc4905 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.433629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677affd-2d28-4922-9a9f-20793839c413 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.446325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b81a7-f4ba-4baa-8e3a-56b3bffeafb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.449621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b81a7-f4ba-4baa-8e3a-56b3bffeafb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.449960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b81a7-f4ba-4baa-8e3a-56b3bffeafb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.450266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b81a7-f4ba-4baa-8e3a-56b3bffeafb7 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.452162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b81a7-f4ba-4baa-8e3a-56b3bffeafb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.454893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b81a7-f4ba-4baa-8e3a-56b3bffeafb7 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.486781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e514070-0b7e-44ac-839f-fb77d6cc4905 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.505717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b83a9-0bd4-4a39-99c7-f0d4c8d4998e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.506713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b83a9-0bd4-4a39-99c7-f0d4c8d4998e service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.506713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b83a9-0bd4-4a39-99c7-f0d4c8d4998e service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.506908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b83a9-0bd4-4a39-99c7-f0d4c8d4998e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.508237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 807/1624] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:14 2022] POST /identity/v3/users => generated 285 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:14.508967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b81a7-f4ba-4baa-8e3a-56b3bffeafb7 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.539896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b81a7-f4ba-4baa-8e3a-56b3bffeafb7 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.551896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59064c68-0044-4e06-abcd-45874166eab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.553303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59064c68-0044-4e06-abcd-45874166eab1 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.553701 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59064c68-0044-4e06-abcd-45874166eab1 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.553971 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59064c68-0044-4e06-abcd-45874166eab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.606314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b83a9-0bd4-4a39-99c7-f0d4c8d4998e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.607972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b83a9-0bd4-4a39-99c7-f0d4c8d4998e service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.620470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 818/1625] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:14.621848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b83a9-0bd4-4a39-99c7-f0d4c8d4998e service nova] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.634980 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b83a9-0bd4-4a39-99c7-f0d4c8d4998e service nova] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.637319 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59064c68-0044-4e06-abcd-45874166eab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.639325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59064c68-0044-4e06-abcd-45874166eab1 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.639978 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a3c65-4fb5-4912-8d04-1cc9cd76900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.640647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a3c65-4fb5-4912-8d04-1cc9cd76900d admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.640926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a3c65-4fb5-4912-8d04-1cc9cd76900d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.641201 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a3c65-4fb5-4912-8d04-1cc9cd76900d admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.641892 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a3c65-4fb5-4912-8d04-1cc9cd76900d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.644700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a3c65-4fb5-4912-8d04-1cc9cd76900d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.659457 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 808/1626] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:14.660539 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59064c68-0044-4e06-abcd-45874166eab1 service nova] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.679327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 819/1627] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:14 2022] POST /identity/v3/users => generated 308 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:14.679327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a3c65-4fb5-4912-8d04-1cc9cd76900d admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.689650 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59064c68-0044-4e06-abcd-45874166eab1 service nova] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.699368 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0b18e-db8c-4aa1-a6f1-d256ae572a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.703071 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0b18e-db8c-4aa1-a6f1-d256ae572a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.703380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0b18e-db8c-4aa1-a6f1-d256ae572a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.706233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a3c65-4fb5-4912-8d04-1cc9cd76900d admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.706995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0b18e-db8c-4aa1-a6f1-d256ae572a74 admin admin] PATH_INFO: `/v3/projects/95303cdcec0e41bd80e7c8dda2fa72bd/users/6cc331c22dda4e9bbbdf08a5e7437d8c/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.720458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6beda-76f1-493b-8e93-142ebe941003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.723053 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6beda-76f1-493b-8e93-142ebe941003 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.723383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6beda-76f1-493b-8e93-142ebe941003 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.724164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6beda-76f1-493b-8e93-142ebe941003 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.724913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6beda-76f1-493b-8e93-142ebe941003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.728408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6beda-76f1-493b-8e93-142ebe941003 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.740225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 820/1628] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:14.741606 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a32d1-77ac-41a3-b837-01c54aa0b56a None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.741892 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a32d1-77ac-41a3-b837-01c54aa0b56a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.742171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a32d1-77ac-41a3-b837-01c54aa0b56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.746308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0b18e-db8c-4aa1-a6f1-d256ae572a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95303cdcec0e41bd80e7c8dda2fa72bd, user_id=6cc331c22dda4e9bbbdf08a5e7437d8c, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.752655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0b18e-db8c-4aa1-a6f1-d256ae572a74 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.773356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-4f8a32d1-77ac-41a3-b837-01c54aa0b56a None None] MFA Rules not processed for user `9d47939de5324f14a451effd4691ce93`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:14.775391 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4f8a32d1-77ac-41a3-b837-01c54aa0b56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:14.786181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 809/1629] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:14 2022] PUT /identity/v3/projects/95303cdcec0e41bd80e7c8dda2fa72bd/users/6cc331c22dda4e9bbbdf08a5e7437d8c/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:14.793599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0b18e-db8c-4aa1-a6f1-d256ae572a74 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.905895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 821/1630] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:14.907218 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a32d1-77ac-41a3-b837-01c54aa0b56a None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.923109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0b18e-db8c-4aa1-a6f1-d256ae572a74 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.932653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f9995-e77e-46b3-b193-0830b435a7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.933660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f9995-e77e-46b3-b193-0830b435a7fa admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.934105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f9995-e77e-46b3-b193-0830b435a7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.934655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f9995-e77e-46b3-b193-0830b435a7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.935654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f9995-e77e-46b3-b193-0830b435a7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.936792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a32d1-77ac-41a3-b837-01c54aa0b56a None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.938621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f9995-e77e-46b3-b193-0830b435a7fa admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.949105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d8f07-2519-43d7-9cba-88c93b91c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.949659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8f07-2519-43d7-9cba-88c93b91c49c admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.949950 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8f07-2519-43d7-9cba-88c93b91c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.950224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8f07-2519-43d7-9cba-88c93b91c49c admin admin] PATH_INFO: `/v3/projects/91b377393a214cfaad14397d8118cf58/users/66f47bf7cf5e486c88d3979b011a1c8d/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.958442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 810/1631] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:14.959781 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f9995-e77e-46b3-b193-0830b435a7fa admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:14.971432 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f9995-e77e-46b3-b193-0830b435a7fa admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:14.975612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d8f07-2519-43d7-9cba-88c93b91c49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b377393a214cfaad14397d8118cf58, user_id=66f47bf7cf5e486c88d3979b011a1c8d, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.977365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de7620-9fd7-43aa-bf43-083d4b25304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:14.978358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de7620-9fd7-43aa-bf43-083d4b25304f admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:14.978702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de7620-9fd7-43aa-bf43-083d4b25304f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:14.978833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d8f07-2519-43d7-9cba-88c93b91c49c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:14.978933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de7620-9fd7-43aa-bf43-083d4b25304f admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:14.979789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de7620-9fd7-43aa-bf43-083d4b25304f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:14.982239 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de7620-9fd7-43aa-bf43-083d4b25304f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:15.001173 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 811/1632] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:15.002758 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9853b5b-c6d6-46f8-b78d-1b3de3d79330 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.003906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9853b5b-c6d6-46f8-b78d-1b3de3d79330 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.004490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9853b5b-c6d6-46f8-b78d-1b3de3d79330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.004969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 822/1633] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:14 2022] PUT /identity/v3/projects/91b377393a214cfaad14397d8118cf58/users/66f47bf7cf5e486c88d3979b011a1c8d/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:15.006643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb73dc-44ab-4d07-ab9b-5de4918a9d91 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.007130 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb73dc-44ab-4d07-ab9b-5de4918a9d91 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.007681 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb73dc-44ab-4d07-ab9b-5de4918a9d91 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.009420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 823/1634] 10.222.0.73 () {54 vars in 912 bytes} [Wed May 4 13:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:48:15.010180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb73dc-44ab-4d07-ab9b-5de4918a9d91 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:15.028132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-e9853b5b-c6d6-46f8-b78d-1b3de3d79330 None None] MFA Rules not processed for user `9d47939de5324f14a451effd4691ce93`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:15.029527 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e9853b5b-c6d6-46f8-b78d-1b3de3d79330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:15.106852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 812/1635] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:15.106852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9853b5b-c6d6-46f8-b78d-1b3de3d79330 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:15.130262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb73dc-44ab-4d07-ab9b-5de4918a9d91 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:15.136467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d83e1-b23c-4a26-a4af-309c70c1aa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:15.137371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d83e1-b23c-4a26-a4af-309c70c1aa75 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.137653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d83e1-b23c-4a26-a4af-309c70c1aa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.137933 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d83e1-b23c-4a26-a4af-309c70c1aa75 admin admin] PATH_INFO: `/v3/projects/3f11612083ff465fb28bda05bb8ab439/users/7454bd52107d4e338a326b0f2b0051f3/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.157664 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d83e1-b23c-4a26-a4af-309c70c1aa75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f11612083ff465fb28bda05bb8ab439, user_id=7454bd52107d4e338a326b0f2b0051f3, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:15.166051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d83e1-b23c-4a26-a4af-309c70c1aa75 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:15.189777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 824/1636] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:15 2022] PUT /identity/v3/projects/3f11612083ff465fb28bda05bb8ab439/users/7454bd52107d4e338a326b0f2b0051f3/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:15.189777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d83e1-b23c-4a26-a4af-309c70c1aa75 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:15.203115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9853b5b-c6d6-46f8-b78d-1b3de3d79330 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:15.280052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6dd36-af72-4f04-b7a6-8c7a1a45d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:15.280297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d83e1-b23c-4a26-a4af-309c70c1aa75 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:15.281843 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6dd36-af72-4f04-b7a6-8c7a1a45d2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.282617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6dd36-af72-4f04-b7a6-8c7a1a45d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.283097 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6dd36-af72-4f04-b7a6-8c7a1a45d2f7 admin admin] PATH_INFO: `/v3/projects/95303cdcec0e41bd80e7c8dda2fa72bd/users/6cc331c22dda4e9bbbdf08a5e7437d8c/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.286217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6dd36-af72-4f04-b7a6-8c7a1a45d2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95303cdcec0e41bd80e7c8dda2fa72bd, user_id=6cc331c22dda4e9bbbdf08a5e7437d8c, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:15.288817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e84c5a-20d1-4ab5-bff4-38b6fc0f0540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:15.289550 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e84c5a-20d1-4ab5-bff4-38b6fc0f0540 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.289688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6dd36-af72-4f04-b7a6-8c7a1a45d2f7 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:15.289874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e84c5a-20d1-4ab5-bff4-38b6fc0f0540 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.290150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e84c5a-20d1-4ab5-bff4-38b6fc0f0540 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.291375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e84c5a-20d1-4ab5-bff4-38b6fc0f0540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:15.293091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e84c5a-20d1-4ab5-bff4-38b6fc0f0540 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:15.310218 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 825/1637] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:15.311875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e5f33-8aa3-45a1-907c-d4095710fc0a None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.312354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e5f33-8aa3-45a1-907c-d4095710fc0a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.312772 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e5f33-8aa3-45a1-907c-d4095710fc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.316234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 813/1638] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:15 2022] PUT /identity/v3/projects/95303cdcec0e41bd80e7c8dda2fa72bd/users/6cc331c22dda4e9bbbdf08a5e7437d8c/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:15.318059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037abb7-ab18-4450-a54c-2452770b50a4 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.318392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037abb7-ab18-4450-a54c-2452770b50a4 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.318777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037abb7-ab18-4450-a54c-2452770b50a4 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.320590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 814/1639] 10.222.0.73 () {54 vars in 912 bytes} [Wed May 4 13:48:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:48:15.321393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037abb7-ab18-4450-a54c-2452770b50a4 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:15.338226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-881e5f33-8aa3-45a1-907c-d4095710fc0a None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:15.339792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-881e5f33-8aa3-45a1-907c-d4095710fc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:15.415055 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037abb7-ab18-4450-a54c-2452770b50a4 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:15.420472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf93de-2783-461a-8904-7d2c6fdf5546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:15.421302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf93de-2783-461a-8904-7d2c6fdf5546 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.421582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf93de-2783-461a-8904-7d2c6fdf5546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.421864 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf93de-2783-461a-8904-7d2c6fdf5546 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.422620 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf93de-2783-461a-8904-7d2c6fdf5546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:15.424299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf93de-2783-461a-8904-7d2c6fdf5546 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:15.436421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 826/1640] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:15.437387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e5f33-8aa3-45a1-907c-d4095710fc0a None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:15.439610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 815/1641] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:15.442897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b68210-996e-48be-8b9b-59153140b296 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.443193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b68210-996e-48be-8b9b-59153140b296 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.444934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b68210-996e-48be-8b9b-59153140b296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.453785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e5f33-8aa3-45a1-907c-d4095710fc0a None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:15.459374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a65ab-332f-46e4-9938-b3624645bda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:15.460746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a65ab-332f-46e4-9938-b3624645bda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.461094 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a65ab-332f-46e4-9938-b3624645bda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.461434 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a65ab-332f-46e4-9938-b3624645bda7 admin admin] PATH_INFO: `/v3/projects/91b377393a214cfaad14397d8118cf58/users/66f47bf7cf5e486c88d3979b011a1c8d/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.465032 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a65ab-332f-46e4-9938-b3624645bda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b377393a214cfaad14397d8118cf58, user_id=66f47bf7cf5e486c88d3979b011a1c8d, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:15.468239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a65ab-332f-46e4-9938-b3624645bda7 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:15.469609 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-34b68210-996e-48be-8b9b-59153140b296 None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:15.471927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-34b68210-996e-48be-8b9b-59153140b296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:15.482568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 827/1642] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:15 2022] PUT /identity/v3/projects/91b377393a214cfaad14397d8118cf58/users/66f47bf7cf5e486c88d3979b011a1c8d/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:15.484612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a339-449a-47ca-a7fc-0275b1dafd18 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.484845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a339-449a-47ca-a7fc-0275b1dafd18 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.485255 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a339-449a-47ca-a7fc-0275b1dafd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.525102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-27f4a339-449a-47ca-a7fc-0275b1dafd18 None None] MFA Rules not processed for user `6cc331c22dda4e9bbbdf08a5e7437d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:15.527482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-27f4a339-449a-47ca-a7fc-0275b1dafd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:15.567774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 816/1643] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:15.568867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b68210-996e-48be-8b9b-59153140b296 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:15.623957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 828/1644] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:15.625122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4a339-449a-47ca-a7fc-0275b1dafd18 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:15.658159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b68210-996e-48be-8b9b-59153140b296 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:15.664673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c5ce8-3aa7-4fdd-a270-67fc14a13b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:15.665413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c5ce8-3aa7-4fdd-a270-67fc14a13b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.665694 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c5ce8-3aa7-4fdd-a270-67fc14a13b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.666020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c5ce8-3aa7-4fdd-a270-67fc14a13b9f admin admin] PATH_INFO: `/v3/projects/3f11612083ff465fb28bda05bb8ab439/users/7454bd52107d4e338a326b0f2b0051f3/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.668229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c5ce8-3aa7-4fdd-a270-67fc14a13b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f11612083ff465fb28bda05bb8ab439, user_id=7454bd52107d4e338a326b0f2b0051f3, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:15.670946 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c5ce8-3aa7-4fdd-a270-67fc14a13b9f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:15.703664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 817/1645] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:15 2022] PUT /identity/v3/projects/3f11612083ff465fb28bda05bb8ab439/users/7454bd52107d4e338a326b0f2b0051f3/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:15.705626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e7b1d-4c3d-4cbc-9dd7-4c08d97b21ac None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.706117 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e7b1d-4c3d-4cbc-9dd7-4c08d97b21ac None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.706550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e7b1d-4c3d-4cbc-9dd7-4c08d97b21ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.723525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4a339-449a-47ca-a7fc-0275b1dafd18 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:15.745165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-162e7b1d-4c3d-4cbc-9dd7-4c08d97b21ac None None] MFA Rules not processed for user `66f47bf7cf5e486c88d3979b011a1c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:15.746578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-162e7b1d-4c3d-4cbc-9dd7-4c08d97b21ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:15.811802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9044b04-9d7c-40a3-9fae-ddf6ac3a0c69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:15.812866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9044b04-9d7c-40a3-9fae-ddf6ac3a0c69 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.813556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9044b04-9d7c-40a3-9fae-ddf6ac3a0c69 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.814020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9044b04-9d7c-40a3-9fae-ddf6ac3a0c69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.839534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 818/1646] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:15.840525 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e7b1d-4c3d-4cbc-9dd7-4c08d97b21ac None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:15.853899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e7b1d-4c3d-4cbc-9dd7-4c08d97b21ac None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:15.859486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee04e6-4389-4810-885a-cf22950405b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:15.860531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee04e6-4389-4810-885a-cf22950405b9 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.861255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee04e6-4389-4810-885a-cf22950405b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.861255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee04e6-4389-4810-885a-cf22950405b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.898684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9044b04-9d7c-40a3-9fae-ddf6ac3a0c69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:15.900735 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9044b04-9d7c-40a3-9fae-ddf6ac3a0c69 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:15.916497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 829/1647] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:15.918313 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac23a98-5898-400c-b0e6-a8b24fcae050 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:15.918782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac23a98-5898-400c-b0e6-a8b24fcae050 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:15.919537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac23a98-5898-400c-b0e6-a8b24fcae050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:15.963340 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-fac23a98-5898-400c-b0e6-a8b24fcae050 None None] MFA Rules not processed for user `7454bd52107d4e338a326b0f2b0051f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:15.964327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fac23a98-5898-400c-b0e6-a8b24fcae050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:15.999232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee04e6-4389-4810-885a-cf22950405b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:16.000714 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee04e6-4389-4810-885a-cf22950405b9 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:16.024574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 819/1648] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:16.065289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 830/1649] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:16.382839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee04e6-4389-4810-885a-cf22950405b9 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:16.395983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee04e6-4389-4810-885a-cf22950405b9 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:16.405547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bed4e-272b-495c-b663-7fe1eac40f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:16.406224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bed4e-272b-495c-b663-7fe1eac40f85 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:16.406509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bed4e-272b-495c-b663-7fe1eac40f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:16.406792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bed4e-272b-495c-b663-7fe1eac40f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:16.500550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bed4e-272b-495c-b663-7fe1eac40f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:16.502069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bed4e-272b-495c-b663-7fe1eac40f85 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:16.512219 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 820/1650] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:16.614227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac23a98-5898-400c-b0e6-a8b24fcae050 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:16.626787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac23a98-5898-400c-b0e6-a8b24fcae050 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:16.631291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98344a-895a-477b-ada5-02203d4e4a42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:16.632261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98344a-895a-477b-ada5-02203d4e4a42 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:16.632770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98344a-895a-477b-ada5-02203d4e4a42 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:16.633250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98344a-895a-477b-ada5-02203d4e4a42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:16.644421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98344a-895a-477b-ada5-02203d4e4a42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:16.646621 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98344a-895a-477b-ada5-02203d4e4a42 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:16.670625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 831/1651] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:16 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:16.718871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bed4e-272b-495c-b663-7fe1eac40f85 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:16.730297 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bed4e-272b-495c-b663-7fe1eac40f85 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:16.734877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efb4b4-e92e-4709-a8c4-714f70107b8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:16.735639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efb4b4-e92e-4709-a8c4-714f70107b8f service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:16.737511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efb4b4-e92e-4709-a8c4-714f70107b8f service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:16.737511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efb4b4-e92e-4709-a8c4-714f70107b8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:16.748194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efb4b4-e92e-4709-a8c4-714f70107b8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:16.749727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92efb4b4-e92e-4709-a8c4-714f70107b8f service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:16.760340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 821/1652] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:16 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:16.886815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98344a-895a-477b-ada5-02203d4e4a42 service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:16.911321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98344a-895a-477b-ada5-02203d4e4a42 service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:16.921357 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f4fcb-449c-4dae-88ac-b202bb97cc3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:16.923032 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f4fcb-449c-4dae-88ac-b202bb97cc3f service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:16.923596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f4fcb-449c-4dae-88ac-b202bb97cc3f service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:16.924137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f4fcb-449c-4dae-88ac-b202bb97cc3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:17.032339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efb4b4-e92e-4709-a8c4-714f70107b8f service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:17.035354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f4fcb-449c-4dae-88ac-b202bb97cc3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:17.038468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f4fcb-449c-4dae-88ac-b202bb97cc3f service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:17.048024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efb4b4-e92e-4709-a8c4-714f70107b8f service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:17.053849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfda9f-ff7f-4c61-9141-4c271319e701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:17.055264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfda9f-ff7f-4c61-9141-4c271319e701 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:17.055947 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfda9f-ff7f-4c61-9141-4c271319e701 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:17.056387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfda9f-ff7f-4c61-9141-4c271319e701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:17.061852 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 832/1653] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:17.136641 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfda9f-ff7f-4c61-9141-4c271319e701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:17.140541 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfda9f-ff7f-4c61-9141-4c271319e701 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:17.169563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 822/1654] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:17 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:17.596290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f4fcb-449c-4dae-88ac-b202bb97cc3f service nova] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:17.752766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f4fcb-449c-4dae-88ac-b202bb97cc3f service nova] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:17.765656 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900ead5-a844-475d-a7ed-90f594d9999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:17.766682 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900ead5-a844-475d-a7ed-90f594d9999a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:17.767040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900ead5-a844-475d-a7ed-90f594d9999a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:17.767640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900ead5-a844-475d-a7ed-90f594d9999a admin admin] PATH_INFO: `/v3/users/24ad63b06aa8476f81a62b5a72b8b0e1` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:17.772760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900ead5-a844-475d-a7ed-90f594d9999a admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ad63b06aa8476f81a62b5a72b8b0e1)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:17.773801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: WARNING py.warnings [None req-0900ead5-a844-475d-a7ed-90f594d9999a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:48:17.773801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: warnings.warn(msg) May 04 13:48:17.773801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: May 04 13:48:17.777817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900ead5-a844-475d-a7ed-90f594d9999a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:17.931693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0900ead5-a844-475d-a7ed-90f594d9999a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ad63b06aa8476f81a62b5a72b8b0e1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:17.947680 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0900ead5-a844-475d-a7ed-90f594d9999a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ad63b06aa8476f81a62b5a72b8b0e1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:17.950223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0900ead5-a844-475d-a7ed-90f594d9999a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ad63b06aa8476f81a62b5a72b8b0e1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:17.982724 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0900ead5-a844-475d-a7ed-90f594d9999a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ad63b06aa8476f81a62b5a72b8b0e1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:18.036755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0900ead5-a844-475d-a7ed-90f594d9999a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ad63b06aa8476f81a62b5a72b8b0e1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:18.058790 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 833/1655] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:17 2022] DELETE /identity/v3/users/24ad63b06aa8476f81a62b5a72b8b0e1 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:18.068290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f935fb2-df1b-40fd-a829-23a35b3a9ef6 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:18.069276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f935fb2-df1b-40fd-a829-23a35b3a9ef6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:18.069738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f935fb2-df1b-40fd-a829-23a35b3a9ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:18.106451 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-0f935fb2-df1b-40fd-a829-23a35b3a9ef6 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:18.109431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0f935fb2-df1b-40fd-a829-23a35b3a9ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:18.246060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35326bea-935f-4b00-a134-dc8cd41141ce None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:18.247015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35326bea-935f-4b00-a134-dc8cd41141ce None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:18.247329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35326bea-935f-4b00-a134-dc8cd41141ce None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:18.249224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 834/1656] 10.222.0.73 () {54 vars in 912 bytes} [Wed May 4 13:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:48:18.265224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2427c-9e96-40a9-9883-f485c73ac837 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:18.265509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2427c-9e96-40a9-9883-f485c73ac837 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:18.266016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2427c-9e96-40a9-9883-f485c73ac837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:18.294206 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 823/1657] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:18.306740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f935fb2-df1b-40fd-a829-23a35b3a9ef6 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:18.309374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0f935fb2-df1b-40fd-a829-23a35b3a9ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:18.369603 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-8dc2427c-9e96-40a9-9883-f485c73ac837 None None] MFA Rules not processed for user `963a38e769674dbba95a231e47a7191f`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:18.378416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-8dc2427c-9e96-40a9-9883-f485c73ac837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:18.475898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f935fb2-df1b-40fd-a829-23a35b3a9ef6 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:18.486363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf813e-285f-46ea-8050-5f57d576319b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:18.487177 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf813e-285f-46ea-8050-5f57d576319b service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:18.492036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf813e-285f-46ea-8050-5f57d576319b service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:18.492775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf813e-285f-46ea-8050-5f57d576319b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:18.545672 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf813e-285f-46ea-8050-5f57d576319b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:18.547705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf813e-285f-46ea-8050-5f57d576319b service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:18.549892 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 835/1658] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:48:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:18.562778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2427c-9e96-40a9-9883-f485c73ac837 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:18.594829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2427c-9e96-40a9-9883-f485c73ac837 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:18.600386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 824/1659] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:18.610654 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f93474-1798-4a28-8ffa-9e4b1e1a1852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:18.610654 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f93474-1798-4a28-8ffa-9e4b1e1a1852 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:18.610654 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f93474-1798-4a28-8ffa-9e4b1e1a1852 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:18.610654 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f93474-1798-4a28-8ffa-9e4b1e1a1852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:18.636276 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f93474-1798-4a28-8ffa-9e4b1e1a1852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:18.637984 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f93474-1798-4a28-8ffa-9e4b1e1a1852 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:18.663748 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 836/1660] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:19.168041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf813e-285f-46ea-8050-5f57d576319b service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:19.169638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bdcf813e-285f-46ea-8050-5f57d576319b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:19.202336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf813e-285f-46ea-8050-5f57d576319b service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:19.224867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:19.225830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:19.226117 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:19.226491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] PATH_INFO: `/v3/projects/2ff2928cf83b4a1db8ef973e8415cd66` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:19.229362 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff2928cf83b4a1db8ef973e8415cd66)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:19.230464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: WARNING py.warnings [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 13:48:19.230464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: warnings.warn(msg) May 04 13:48:19.230464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: May 04 13:48:19.232169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:19.384147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff2928cf83b4a1db8ef973e8415cd66', 'request_id': 'req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:19.411627 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff2928cf83b4a1db8ef973e8415cd66', 'request_id': 'req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:19.433520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff2928cf83b4a1db8ef973e8415cd66', 'request_id': 'req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:19.463728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] The token cache is being invalidate because project 2ff2928cf83b4a1db8ef973e8415cd66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:19.464330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:19.467648 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-31ac70ea-7983-4cab-8cd4-6ae09bb00f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:19.469900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 825/1661] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:19 2022] DELETE /identity/v3/projects/2ff2928cf83b4a1db8ef973e8415cd66 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:19.475500 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f93474-1798-4a28-8ffa-9e4b1e1a1852 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:19.492046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f93474-1798-4a28-8ffa-9e4b1e1a1852 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:19.660133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:19.661469 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:19.661913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:19.662354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] PATH_INFO: `/v3/users/7454bd52107d4e338a326b0f2b0051f3` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:19.663887 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7454bd52107d4e338a326b0f2b0051f3)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:19.666213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:19.683232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0241-809b-46d2-a749-a9ac531d4757 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:19.683522 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0241-809b-46d2-a749-a9ac531d4757 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:19.683809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0241-809b-46d2-a749-a9ac531d4757 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:19.685190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 826/1662] 10.222.0.73 () {54 vars in 960 bytes} [Wed May 4 13:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:48:19.692425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba623f0a-595b-4547-b1c6-0af6c2819f0e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:19.692635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba623f0a-595b-4547-b1c6-0af6c2819f0e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:19.692736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba623f0a-595b-4547-b1c6-0af6c2819f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:19.756961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7454bd52107d4e338a326b0f2b0051f3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:19.764397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-ba623f0a-595b-4547-b1c6-0af6c2819f0e None None] MFA Rules not processed for user `735744b9ea1f429399b914f3e00d166f`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:19.765695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ba623f0a-595b-4547-b1c6-0af6c2819f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:19.771736 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7454bd52107d4e338a326b0f2b0051f3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:19.772897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7454bd52107d4e338a326b0f2b0051f3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:19.789711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7454bd52107d4e338a326b0f2b0051f3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:19.843618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7454bd52107d4e338a326b0f2b0051f3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:19.854489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 837/1663] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:19 2022] DELETE /identity/v3/users/7454bd52107d4e338a326b0f2b0051f3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:20.086083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 827/1664] 10.222.0.73 () {58 vars in 1057 bytes} [Wed May 4 13:48:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:20.099673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:20.281778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9174b84-e1da-474f-85fd-eff840e26c70 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:20.305155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64523e1-2d44-4421-9e87-d497a261fd3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735744b9ea1f429399b914f3e00d166f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:20.306108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64523e1-2d44-4421-9e87-d497a261fd3f service placement] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:20.306744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64523e1-2d44-4421-9e87-d497a261fd3f service placement] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:20.307347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64523e1-2d44-4421-9e87-d497a261fd3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:20.309847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d64523e1-2d44-4421-9e87-d497a261fd3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:20.328582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64523e1-2d44-4421-9e87-d497a261fd3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:20.330949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64523e1-2d44-4421-9e87-d497a261fd3f service placement] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:20.362036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 838/1665] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:20.416475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba623f0a-595b-4547-b1c6-0af6c2819f0e None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:20.417989 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ba623f0a-595b-4547-b1c6-0af6c2819f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:20.433329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba623f0a-595b-4547-b1c6-0af6c2819f0e None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:20.507545 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a01bfc-36b2-452f-a143-8bfc059dd841 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:20.508153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a01bfc-36b2-452f-a143-8bfc059dd841 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:20.508153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a01bfc-36b2-452f-a143-8bfc059dd841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:20.524442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a932c-d080-4134-b7bf-63843d0355a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:20.525589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a932c-d080-4134-b7bf-63843d0355a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:20.526074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a932c-d080-4134-b7bf-63843d0355a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:20.526527 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a932c-d080-4134-b7bf-63843d0355a1 admin admin] PATH_INFO: `/v3/projects/3f11612083ff465fb28bda05bb8ab439` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:20.528024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a932c-d080-4134-b7bf-63843d0355a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f11612083ff465fb28bda05bb8ab439)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:20.530187 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a932c-d080-4134-b7bf-63843d0355a1 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:20.560284 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-14a01bfc-36b2-452f-a143-8bfc059dd841 None None] MFA Rules not processed for user `6eb5d685612446d9ab48768c32759bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:20.563446 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-14a01bfc-36b2-452f-a143-8bfc059dd841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:20.607403 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-df4a932c-d080-4134-b7bf-63843d0355a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f11612083ff465fb28bda05bb8ab439', 'request_id': 'req-df4a932c-d080-4134-b7bf-63843d0355a1'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:20.617009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-df4a932c-d080-4134-b7bf-63843d0355a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f11612083ff465fb28bda05bb8ab439', 'request_id': 'req-df4a932c-d080-4134-b7bf-63843d0355a1'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:20.630581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-df4a932c-d080-4134-b7bf-63843d0355a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f11612083ff465fb28bda05bb8ab439', 'request_id': 'req-df4a932c-d080-4134-b7bf-63843d0355a1'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:20.642992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-df4a932c-d080-4134-b7bf-63843d0355a1 admin admin] The token cache is being invalidate because project 3f11612083ff465fb28bda05bb8ab439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:20.643532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-df4a932c-d080-4134-b7bf-63843d0355a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:20.644326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-df4a932c-d080-4134-b7bf-63843d0355a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:20.646978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 828/1666] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:20 2022] DELETE /identity/v3/projects/3f11612083ff465fb28bda05bb8ab439 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:20.658158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 839/1667] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:20.660177 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a399bd2-2c19-4271-88a3-6d8670fd48e9 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:20.660621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a399bd2-2c19-4271-88a3-6d8670fd48e9 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:20.660965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a399bd2-2c19-4271-88a3-6d8670fd48e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:20.670975 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a01bfc-36b2-452f-a143-8bfc059dd841 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:20.673163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-14a01bfc-36b2-452f-a143-8bfc059dd841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:20.691760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6a399bd2-2c19-4271-88a3-6d8670fd48e9 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:20.693238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6a399bd2-2c19-4271-88a3-6d8670fd48e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:20.769698 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 829/1668] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:20.770580 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a01bfc-36b2-452f-a143-8bfc059dd841 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:20.771345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489ca81-1ae6-45a0-addb-89d30ac1f59c None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:20.771708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489ca81-1ae6-45a0-addb-89d30ac1f59c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:20.772345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489ca81-1ae6-45a0-addb-89d30ac1f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:20.793772 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-4489ca81-1ae6-45a0-addb-89d30ac1f59c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:20.796537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4489ca81-1ae6-45a0-addb-89d30ac1f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:20.808316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 830/1669] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:20.813408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489ca81-1ae6-45a0-addb-89d30ac1f59c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:20.834986 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489ca81-1ae6-45a0-addb-89d30ac1f59c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:20.840164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4884f34-adbe-43ba-a1de-d534954812a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:20.841077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4884f34-adbe-43ba-a1de-d534954812a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:20.841506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4884f34-adbe-43ba-a1de-d534954812a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:20.841923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4884f34-adbe-43ba-a1de-d534954812a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:20.842800 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4884f34-adbe-43ba-a1de-d534954812a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:20.843900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4884f34-adbe-43ba-a1de-d534954812a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:20.846100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4884f34-adbe-43ba-a1de-d534954812a1 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:20.859827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 831/1670] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:20.867126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4884f34-adbe-43ba-a1de-d534954812a1 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:20.882415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22f2e8-8899-4f25-80b8-2c7477b260fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:20.883108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22f2e8-8899-4f25-80b8-2c7477b260fd service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:20.883675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22f2e8-8899-4f25-80b8-2c7477b260fd service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:20.883959 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22f2e8-8899-4f25-80b8-2c7477b260fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:20.892073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2d22f2e8-8899-4f25-80b8-2c7477b260fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:20.897988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4884f34-adbe-43ba-a1de-d534954812a1 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:20.913406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ec17f-b310-42b2-882b-770b63393710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:20.914460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ec17f-b310-42b2-882b-770b63393710 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:20.914893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ec17f-b310-42b2-882b-770b63393710 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:20.915384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ec17f-b310-42b2-882b-770b63393710 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:20.916230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ec17f-b310-42b2-882b-770b63393710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:20.920254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ec17f-b310-42b2-882b-770b63393710 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:20.970231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 832/1671] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:20 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:20.973256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22f2e8-8899-4f25-80b8-2c7477b260fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:20.975000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ec17f-b310-42b2-882b-770b63393710 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:20.976364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22f2e8-8899-4f25-80b8-2c7477b260fd service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:20.986153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 840/1672] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:21.057202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ec17f-b310-42b2-882b-770b63393710 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:21.062450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfca32-3222-4b08-9b61-f2612e09d5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:21.063408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfca32-3222-4b08-9b61-f2612e09d5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:21.063726 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfca32-3222-4b08-9b61-f2612e09d5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:21.064103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfca32-3222-4b08-9b61-f2612e09d5e6 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:21.064934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfca32-3222-4b08-9b61-f2612e09d5e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:21.067406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfca32-3222-4b08-9b61-f2612e09d5e6 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:21.100559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 833/1673] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:20 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:21.104591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22f2e8-8899-4f25-80b8-2c7477b260fd service nova] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:21.117428 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22f2e8-8899-4f25-80b8-2c7477b260fd service nova] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:21.123009 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1bcce-2bc7-43de-83ce-55c73a61435c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:21.123898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1bcce-2bc7-43de-83ce-55c73a61435c admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:21.124347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1bcce-2bc7-43de-83ce-55c73a61435c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:21.124767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1bcce-2bc7-43de-83ce-55c73a61435c admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:21.125653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1bcce-2bc7-43de-83ce-55c73a61435c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:21.128418 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1bcce-2bc7-43de-83ce-55c73a61435c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:21.149647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 841/1674] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:21.150429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfca32-3222-4b08-9b61-f2612e09d5e6 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:21.163012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfca32-3222-4b08-9b61-f2612e09d5e6 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:21.168207 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa065159-7e86-4214-bfd0-87d33f5d0cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:21.169038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa065159-7e86-4214-bfd0-87d33f5d0cdc admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:21.169330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa065159-7e86-4214-bfd0-87d33f5d0cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:21.169607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa065159-7e86-4214-bfd0-87d33f5d0cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:21.170327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa065159-7e86-4214-bfd0-87d33f5d0cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:21.176755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa065159-7e86-4214-bfd0-87d33f5d0cdc admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:21.191254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 834/1675] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:48:21.193875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1bcce-2bc7-43de-83ce-55c73a61435c admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:21.206835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1bcce-2bc7-43de-83ce-55c73a61435c admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:21.213464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc725f-4246-4d01-a432-7de2b41e6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:21.214934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc725f-4246-4d01-a432-7de2b41e6cab admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:21.214934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc725f-4246-4d01-a432-7de2b41e6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:21.215099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc725f-4246-4d01-a432-7de2b41e6cab admin admin] PATH_INFO: `/v3/projects/f66d466afc35456c9d43002ef5ca4e46/users/01f9de8953d44f27b5f674a312062f3c/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:21.232847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc725f-4246-4d01-a432-7de2b41e6cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66d466afc35456c9d43002ef5ca4e46, user_id=01f9de8953d44f27b5f674a312062f3c, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:21.236521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc725f-4246-4d01-a432-7de2b41e6cab admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:21.261617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 842/1676] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:21 2022] PUT /identity/v3/projects/f66d466afc35456c9d43002ef5ca4e46/users/01f9de8953d44f27b5f674a312062f3c/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:21.271820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ffba9-ffda-4944-9b1a-d226d1dbf7c4 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:21.272117 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ffba9-ffda-4944-9b1a-d226d1dbf7c4 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:21.272396 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ffba9-ffda-4944-9b1a-d226d1dbf7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:21.307387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-361ffba9-ffda-4944-9b1a-d226d1dbf7c4 None None] MFA Rules not processed for user `01f9de8953d44f27b5f674a312062f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:21.308701 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-361ffba9-ffda-4944-9b1a-d226d1dbf7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:21.395666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 835/1677] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:21.396564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc725f-4246-4d01-a432-7de2b41e6cab admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:21.479366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc725f-4246-4d01-a432-7de2b41e6cab admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:21.500325 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310990a-9c8e-46b4-8424-eff02d50f9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:21.501261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310990a-9c8e-46b4-8424-eff02d50f9ed admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:21.501749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310990a-9c8e-46b4-8424-eff02d50f9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:21.502142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310990a-9c8e-46b4-8424-eff02d50f9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:21.504445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310990a-9c8e-46b4-8424-eff02d50f9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:21.507138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310990a-9c8e-46b4-8424-eff02d50f9ed admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:21.539754 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 843/1678] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:21 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:21.543860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ffba9-ffda-4944-9b1a-d226d1dbf7c4 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:21.559662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ffba9-ffda-4944-9b1a-d226d1dbf7c4 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:21.622242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045202-756c-474c-8453-8d7092e0a0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:21.622844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045202-756c-474c-8453-8d7092e0a0ba admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:21.623123 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045202-756c-474c-8453-8d7092e0a0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:21.623446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d045202-756c-474c-8453-8d7092e0a0ba admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:21.624148 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045202-756c-474c-8453-8d7092e0a0ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:21.626333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d045202-756c-474c-8453-8d7092e0a0ba admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:21.651172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 836/1679] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:21 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:21.655073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310990a-9c8e-46b4-8424-eff02d50f9ed admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:21.670646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310990a-9c8e-46b4-8424-eff02d50f9ed admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:21.676365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531731c7-3a94-46a6-89dc-b1cb60348bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:21.677170 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531731c7-3a94-46a6-89dc-b1cb60348bda admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:21.677621 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531731c7-3a94-46a6-89dc-b1cb60348bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:21.677935 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531731c7-3a94-46a6-89dc-b1cb60348bda admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:21.678908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531731c7-3a94-46a6-89dc-b1cb60348bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:21.680846 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531731c7-3a94-46a6-89dc-b1cb60348bda admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:21.699647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 844/1680] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:48:21.702440 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045202-756c-474c-8453-8d7092e0a0ba admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:21.719404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d045202-756c-474c-8453-8d7092e0a0ba admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:21.756384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98366c38-5f1a-493e-b99a-f7a7eea1e32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:21.758710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98366c38-5f1a-493e-b99a-f7a7eea1e32f admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:21.759006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98366c38-5f1a-493e-b99a-f7a7eea1e32f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:21.759311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98366c38-5f1a-493e-b99a-f7a7eea1e32f admin admin] PATH_INFO: `/v3/projects/f141c7f3d1d24521a7265cbdd1daffb8/users/533e970aa91c4c898897efc154172775/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:21.800351 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98366c38-5f1a-493e-b99a-f7a7eea1e32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f141c7f3d1d24521a7265cbdd1daffb8, user_id=533e970aa91c4c898897efc154172775, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:21.803814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98366c38-5f1a-493e-b99a-f7a7eea1e32f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:21.823591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 837/1681] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:21 2022] PUT /identity/v3/projects/f141c7f3d1d24521a7265cbdd1daffb8/users/533e970aa91c4c898897efc154172775/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:21.827632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531731c7-3a94-46a6-89dc-b1cb60348bda admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:21.842269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531731c7-3a94-46a6-89dc-b1cb60348bda admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:21.912037 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b49bdb-e3f3-4c97-a6f6-db9c94fb2bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:21.912834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b49bdb-e3f3-4c97-a6f6-db9c94fb2bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:21.913195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b49bdb-e3f3-4c97-a6f6-db9c94fb2bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:21.913562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b49bdb-e3f3-4c97-a6f6-db9c94fb2bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:21.914395 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b49bdb-e3f3-4c97-a6f6-db9c94fb2bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:21.916100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b49bdb-e3f3-4c97-a6f6-db9c94fb2bd6 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:21.939493 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98366c38-5f1a-493e-b99a-f7a7eea1e32f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:21.941979 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 845/1682] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:48:21.959433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98366c38-5f1a-493e-b99a-f7a7eea1e32f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:21.967429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503a456-df03-4608-8095-d2ed7fa060c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:21.968412 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503a456-df03-4608-8095-d2ed7fa060c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:21.969342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503a456-df03-4608-8095-d2ed7fa060c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:21.969576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503a456-df03-4608-8095-d2ed7fa060c6 admin admin] PATH_INFO: `/v3/projects/f141c7f3d1d24521a7265cbdd1daffb8/users/533e970aa91c4c898897efc154172775/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:21.971845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503a456-df03-4608-8095-d2ed7fa060c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f141c7f3d1d24521a7265cbdd1daffb8, user_id=533e970aa91c4c898897efc154172775, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:21.976350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503a456-df03-4608-8095-d2ed7fa060c6 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:22.013651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 838/1683] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:21 2022] PUT /identity/v3/projects/f141c7f3d1d24521a7265cbdd1daffb8/users/533e970aa91c4c898897efc154172775/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:22.024483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b8c78-c826-44af-bb73-043dedbdbbeb None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:22.024780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b8c78-c826-44af-bb73-043dedbdbbeb None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:22.025346 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b8c78-c826-44af-bb73-043dedbdbbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:22.064464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-495b8c78-c826-44af-bb73-043dedbdbbeb None None] MFA Rules not processed for user `533e970aa91c4c898897efc154172775`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:22.066818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-495b8c78-c826-44af-bb73-043dedbdbbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:22.141551 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 846/1684] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:22.155797 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503a456-df03-4608-8095-d2ed7fa060c6 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:22.157719 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d503a456-df03-4608-8095-d2ed7fa060c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:22.256541 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503a456-df03-4608-8095-d2ed7fa060c6 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:22.260971 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121b8b3-ef86-4b16-a21e-1388f439fb05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:22.261700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121b8b3-ef86-4b16-a21e-1388f439fb05 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:22.262352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121b8b3-ef86-4b16-a21e-1388f439fb05 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:22.262698 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121b8b3-ef86-4b16-a21e-1388f439fb05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:22.276941 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121b8b3-ef86-4b16-a21e-1388f439fb05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:22.280071 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121b8b3-ef86-4b16-a21e-1388f439fb05 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:22.294144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 839/1685] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:22.765849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b8c78-c826-44af-bb73-043dedbdbbeb None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:22.840126 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b8c78-c826-44af-bb73-043dedbdbbeb None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:22.846220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:22.848087 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:22.848508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:22.848915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] PATH_INFO: `/v3/users/01f9de8953d44f27b5f674a312062f3c` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:22.850266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f9de8953d44f27b5f674a312062f3c)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:22.852703 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:22.921367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f9de8953d44f27b5f674a312062f3c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:22.932893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f9de8953d44f27b5f674a312062f3c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:22.933941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f9de8953d44f27b5f674a312062f3c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:22.948958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f9de8953d44f27b5f674a312062f3c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:22.976070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f9de8953d44f27b5f674a312062f3c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:22.987990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 847/1686] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:22 2022] DELETE /identity/v3/users/01f9de8953d44f27b5f674a312062f3c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:22.993378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467c61-2f78-4ebf-8972-f70bde5dabd8 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:22.993905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467c61-2f78-4ebf-8972-f70bde5dabd8 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:22.994294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5467c61-2f78-4ebf-8972-f70bde5dabd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:23.012066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f5467c61-2f78-4ebf-8972-f70bde5dabd8 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:23.013401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f5467c61-2f78-4ebf-8972-f70bde5dabd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:23.104793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 840/1687] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:23.121885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:23.123532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:23.201326 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda3ec-0f8f-4731-9b25-d84f55599c8c admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:23.205224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe23627-72aa-4a3b-a95c-113ba27ce858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:23.206653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe23627-72aa-4a3b-a95c-113ba27ce858 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:23.207137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe23627-72aa-4a3b-a95c-113ba27ce858 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:23.207807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe23627-72aa-4a3b-a95c-113ba27ce858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:23.218445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe23627-72aa-4a3b-a95c-113ba27ce858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:23.220912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe23627-72aa-4a3b-a95c-113ba27ce858 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:23.234479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 848/1688] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:23.651612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a3ab6-82ea-438a-b83a-57d033f64432 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:23.651894 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a3ab6-82ea-438a-b83a-57d033f64432 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:23.652172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a3ab6-82ea-438a-b83a-57d033f64432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:23.671969 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-4b8a3ab6-82ea-438a-b83a-57d033f64432 None None] MFA Rules not processed for user `6eb5d685612446d9ab48768c32759bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:23.673388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4b8a3ab6-82ea-438a-b83a-57d033f64432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:23.719025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe23627-72aa-4a3b-a95c-113ba27ce858 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:23.722469 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5fe23627-72aa-4a3b-a95c-113ba27ce858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:23.762292 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe23627-72aa-4a3b-a95c-113ba27ce858 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:23.769784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a552c-6e8d-46c0-bc0e-87d19ed332a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:23.771025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a552c-6e8d-46c0-bc0e-87d19ed332a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:23.771425 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a552c-6e8d-46c0-bc0e-87d19ed332a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:23.772002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a552c-6e8d-46c0-bc0e-87d19ed332a3 admin admin] PATH_INFO: `/v3/projects/f66d466afc35456c9d43002ef5ca4e46` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:23.773597 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a552c-6e8d-46c0-bc0e-87d19ed332a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66d466afc35456c9d43002ef5ca4e46)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:23.777751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a552c-6e8d-46c0-bc0e-87d19ed332a3 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:23.793945 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 841/1689] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:23.843520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-191a552c-6e8d-46c0-bc0e-87d19ed332a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66d466afc35456c9d43002ef5ca4e46', 'request_id': 'req-191a552c-6e8d-46c0-bc0e-87d19ed332a3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:23.851037 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-191a552c-6e8d-46c0-bc0e-87d19ed332a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66d466afc35456c9d43002ef5ca4e46', 'request_id': 'req-191a552c-6e8d-46c0-bc0e-87d19ed332a3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:23.860742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-191a552c-6e8d-46c0-bc0e-87d19ed332a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66d466afc35456c9d43002ef5ca4e46', 'request_id': 'req-191a552c-6e8d-46c0-bc0e-87d19ed332a3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:23.881931 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-191a552c-6e8d-46c0-bc0e-87d19ed332a3 admin admin] The token cache is being invalidate because project f66d466afc35456c9d43002ef5ca4e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:23.882321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-191a552c-6e8d-46c0-bc0e-87d19ed332a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:23.883122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-191a552c-6e8d-46c0-bc0e-87d19ed332a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:23.887676 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 849/1690] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:23 2022] DELETE /identity/v3/projects/f66d466afc35456c9d43002ef5ca4e46 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:23.889095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a3ab6-82ea-438a-b83a-57d033f64432 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:23.904236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a3ab6-82ea-438a-b83a-57d033f64432 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:23.994577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aad4b0-4c04-4759-afb8-78cd0eb4879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:23.995593 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aad4b0-4c04-4759-afb8-78cd0eb4879e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:23.995875 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aad4b0-4c04-4759-afb8-78cd0eb4879e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:23.996148 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aad4b0-4c04-4759-afb8-78cd0eb4879e admin admin] PATH_INFO: `/v3/users/533e970aa91c4c898897efc154172775` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:23.997439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aad4b0-4c04-4759-afb8-78cd0eb4879e admin admin] RBAC: Authorizing `identity:delete_user(user_id=533e970aa91c4c898897efc154172775)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:23.999473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aad4b0-4c04-4759-afb8-78cd0eb4879e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:24.064623 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-54aad4b0-4c04-4759-afb8-78cd0eb4879e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533e970aa91c4c898897efc154172775'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:24.074116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-54aad4b0-4c04-4759-afb8-78cd0eb4879e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533e970aa91c4c898897efc154172775'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:24.082618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-54aad4b0-4c04-4759-afb8-78cd0eb4879e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533e970aa91c4c898897efc154172775'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:24.083426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-54aad4b0-4c04-4759-afb8-78cd0eb4879e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533e970aa91c4c898897efc154172775'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:24.084089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-54aad4b0-4c04-4759-afb8-78cd0eb4879e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533e970aa91c4c898897efc154172775'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:24.102472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 842/1691] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:23 2022] DELETE /identity/v3/users/533e970aa91c4c898897efc154172775 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:24.426283 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb77338-0df9-4032-83af-e0c0638d8e57 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:24.426906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb77338-0df9-4032-83af-e0c0638d8e57 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:24.427318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb77338-0df9-4032-83af-e0c0638d8e57 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:24.429321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 850/1692] 10.222.0.73 () {54 vars in 912 bytes} [Wed May 4 13:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:48:24.435049 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc9338-5ad9-4264-bc30-320e7732dd1b None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:24.436352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc9338-5ad9-4264-bc30-320e7732dd1b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:24.436649 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc9338-5ad9-4264-bc30-320e7732dd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:24.459849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-25cc9338-5ad9-4264-bc30-320e7732dd1b None None] MFA Rules not processed for user `963a38e769674dbba95a231e47a7191f`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:24.461554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-25cc9338-5ad9-4264-bc30-320e7732dd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:24.526554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 843/1693] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:48:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:24.538046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb77338-0df9-4032-83af-e0c0638d8e57 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:24.540129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7cb77338-0df9-4032-83af-e0c0638d8e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:24.559312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc9338-5ad9-4264-bc30-320e7732dd1b None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:24.560710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-25cc9338-5ad9-4264-bc30-320e7732dd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:24.562958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb77338-0df9-4032-83af-e0c0638d8e57 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:24.576444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34674b3c-5dec-4892-a7df-122340d59692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:24.577326 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34674b3c-5dec-4892-a7df-122340d59692 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:24.577768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34674b3c-5dec-4892-a7df-122340d59692 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:24.578318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34674b3c-5dec-4892-a7df-122340d59692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:24.588955 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34674b3c-5dec-4892-a7df-122340d59692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:24.590977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34674b3c-5dec-4892-a7df-122340d59692 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:24.613620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 851/1694] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:24.651970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc9338-5ad9-4264-bc30-320e7732dd1b None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:24.657315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5bf1a0-deec-4791-8a3b-7662db9275c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:24.658191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bf1a0-deec-4791-8a3b-7662db9275c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:24.658476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bf1a0-deec-4791-8a3b-7662db9275c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:24.658750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bf1a0-deec-4791-8a3b-7662db9275c5 admin admin] PATH_INFO: `/v3/projects/f141c7f3d1d24521a7265cbdd1daffb8` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:24.660149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5bf1a0-deec-4791-8a3b-7662db9275c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f141c7f3d1d24521a7265cbdd1daffb8)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:24.662065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5bf1a0-deec-4791-8a3b-7662db9275c5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:24.715001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-da5bf1a0-deec-4791-8a3b-7662db9275c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f141c7f3d1d24521a7265cbdd1daffb8', 'request_id': 'req-da5bf1a0-deec-4791-8a3b-7662db9275c5'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:24.724819 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-da5bf1a0-deec-4791-8a3b-7662db9275c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f141c7f3d1d24521a7265cbdd1daffb8', 'request_id': 'req-da5bf1a0-deec-4791-8a3b-7662db9275c5'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:24.734295 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-da5bf1a0-deec-4791-8a3b-7662db9275c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f141c7f3d1d24521a7265cbdd1daffb8', 'request_id': 'req-da5bf1a0-deec-4791-8a3b-7662db9275c5'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:24.746132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-da5bf1a0-deec-4791-8a3b-7662db9275c5 admin admin] The token cache is being invalidate because project f141c7f3d1d24521a7265cbdd1daffb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:24.746476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-da5bf1a0-deec-4791-8a3b-7662db9275c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:24.747150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-da5bf1a0-deec-4791-8a3b-7662db9275c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:24.748981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 844/1695] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:24 2022] DELETE /identity/v3/projects/f141c7f3d1d24521a7265cbdd1daffb8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:24.754282 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a89f-bab6-4638-a0d3-060b83b75f4b None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:24.754573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a89f-bab6-4638-a0d3-060b83b75f4b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:24.754851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63a89f-bab6-4638-a0d3-060b83b75f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:24.775712 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-bd63a89f-bab6-4638-a0d3-060b83b75f4b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:24.778256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-bd63a89f-bab6-4638-a0d3-060b83b75f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:24.848952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 852/1696] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:24.857096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba5929-d9a3-4226-8be7-857bc52c609a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:24.857740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba5929-d9a3-4226-8be7-857bc52c609a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:24.858236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba5929-d9a3-4226-8be7-857bc52c609a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:24.900142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-13ba5929-d9a3-4226-8be7-857bc52c609a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:24.904586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-13ba5929-d9a3-4226-8be7-857bc52c609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:24.919068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 845/1697] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:24.923435 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a89f-bab6-4638-a0d3-060b83b75f4b None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:24.934528 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63a89f-bab6-4638-a0d3-060b83b75f4b None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:24.942776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096963a-d7a8-457f-beaf-521a2a9557d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:24.944272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096963a-d7a8-457f-beaf-521a2a9557d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:24.944754 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096963a-d7a8-457f-beaf-521a2a9557d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:24.945221 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096963a-d7a8-457f-beaf-521a2a9557d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:24.946370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096963a-d7a8-457f-beaf-521a2a9557d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:24.946865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096963a-d7a8-457f-beaf-521a2a9557d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:24.953501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096963a-d7a8-457f-beaf-521a2a9557d5 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:24.988292 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 853/1698] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:48:24.992412 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba5929-d9a3-4226-8be7-857bc52c609a None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:25.004351 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba5929-d9a3-4226-8be7-857bc52c609a None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:25.019301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c71fa-1a32-4721-b2d7-f7e77d50f421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:25.020245 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c71fa-1a32-4721-b2d7-f7e77d50f421 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:25.020808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c71fa-1a32-4721-b2d7-f7e77d50f421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:25.021563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c71fa-1a32-4721-b2d7-f7e77d50f421 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:25.022527 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c71fa-1a32-4721-b2d7-f7e77d50f421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:25.026460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c71fa-1a32-4721-b2d7-f7e77d50f421 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:25.077096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 846/1699] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:24 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:25.081401 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096963a-d7a8-457f-beaf-521a2a9557d5 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:25.106709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c71fa-1a32-4721-b2d7-f7e77d50f421 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:25.107859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096963a-d7a8-457f-beaf-521a2a9557d5 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:25.109333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-aa3c71fa-1a32-4721-b2d7-f7e77d50f421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:25.218251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a1cb-b3d0-4000-bddb-89921b1eb450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:25.219474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a1cb-b3d0-4000-bddb-89921b1eb450 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:25.220035 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a1cb-b3d0-4000-bddb-89921b1eb450 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:25.220604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a1cb-b3d0-4000-bddb-89921b1eb450 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:25.222322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4a1cb-b3d0-4000-bddb-89921b1eb450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:25.232212 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4a1cb-b3d0-4000-bddb-89921b1eb450 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:25.273297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 854/1700] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:25 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:25.274553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a1cb-b3d0-4000-bddb-89921b1eb450 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:25.286588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c71fa-1a32-4721-b2d7-f7e77d50f421 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:25.288220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a1cb-b3d0-4000-bddb-89921b1eb450 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:25.292000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7848cd8-161f-430a-a75e-e525bff96a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:25.292839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7848cd8-161f-430a-a75e-e525bff96a7c service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:25.293381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7848cd8-161f-430a-a75e-e525bff96a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:25.294404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7848cd8-161f-430a-a75e-e525bff96a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:25.294960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879619bf-a50c-464c-8e78-ec0325f77a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:25.295815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879619bf-a50c-464c-8e78-ec0325f77a97 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:25.296322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879619bf-a50c-464c-8e78-ec0325f77a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:25.296796 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879619bf-a50c-464c-8e78-ec0325f77a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:25.298988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879619bf-a50c-464c-8e78-ec0325f77a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:25.301733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879619bf-a50c-464c-8e78-ec0325f77a97 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:25.302376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b7848cd8-161f-430a-a75e-e525bff96a7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:25.330039 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 855/1701] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:25.331475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879619bf-a50c-464c-8e78-ec0325f77a97 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:25.348126 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879619bf-a50c-464c-8e78-ec0325f77a97 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:25.366889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7024f-1d0b-42df-8d45-f54fd786834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:25.367634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7024f-1d0b-42df-8d45-f54fd786834e admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:25.368107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7024f-1d0b-42df-8d45-f54fd786834e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:25.368776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7024f-1d0b-42df-8d45-f54fd786834e admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:25.369696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7024f-1d0b-42df-8d45-f54fd786834e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:25.385598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7024f-1d0b-42df-8d45-f54fd786834e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:25.417372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 856/1702] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:25.425533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b720cc7-7561-4692-a8a0-d5d3edf89071 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:25.430442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b720cc7-7561-4692-a8a0-d5d3edf89071 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:25.430597 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b720cc7-7561-4692-a8a0-d5d3edf89071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:25.514274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7848cd8-161f-430a-a75e-e525bff96a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:25.519570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7848cd8-161f-430a-a75e-e525bff96a7c service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:25.560452 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 847/1703] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:25.561711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7848cd8-161f-430a-a75e-e525bff96a7c service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:25.602389 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7848cd8-161f-430a-a75e-e525bff96a7c service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:25.621504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dee8c3-c4ce-4e69-b0ae-8ee815636473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:25.623840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dee8c3-c4ce-4e69-b0ae-8ee815636473 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:25.626293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dee8c3-c4ce-4e69-b0ae-8ee815636473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:25.626696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dee8c3-c4ce-4e69-b0ae-8ee815636473 admin admin] PATH_INFO: `/v3/projects/cd2c0176e26e44a8b6a729af849a52aa/users/56189d96d60341acb62a5ccd01f1f2c5/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:25.661778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-0b720cc7-7561-4692-a8a0-d5d3edf89071 None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:25.662093 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dee8c3-c4ce-4e69-b0ae-8ee815636473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2c0176e26e44a8b6a729af849a52aa, user_id=56189d96d60341acb62a5ccd01f1f2c5, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:25.663026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0b720cc7-7561-4692-a8a0-d5d3edf89071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:25.665312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dee8c3-c4ce-4e69-b0ae-8ee815636473 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:25.700707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 848/1704] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:25 2022] PUT /identity/v3/projects/cd2c0176e26e44a8b6a729af849a52aa/users/56189d96d60341acb62a5ccd01f1f2c5/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:25.712646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4344cff-6a44-4817-8875-dda8873b9994 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:25.713801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4344cff-6a44-4817-8875-dda8873b9994 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:25.714315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4344cff-6a44-4817-8875-dda8873b9994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:25.760432 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-a4344cff-6a44-4817-8875-dda8873b9994 None None] MFA Rules not processed for user `56189d96d60341acb62a5ccd01f1f2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:25.761963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a4344cff-6a44-4817-8875-dda8873b9994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:25.848646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 857/1705] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:48:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:25.864865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b720cc7-7561-4692-a8a0-d5d3edf89071 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:25.867186 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0b720cc7-7561-4692-a8a0-d5d3edf89071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:25.917146 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b720cc7-7561-4692-a8a0-d5d3edf89071 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:25.996111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 849/1706] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:25.997571 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4344cff-6a44-4817-8875-dda8873b9994 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:26.090817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:26.092055 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:26.092785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:26.093486 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] PATH_INFO: `/v3/users/1e1d4240e6b346e7b3817fc0b70deb95` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:26.096891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1d4240e6b346e7b3817fc0b70deb95)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:26.099021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:26.123742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4344cff-6a44-4817-8875-dda8873b9994 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:26.139497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cf97e-bcb0-4e5f-b65f-d7b4efd80394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:26.140828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cf97e-bcb0-4e5f-b65f-d7b4efd80394 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:26.141349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cf97e-bcb0-4e5f-b65f-d7b4efd80394 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:26.141827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cf97e-bcb0-4e5f-b65f-d7b4efd80394 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:26.143385 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cf97e-bcb0-4e5f-b65f-d7b4efd80394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:26.146246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cf97e-bcb0-4e5f-b65f-d7b4efd80394 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:26.190008 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 850/1707] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:25 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:26.191853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cf97e-bcb0-4e5f-b65f-d7b4efd80394 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:26.201574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-739cf97e-bcb0-4e5f-b65f-d7b4efd80394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:26.217684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1d4240e6b346e7b3817fc0b70deb95'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:26.241868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1d4240e6b346e7b3817fc0b70deb95'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:26.242353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1d4240e6b346e7b3817fc0b70deb95'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:26.258453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1d4240e6b346e7b3817fc0b70deb95'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:26.286263 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1d4240e6b346e7b3817fc0b70deb95'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:26.299075 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 858/1708] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:25 2022] DELETE /identity/v3/users/1e1d4240e6b346e7b3817fc0b70deb95 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:26.301203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:26.305470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:26.336853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cf97e-bcb0-4e5f-b65f-d7b4efd80394 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:26.454688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2ad03-b64a-49d9-a0f9-f1bee09adfe6 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:26.458651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933024ef-1053-4f7f-b545-ed7ece665a2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:26.459531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933024ef-1053-4f7f-b545-ed7ece665a2f service swift] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:26.460331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a6c52-0a00-49ac-b876-0441e2a3a540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:26.461323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a6c52-0a00-49ac-b876-0441e2a3a540 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:26.461582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a6c52-0a00-49ac-b876-0441e2a3a540 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:26.461915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a6c52-0a00-49ac-b876-0441e2a3a540 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:26.462619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a6c52-0a00-49ac-b876-0441e2a3a540 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:26.463092 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933024ef-1053-4f7f-b545-ed7ece665a2f service swift] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:26.463686 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933024ef-1053-4f7f-b545-ed7ece665a2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:26.464702 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a6c52-0a00-49ac-b876-0441e2a3a540 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:26.470285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-933024ef-1053-4f7f-b545-ed7ece665a2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:26.498865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 859/1709] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:26 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:26.501068 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f224e-d54a-41ea-be36-ace69a15847a None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:26.501202 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f224e-d54a-41ea-be36-ace69a15847a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:26.501485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f224e-d54a-41ea-be36-ace69a15847a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:26.555198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d29f224e-d54a-41ea-be36-ace69a15847a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:26.556389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d29f224e-d54a-41ea-be36-ace69a15847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:26.579150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 860/1710] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:26.580060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f224e-d54a-41ea-be36-ace69a15847a None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:26.601125 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f224e-d54a-41ea-be36-ace69a15847a None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:26.613867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933024ef-1053-4f7f-b545-ed7ece665a2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:26.616043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933024ef-1053-4f7f-b545-ed7ece665a2f service swift] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:26.619939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a8790-6629-476c-82ad-66a3ca4ff4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:26.620641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a8790-6629-476c-82ad-66a3ca4ff4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:26.620926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a8790-6629-476c-82ad-66a3ca4ff4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:26.621230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a8790-6629-476c-82ad-66a3ca4ff4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:26.622348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a8790-6629-476c-82ad-66a3ca4ff4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:26.626007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a8790-6629-476c-82ad-66a3ca4ff4f1 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:26.646931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 851/1711] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:48:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:48:26.651664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933024ef-1053-4f7f-b545-ed7ece665a2f service swift] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:26.666767 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-933024ef-1053-4f7f-b545-ed7ece665a2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:26.673694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 861/1712] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:26.681696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a8790-6629-476c-82ad-66a3ca4ff4f1 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:26.726877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a8790-6629-476c-82ad-66a3ca4ff4f1 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:26.753053 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157d547-2026-409f-9c86-3cac7fae95a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:26.757158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157d547-2026-409f-9c86-3cac7fae95a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:26.759650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157d547-2026-409f-9c86-3cac7fae95a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:26.761986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157d547-2026-409f-9c86-3cac7fae95a5 admin admin] PATH_INFO: `/v3/projects/b2b0c30fa9f14ea585d69fd691950493/users/648af030b6ac459e8f2d084f58b961ef/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:26.800279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933024ef-1053-4f7f-b545-ed7ece665a2f service swift] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:26.804914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580478b-5f9c-42b1-bac2-10a68a74aa61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:26.805577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580478b-5f9c-42b1-bac2-10a68a74aa61 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:26.806008 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580478b-5f9c-42b1-bac2-10a68a74aa61 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:26.806221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580478b-5f9c-42b1-bac2-10a68a74aa61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:26.820152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580478b-5f9c-42b1-bac2-10a68a74aa61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:26.820379 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580478b-5f9c-42b1-bac2-10a68a74aa61 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:26.830329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157d547-2026-409f-9c86-3cac7fae95a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b0c30fa9f14ea585d69fd691950493, user_id=648af030b6ac459e8f2d084f58b961ef, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:26.832405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 852/1713] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:26.848644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157d547-2026-409f-9c86-3cac7fae95a5 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:26.897001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 862/1714] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:26 2022] PUT /identity/v3/projects/b2b0c30fa9f14ea585d69fd691950493/users/648af030b6ac459e8f2d084f58b961ef/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:26.901725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580478b-5f9c-42b1-bac2-10a68a74aa61 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:26.928777 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580478b-5f9c-42b1-bac2-10a68a74aa61 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:27.081809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0c109-78ca-438c-b30b-0e59c9214085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:27.082900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0c109-78ca-438c-b30b-0e59c9214085 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.083374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0c109-78ca-438c-b30b-0e59c9214085 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.083806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0c109-78ca-438c-b30b-0e59c9214085 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.084683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0c109-78ca-438c-b30b-0e59c9214085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:27.086628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0c109-78ca-438c-b30b-0e59c9214085 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:27.099385 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 853/1715] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:27.103112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157d547-2026-409f-9c86-3cac7fae95a5 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:27.115576 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157d547-2026-409f-9c86-3cac7fae95a5 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:27.121961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd1c7-1f21-433b-bfbd-e693ea946212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:27.122867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd1c7-1f21-433b-bfbd-e693ea946212 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.123174 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd1c7-1f21-433b-bfbd-e693ea946212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.123506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd1c7-1f21-433b-bfbd-e693ea946212 admin admin] PATH_INFO: `/v3/projects/b2b0c30fa9f14ea585d69fd691950493/users/648af030b6ac459e8f2d084f58b961ef/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.129035 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fd1c7-1f21-433b-bfbd-e693ea946212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b0c30fa9f14ea585d69fd691950493, user_id=648af030b6ac459e8f2d084f58b961ef, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:27.132002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fd1c7-1f21-433b-bfbd-e693ea946212 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:27.144294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 863/1716] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:27 2022] PUT /identity/v3/projects/b2b0c30fa9f14ea585d69fd691950493/users/648af030b6ac459e8f2d084f58b961ef/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:27.156342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890c9a6-d341-46a2-b34b-f40b18621637 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.157249 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890c9a6-d341-46a2-b34b-f40b18621637 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.157702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890c9a6-d341-46a2-b34b-f40b18621637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.188230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-9890c9a6-d341-46a2-b34b-f40b18621637 None None] MFA Rules not processed for user `648af030b6ac459e8f2d084f58b961ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:27.190283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9890c9a6-d341-46a2-b34b-f40b18621637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:27.297165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 854/1717] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:27.308416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd1c7-1f21-433b-bfbd-e693ea946212 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:27.310162 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-257fd1c7-1f21-433b-bfbd-e693ea946212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:27.388403 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890c9a6-d341-46a2-b34b-f40b18621637 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:27.391123 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9890c9a6-d341-46a2-b34b-f40b18621637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:27.426405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd1c7-1f21-433b-bfbd-e693ea946212 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:27.431328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2f57e-d26e-4e17-bd9b-d8266431624b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:27.432714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2f57e-d26e-4e17-bd9b-d8266431624b service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.433206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2f57e-d26e-4e17-bd9b-d8266431624b service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.433546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2f57e-d26e-4e17-bd9b-d8266431624b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.447471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2f57e-d26e-4e17-bd9b-d8266431624b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:27.449655 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2f57e-d26e-4e17-bd9b-d8266431624b service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:27.466383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 864/1718] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:27.477508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890c9a6-d341-46a2-b34b-f40b18621637 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:27.482344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb817fd-8f98-47a0-a8ed-62ea041fc718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:27.483468 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb817fd-8f98-47a0-a8ed-62ea041fc718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.483758 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb817fd-8f98-47a0-a8ed-62ea041fc718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.484044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb817fd-8f98-47a0-a8ed-62ea041fc718 admin admin] PATH_INFO: `/v3/projects/7f0a4bc817ae4546ac2c281eb568cb71` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.485375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb817fd-8f98-47a0-a8ed-62ea041fc718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0a4bc817ae4546ac2c281eb568cb71)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:27.487463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb817fd-8f98-47a0-a8ed-62ea041fc718 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:27.496753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2f57e-d26e-4e17-bd9b-d8266431624b service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:27.507999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2f57e-d26e-4e17-bd9b-d8266431624b service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:27.512840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:27.513832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.514206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.514577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] PATH_INFO: `/v3/users/56189d96d60341acb62a5ccd01f1f2c5` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.515918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56189d96d60341acb62a5ccd01f1f2c5)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:27.518236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:27.570147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-9fb817fd-8f98-47a0-a8ed-62ea041fc718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0a4bc817ae4546ac2c281eb568cb71', 'request_id': 'req-9fb817fd-8f98-47a0-a8ed-62ea041fc718'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.585398 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-9fb817fd-8f98-47a0-a8ed-62ea041fc718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0a4bc817ae4546ac2c281eb568cb71', 'request_id': 'req-9fb817fd-8f98-47a0-a8ed-62ea041fc718'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.595132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-9fb817fd-8f98-47a0-a8ed-62ea041fc718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0a4bc817ae4546ac2c281eb568cb71', 'request_id': 'req-9fb817fd-8f98-47a0-a8ed-62ea041fc718'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.607912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-9fb817fd-8f98-47a0-a8ed-62ea041fc718 admin admin] The token cache is being invalidate because project 7f0a4bc817ae4546ac2c281eb568cb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:27.609208 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-9fb817fd-8f98-47a0-a8ed-62ea041fc718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.609629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-9fb817fd-8f98-47a0-a8ed-62ea041fc718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.612198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56189d96d60341acb62a5ccd01f1f2c5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.613160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 855/1719] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:27 2022] DELETE /identity/v3/projects/7f0a4bc817ae4546ac2c281eb568cb71 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:27.617905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e8e1c-6b63-4b3d-a1e2-f43209ea4b0c None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.618538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e8e1c-6b63-4b3d-a1e2-f43209ea4b0c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.618849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e8e1c-6b63-4b3d-a1e2-f43209ea4b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.632805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56189d96d60341acb62a5ccd01f1f2c5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.633866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56189d96d60341acb62a5ccd01f1f2c5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.644515 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56189d96d60341acb62a5ccd01f1f2c5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.647611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-9e4e8e1c-6b63-4b3d-a1e2-f43209ea4b0c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:27.649046 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9e4e8e1c-6b63-4b3d-a1e2-f43209ea4b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:27.661414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56189d96d60341acb62a5ccd01f1f2c5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.670984 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 865/1720] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:27 2022] DELETE /identity/v3/users/56189d96d60341acb62a5ccd01f1f2c5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:27.672203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:27.673567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:27.730688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 856/1721] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:27.733455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c12ea6-5ec7-48c8-a451-4999129f1593 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.733870 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c12ea6-5ec7-48c8-a451-4999129f1593 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.734514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c12ea6-5ec7-48c8-a451-4999129f1593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.754358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-07c12ea6-5ec7-48c8-a451-4999129f1593 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:27.755592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-07c12ea6-5ec7-48c8-a451-4999129f1593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:27.761739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b9973-be65-477c-a41a-2cd6ee58b477 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:27.764588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 857/1722] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:27.765860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11487cc7-1ff2-43db-a226-f10cc51db1ab None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.766262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11487cc7-1ff2-43db-a226-f10cc51db1ab None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.766569 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11487cc7-1ff2-43db-a226-f10cc51db1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.775177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:27.776571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.776957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.777243 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] PATH_INFO: `/v3/users/f97f8fe6fc124c0c8213c5b18b558bfc` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.778628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97f8fe6fc124c0c8213c5b18b558bfc)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:27.781286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:27.788844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-11487cc7-1ff2-43db-a226-f10cc51db1ab None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:27.788844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-11487cc7-1ff2-43db-a226-f10cc51db1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:27.796129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 858/1723] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:27.801958 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11487cc7-1ff2-43db-a226-f10cc51db1ab None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:27.804254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-11487cc7-1ff2-43db-a226-f10cc51db1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:27.844175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97f8fe6fc124c0c8213c5b18b558bfc'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.853405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97f8fe6fc124c0c8213c5b18b558bfc'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.854109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97f8fe6fc124c0c8213c5b18b558bfc'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.861698 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97f8fe6fc124c0c8213c5b18b558bfc'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.869212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11487cc7-1ff2-43db-a226-f10cc51db1ab None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:27.872816 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de05b8-a106-4a23-821a-779480ac65cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:27.873466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de05b8-a106-4a23-821a-779480ac65cd service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.873747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de05b8-a106-4a23-821a-779480ac65cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.873925 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97f8fe6fc124c0c8213c5b18b558bfc'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:27.874024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de05b8-a106-4a23-821a-779480ac65cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.875775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a3de05b8-a106-4a23-821a-779480ac65cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:27.880424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 866/1724] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:27 2022] DELETE /identity/v3/users/f97f8fe6fc124c0c8213c5b18b558bfc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:27.881203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:27.882661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:27.888210 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de05b8-a106-4a23-821a-779480ac65cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:27.889652 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de05b8-a106-4a23-821a-779480ac65cd service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:27.898984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 859/1725] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:27.900097 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927277b-f4d8-4583-beea-05a31c86e61c None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.900378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927277b-f4d8-4583-beea-05a31c86e61c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.900656 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927277b-f4d8-4583-beea-05a31c86e61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.918604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-8927277b-f4d8-4583-beea-05a31c86e61c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:27.919835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8927277b-f4d8-4583-beea-05a31c86e61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:27.949781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa279a-983b-4777-ba58-47394c6f9a8a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:27.955232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34afdd-97c7-4716-8007-a47a0b810dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:27.955897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34afdd-97c7-4716-8007-a47a0b810dee admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.956190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34afdd-97c7-4716-8007-a47a0b810dee admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.956462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34afdd-97c7-4716-8007-a47a0b810dee admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.957191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34afdd-97c7-4716-8007-a47a0b810dee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:27.957497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34afdd-97c7-4716-8007-a47a0b810dee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:27.959080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34afdd-97c7-4716-8007-a47a0b810dee admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:27.971822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 867/1726] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:27.977479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34afdd-97c7-4716-8007-a47a0b810dee admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:27.989159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34afdd-97c7-4716-8007-a47a0b810dee admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:27.992905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 860/1727] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:27.996679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884bd56-2d4c-448c-99a1-8ef0656bb5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:27.997407 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884bd56-2d4c-448c-99a1-8ef0656bb5da admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:27.997695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884bd56-2d4c-448c-99a1-8ef0656bb5da admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:27.997969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884bd56-2d4c-448c-99a1-8ef0656bb5da admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:27.998661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884bd56-2d4c-448c-99a1-8ef0656bb5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:28.000635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884bd56-2d4c-448c-99a1-8ef0656bb5da admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:28.004392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927277b-f4d8-4583-beea-05a31c86e61c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:28.005996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8927277b-f4d8-4583-beea-05a31c86e61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:28.029816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 868/1728] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:27 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:28.033386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884bd56-2d4c-448c-99a1-8ef0656bb5da admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:28.069398 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927277b-f4d8-4583-beea-05a31c86e61c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:28.098153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884bd56-2d4c-448c-99a1-8ef0656bb5da admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:28.103577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b5cc5-d2fb-4083-b5ff-12fa5e92aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:28.104253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b5cc5-d2fb-4083-b5ff-12fa5e92aa3b admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.104535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b5cc5-d2fb-4083-b5ff-12fa5e92aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.104812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b5cc5-d2fb-4083-b5ff-12fa5e92aa3b admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.105507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b5cc5-d2fb-4083-b5ff-12fa5e92aa3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:28.107448 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b5cc5-d2fb-4083-b5ff-12fa5e92aa3b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:28.122255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b10e4f-4f84-4bb3-a724-749e5acc90a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:28.122955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b10e4f-4f84-4bb3-a724-749e5acc90a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.123259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b10e4f-4f84-4bb3-a724-749e5acc90a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.123540 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b10e4f-4f84-4bb3-a724-749e5acc90a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.128547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 869/1729] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:28 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:28.132607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b5cc5-d2fb-4083-b5ff-12fa5e92aa3b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:28.135919 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b10e4f-4f84-4bb3-a724-749e5acc90a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:28.137681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b10e4f-4f84-4bb3-a724-749e5acc90a4 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:28.142337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b5cc5-d2fb-4083-b5ff-12fa5e92aa3b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:28.147436 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2061c7e-0556-49a6-b7e1-f02649da8e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:28.147597 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 861/1730] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:28.148159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2061c7e-0556-49a6-b7e1-f02649da8e5a admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.148439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2061c7e-0556-49a6-b7e1-f02649da8e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.148709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2061c7e-0556-49a6-b7e1-f02649da8e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.149475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2061c7e-0556-49a6-b7e1-f02649da8e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:28.151072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2061c7e-0556-49a6-b7e1-f02649da8e5a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:28.161706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 870/1731] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:48:28.165473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b10e4f-4f84-4bb3-a724-749e5acc90a4 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:28.175969 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b10e4f-4f84-4bb3-a724-749e5acc90a4 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:28.181129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7813ec-b16c-42aa-b923-87d16326f960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:28.181642 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7813ec-b16c-42aa-b923-87d16326f960 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.181780 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7813ec-b16c-42aa-b923-87d16326f960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.182047 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7813ec-b16c-42aa-b923-87d16326f960 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.182769 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7813ec-b16c-42aa-b923-87d16326f960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:28.184447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7813ec-b16c-42aa-b923-87d16326f960 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:28.197265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 862/1732] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:28.201511 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2061c7e-0556-49a6-b7e1-f02649da8e5a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:28.211828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2061c7e-0556-49a6-b7e1-f02649da8e5a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:28.212259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7813ec-b16c-42aa-b923-87d16326f960 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:28.213973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4f7813ec-b16c-42aa-b923-87d16326f960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:28.217317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23393574-4896-4dd0-9534-aed0c95ef0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:28.218816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23393574-4896-4dd0-9534-aed0c95ef0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.218816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23393574-4896-4dd0-9534-aed0c95ef0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.218997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23393574-4896-4dd0-9534-aed0c95ef0ce admin admin] PATH_INFO: `/v3/projects/c40f0d265ae34d4f8d3d5d02b981d6a5/users/dd2ac4030b0b4bd69901e079f0d02efd/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.227109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7813ec-b16c-42aa-b923-87d16326f960 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:28.239147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:28.240338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.240615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.241198 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] PATH_INFO: `/v3/projects/cd2c0176e26e44a8b6a729af849a52aa` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.242103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2c0176e26e44a8b6a729af849a52aa)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:28.244088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:28.255811 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23393574-4896-4dd0-9534-aed0c95ef0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40f0d265ae34d4f8d3d5d02b981d6a5, user_id=dd2ac4030b0b4bd69901e079f0d02efd, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:28.259913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23393574-4896-4dd0-9534-aed0c95ef0ce admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:28.277126 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 871/1733] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:28 2022] PUT /identity/v3/projects/c40f0d265ae34d4f8d3d5d02b981d6a5/users/dd2ac4030b0b4bd69901e079f0d02efd/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:28.289204 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a90168-d6e9-4721-8fa8-153301dfa139 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.289497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a90168-d6e9-4721-8fa8-153301dfa139 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.289771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a90168-d6e9-4721-8fa8-153301dfa139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.317056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2c0176e26e44a8b6a729af849a52aa', 'request_id': 'req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.322240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b3a90168-d6e9-4721-8fa8-153301dfa139 None None] MFA Rules not processed for user `dd2ac4030b0b4bd69901e079f0d02efd`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:28.323550 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b3a90168-d6e9-4721-8fa8-153301dfa139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:28.328460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2c0176e26e44a8b6a729af849a52aa', 'request_id': 'req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.351678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2c0176e26e44a8b6a729af849a52aa', 'request_id': 'req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.370248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] The token cache is being invalidate because project cd2c0176e26e44a8b6a729af849a52aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:28.370794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.371492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.373281 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 863/1734] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:28 2022] DELETE /identity/v3/projects/cd2c0176e26e44a8b6a729af849a52aa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:28.377622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:28.380695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:28.450136 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 872/1735] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:28.461484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a90168-d6e9-4721-8fa8-153301dfa139 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:28.463386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b3a90168-d6e9-4721-8fa8-153301dfa139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:28.506407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb6ef8-9687-4350-b3bb-1d69619a0ba5 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:28.511277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:28.512153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.512430 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.512726 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] PATH_INFO: `/v3/users/648af030b6ac459e8f2d084f58b961ef` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.513910 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=648af030b6ac459e8f2d084f58b961ef)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:28.515848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:28.542888 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a90168-d6e9-4721-8fa8-153301dfa139 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:28.547589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47117d34-1805-4dc4-a27b-2310ce3ccda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:28.548259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47117d34-1805-4dc4-a27b-2310ce3ccda8 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.548539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47117d34-1805-4dc4-a27b-2310ce3ccda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.548822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47117d34-1805-4dc4-a27b-2310ce3ccda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.549508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47117d34-1805-4dc4-a27b-2310ce3ccda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:28.551585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47117d34-1805-4dc4-a27b-2310ce3ccda8 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:28.561658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648af030b6ac459e8f2d084f58b961ef'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.568933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648af030b6ac459e8f2d084f58b961ef'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.575820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648af030b6ac459e8f2d084f58b961ef'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.576457 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648af030b6ac459e8f2d084f58b961ef'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.576581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 873/1736] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:28 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:28.577476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47117d34-1805-4dc4-a27b-2310ce3ccda8 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:28.579916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648af030b6ac459e8f2d084f58b961ef'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.580813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-47117d34-1805-4dc4-a27b-2310ce3ccda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:28.598415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 864/1737] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:28 2022] DELETE /identity/v3/users/648af030b6ac459e8f2d084f58b961ef => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:28.599308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:28.600742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:28.704392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47117d34-1805-4dc4-a27b-2310ce3ccda8 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:28.744969 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bce4e-a134-45bd-b0a7-d8a5cc067642 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:28.753242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d928e6-1167-4d3f-8c69-6d44824b3c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:28.754397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d928e6-1167-4d3f-8c69-6d44824b3c2b admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.754867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d928e6-1167-4d3f-8c69-6d44824b3c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.755461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d928e6-1167-4d3f-8c69-6d44824b3c2b admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.756859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d928e6-1167-4d3f-8c69-6d44824b3c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:28.759594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d928e6-1167-4d3f-8c69-6d44824b3c2b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:28.786958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb00d4-2e64-40fb-818e-aa73037541c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:28.787979 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb00d4-2e64-40fb-818e-aa73037541c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.788271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb00d4-2e64-40fb-818e-aa73037541c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.788605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb00d4-2e64-40fb-818e-aa73037541c2 admin admin] PATH_INFO: `/v3/projects/1640d983430c4897920bf0e36861ff87` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.793658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb00d4-2e64-40fb-818e-aa73037541c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1640d983430c4897920bf0e36861ff87)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:28.800699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 865/1738] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:28 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:28.800992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb00d4-2e64-40fb-818e-aa73037541c2 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:28.801818 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d928e6-1167-4d3f-8c69-6d44824b3c2b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:28.820415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d928e6-1167-4d3f-8c69-6d44824b3c2b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:28.826189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81582c6e-f155-4873-8968-d728fc09b568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:28.827191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81582c6e-f155-4873-8968-d728fc09b568 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.827510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81582c6e-f155-4873-8968-d728fc09b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.827784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81582c6e-f155-4873-8968-d728fc09b568 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.828655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81582c6e-f155-4873-8968-d728fc09b568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:28.830172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81582c6e-f155-4873-8968-d728fc09b568 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:28.855885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 866/1739] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:28.864871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81582c6e-f155-4873-8968-d728fc09b568 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:28.886321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-36cb00d4-2e64-40fb-818e-aa73037541c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1640d983430c4897920bf0e36861ff87', 'request_id': 'req-36cb00d4-2e64-40fb-818e-aa73037541c2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.889392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81582c6e-f155-4873-8968-d728fc09b568 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:28.898399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-36cb00d4-2e64-40fb-818e-aa73037541c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1640d983430c4897920bf0e36861ff87', 'request_id': 'req-36cb00d4-2e64-40fb-818e-aa73037541c2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.910768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-36cb00d4-2e64-40fb-818e-aa73037541c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1640d983430c4897920bf0e36861ff87', 'request_id': 'req-36cb00d4-2e64-40fb-818e-aa73037541c2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.929435 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-36cb00d4-2e64-40fb-818e-aa73037541c2 admin admin] The token cache is being invalidate because project 1640d983430c4897920bf0e36861ff87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:28.929744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-36cb00d4-2e64-40fb-818e-aa73037541c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.930794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-36cb00d4-2e64-40fb-818e-aa73037541c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:28.932675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 874/1740] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:28 2022] DELETE /identity/v3/projects/1640d983430c4897920bf0e36861ff87 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:28.937912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fd508-4555-4e10-88d1-745882f5a08e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:28.938266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fd508-4555-4e10-88d1-745882f5a08e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:28.938601 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fd508-4555-4e10-88d1-745882f5a08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:28.963092 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-c39fd508-4555-4e10-88d1-745882f5a08e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:28.964319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c39fd508-4555-4e10-88d1-745882f5a08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:29.044276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f18e71-33c5-42d9-817d-dedb3cc5e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:29.046152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f18e71-33c5-42d9-817d-dedb3cc5e2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.046439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f18e71-33c5-42d9-817d-dedb3cc5e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.046718 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f18e71-33c5-42d9-817d-dedb3cc5e2ff admin admin] PATH_INFO: `/v3/projects/5b2ffba4a3d44e3cb684d14168a5e712/users/8cc715f27ac14fc7a1aa54268693c9e7/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.092051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f18e71-33c5-42d9-817d-dedb3cc5e2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2ffba4a3d44e3cb684d14168a5e712, user_id=8cc715f27ac14fc7a1aa54268693c9e7, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:29.106614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f18e71-33c5-42d9-817d-dedb3cc5e2ff admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:29.108026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 875/1741] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:29.110612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3ada7-ef20-455a-8c74-c038867df608 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.111596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3ada7-ef20-455a-8c74-c038867df608 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.112256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3ada7-ef20-455a-8c74-c038867df608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.124232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 867/1742] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:28 2022] PUT /identity/v3/projects/5b2ffba4a3d44e3cb684d14168a5e712/users/8cc715f27ac14fc7a1aa54268693c9e7/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:29.130075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f18e71-33c5-42d9-817d-dedb3cc5e2ff admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:29.136428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-17f18e71-33c5-42d9-817d-dedb3cc5e2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:29.139626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-5ea3ada7-ef20-455a-8c74-c038867df608 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:29.141406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5ea3ada7-ef20-455a-8c74-c038867df608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:29.240043 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 876/1743] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:29.240043 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3ada7-ef20-455a-8c74-c038867df608 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:29.242896 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5ea3ada7-ef20-455a-8c74-c038867df608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:29.252228 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f18e71-33c5-42d9-817d-dedb3cc5e2ff admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:29.257292 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3ada7-ef20-455a-8c74-c038867df608 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:29.258229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b86f5-79ca-49db-bc2d-37a80af93bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:29.259262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b86f5-79ca-49db-bc2d-37a80af93bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.259574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b86f5-79ca-49db-bc2d-37a80af93bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.259916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b86f5-79ca-49db-bc2d-37a80af93bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.260736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b86f5-79ca-49db-bc2d-37a80af93bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:29.262436 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b86f5-79ca-49db-bc2d-37a80af93bb7 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:29.264094 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:29.265136 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.265656 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.265928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] PATH_INFO: `/v3/projects/b2b0c30fa9f14ea585d69fd691950493` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.267161 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b0c30fa9f14ea585d69fd691950493)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:29.269191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:29.279465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 868/1744] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:29.280594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b86f5-79ca-49db-bc2d-37a80af93bb7 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:29.300139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b86f5-79ca-49db-bc2d-37a80af93bb7 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:29.312230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b656f7-ee29-4d1f-be63-7700c59e4b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:29.312948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b656f7-ee29-4d1f-be63-7700c59e4b7d admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.313207 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b656f7-ee29-4d1f-be63-7700c59e4b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.313759 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b656f7-ee29-4d1f-be63-7700c59e4b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.314448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b656f7-ee29-4d1f-be63-7700c59e4b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:29.317835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b656f7-ee29-4d1f-be63-7700c59e4b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:29.320237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b656f7-ee29-4d1f-be63-7700c59e4b7d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:29.335934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b0c30fa9f14ea585d69fd691950493', 'request_id': 'req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:29.343353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 869/1745] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:29.343353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b656f7-ee29-4d1f-be63-7700c59e4b7d admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:29.343838 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b0c30fa9f14ea585d69fd691950493', 'request_id': 'req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:29.356573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b0c30fa9f14ea585d69fd691950493', 'request_id': 'req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:29.358522 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b656f7-ee29-4d1f-be63-7700c59e4b7d admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:29.369705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] The token cache is being invalidate because project b2b0c30fa9f14ea585d69fd691950493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:29.369998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:29.370785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:29.376961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 877/1746] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:29 2022] DELETE /identity/v3/projects/b2b0c30fa9f14ea585d69fd691950493 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:29.378541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:29.380275 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:29.472565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28639d43-9f65-4a10-8bb8-b2b6346cd170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:29.473479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28639d43-9f65-4a10-8bb8-b2b6346cd170 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.473990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28639d43-9f65-4a10-8bb8-b2b6346cd170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.474286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28639d43-9f65-4a10-8bb8-b2b6346cd170 admin admin] PATH_INFO: `/v3/projects/5b2ffba4a3d44e3cb684d14168a5e712/users/8cc715f27ac14fc7a1aa54268693c9e7/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.477489 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28639d43-9f65-4a10-8bb8-b2b6346cd170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2ffba4a3d44e3cb684d14168a5e712, user_id=8cc715f27ac14fc7a1aa54268693c9e7, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:29.481686 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28639d43-9f65-4a10-8bb8-b2b6346cd170 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:29.512182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 870/1747] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:29 2022] PUT /identity/v3/projects/5b2ffba4a3d44e3cb684d14168a5e712/users/8cc715f27ac14fc7a1aa54268693c9e7/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:29.513563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04f198-200b-44ad-af6c-4c13a3d6b06d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.513960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04f198-200b-44ad-af6c-4c13a3d6b06d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.518285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04f198-200b-44ad-af6c-4c13a3d6b06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.523346 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecbfa25-e173-4d39-8382-e0c638cc3bc3 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:29.558000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-4d04f198-200b-44ad-af6c-4c13a3d6b06d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:29.559560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4d04f198-200b-44ad-af6c-4c13a3d6b06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:29.608980 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a89e9-7025-49d8-ba5f-dfe5be0d0117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:29.610458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a89e9-7025-49d8-ba5f-dfe5be0d0117 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.610828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a89e9-7025-49d8-ba5f-dfe5be0d0117 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.611172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a89e9-7025-49d8-ba5f-dfe5be0d0117 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.612860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a89e9-7025-49d8-ba5f-dfe5be0d0117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:29.616913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a89e9-7025-49d8-ba5f-dfe5be0d0117 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:29.639716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 871/1748] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:29.641130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83b42-7ab8-4771-98f0-11c6aa121772 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.641353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83b42-7ab8-4771-98f0-11c6aa121772 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.641627 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83b42-7ab8-4771-98f0-11c6aa121772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.654781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 878/1749] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:29 2022] POST /identity/v3/projects => generated 365 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:29.656454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065cf32-19f7-4b87-865c-2d729100286f None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.656934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065cf32-19f7-4b87-865c-2d729100286f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.657364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065cf32-19f7-4b87-865c-2d729100286f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.690105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-efa83b42-7ab8-4771-98f0-11c6aa121772 None None] MFA Rules not processed for user `8cc715f27ac14fc7a1aa54268693c9e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:29.693580 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-efa83b42-7ab8-4771-98f0-11c6aa121772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:29.698975 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-0065cf32-19f7-4b87-865c-2d729100286f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:29.700823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0065cf32-19f7-4b87-865c-2d729100286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:29.809935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 872/1750] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:29.811059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa83b42-7ab8-4771-98f0-11c6aa121772 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:29.823951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 879/1751] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:29.834968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa83b42-7ab8-4771-98f0-11c6aa121772 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:29.840492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065cf32-19f7-4b87-865c-2d729100286f None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:29.842657 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0065cf32-19f7-4b87-865c-2d729100286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:29.853552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5950a45-30e1-45c8-8d93-523be7569954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:29.854264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5950a45-30e1-45c8-8d93-523be7569954 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.854553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5950a45-30e1-45c8-8d93-523be7569954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.854833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5950a45-30e1-45c8-8d93-523be7569954 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.855579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5950a45-30e1-45c8-8d93-523be7569954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:29.865877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5950a45-30e1-45c8-8d93-523be7569954 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:29.919895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 873/1752] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:29 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:29.920740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5950a45-30e1-45c8-8d93-523be7569954 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:29.929155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065cf32-19f7-4b87-865c-2d729100286f None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:29.933038 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58596a-0993-4ed9-851a-dd53528fcaba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:29.933695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58596a-0993-4ed9-851a-dd53528fcaba service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.933974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58596a-0993-4ed9-851a-dd53528fcaba service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.934248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58596a-0993-4ed9-851a-dd53528fcaba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.939452 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5950a45-30e1-45c8-8d93-523be7569954 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:29.949365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58596a-0993-4ed9-851a-dd53528fcaba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:29.949577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58596a-0993-4ed9-851a-dd53528fcaba service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:29.952161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029f46e-2ed6-42d9-bbf6-0868d8cf7bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:29.953045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029f46e-2ed6-42d9-bbf6-0868d8cf7bcf admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.953484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029f46e-2ed6-42d9-bbf6-0868d8cf7bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.953924 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029f46e-2ed6-42d9-bbf6-0868d8cf7bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.954867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029f46e-2ed6-42d9-bbf6-0868d8cf7bcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:29.955363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029f46e-2ed6-42d9-bbf6-0868d8cf7bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:29.957998 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029f46e-2ed6-42d9-bbf6-0868d8cf7bcf admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:29.962692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 880/1753] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:29.963787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58596a-0993-4ed9-851a-dd53528fcaba service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:29.981082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58596a-0993-4ed9-851a-dd53528fcaba service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:29.983067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 874/1754] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:29.987740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029f46e-2ed6-42d9-bbf6-0868d8cf7bcf admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:29.991056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1411-53e9-47a0-9115-08ccc32e994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:29.991865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1411-53e9-47a0-9115-08ccc32e994b admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:29.992144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1411-53e9-47a0-9115-08ccc32e994b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:29.992421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1411-53e9-47a0-9115-08ccc32e994b admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:29.993157 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a1411-53e9-47a0-9115-08ccc32e994b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:29.995051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a1411-53e9-47a0-9115-08ccc32e994b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:30.025847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 881/1755] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:30.027260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1411-53e9-47a0-9115-08ccc32e994b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:30.031400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029f46e-2ed6-42d9-bbf6-0868d8cf7bcf admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:30.042171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1411-53e9-47a0-9115-08ccc32e994b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:30.052708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a255ce-2072-40e1-ba61-16c204685ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:30.054659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5da1f-93d4-44c4-ba74-55a3cbd3fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:30.055558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5da1f-93d4-44c4-ba74-55a3cbd3fe60 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:30.055840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5da1f-93d4-44c4-ba74-55a3cbd3fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:30.056455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5da1f-93d4-44c4-ba74-55a3cbd3fe60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:30.056992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a255ce-2072-40e1-ba61-16c204685ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:30.057463 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5da1f-93d4-44c4-ba74-55a3cbd3fe60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:30.057592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a255ce-2072-40e1-ba61-16c204685ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:30.059655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a255ce-2072-40e1-ba61-16c204685ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:30.060426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5da1f-93d4-44c4-ba74-55a3cbd3fe60 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:30.061363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a255ce-2072-40e1-ba61-16c204685ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:30.071353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a255ce-2072-40e1-ba61-16c204685ee6 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:30.083559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 882/1756] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:30.083559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5da1f-93d4-44c4-ba74-55a3cbd3fe60 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:30.094428 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5da1f-93d4-44c4-ba74-55a3cbd3fe60 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:30.117509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4e379-b1c3-4d5d-b2b0-b8f0b1d2fc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:30.118683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4e379-b1c3-4d5d-b2b0-b8f0b1d2fc58 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:30.119075 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4e379-b1c3-4d5d-b2b0-b8f0b1d2fc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:30.119428 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4e379-b1c3-4d5d-b2b0-b8f0b1d2fc58 admin admin] PATH_INFO: `/v3/projects/16befcb8bfa24e828132152af3a2a94e/users/44e1346a838b46ccadab9516fa316617/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:30.151661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4e379-b1c3-4d5d-b2b0-b8f0b1d2fc58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16befcb8bfa24e828132152af3a2a94e, user_id=44e1346a838b46ccadab9516fa316617, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:30.153828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 875/1757] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:29 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:30.155302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4e379-b1c3-4d5d-b2b0-b8f0b1d2fc58 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:30.155434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a255ce-2072-40e1-ba61-16c204685ee6 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:30.163705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d7a255ce-2072-40e1-ba61-16c204685ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:30.200017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 883/1758] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:30 2022] PUT /identity/v3/projects/16befcb8bfa24e828132152af3a2a94e/users/44e1346a838b46ccadab9516fa316617/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:30.200017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4e379-b1c3-4d5d-b2b0-b8f0b1d2fc58 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:30.307494 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a255ce-2072-40e1-ba61-16c204685ee6 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:30.336170 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4e379-b1c3-4d5d-b2b0-b8f0b1d2fc58 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:30.344255 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1c4b7-6841-498e-a82b-a09e3f626450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:30.345526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c4b7-6841-498e-a82b-a09e3f626450 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:30.345526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c4b7-6841-498e-a82b-a09e3f626450 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:30.345839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c4b7-6841-498e-a82b-a09e3f626450 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:30.346675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1c4b7-6841-498e-a82b-a09e3f626450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:30.348849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1c4b7-6841-498e-a82b-a09e3f626450 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:30.417414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 884/1759] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:30 2022] POST /identity/v3/users => generated 287 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:30.417414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162dd7-9809-4ffb-a44a-f0dd75c6e273 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:30.417414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162dd7-9809-4ffb-a44a-f0dd75c6e273 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:30.417414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162dd7-9809-4ffb-a44a-f0dd75c6e273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:30.423753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afaaac-b453-4f91-a430-865047b93ef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:30.424435 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afaaac-b453-4f91-a430-865047b93ef8 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:30.424743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afaaac-b453-4f91-a430-865047b93ef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:30.425019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afaaac-b453-4f91-a430-865047b93ef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:30.430562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-22afaaac-b453-4f91-a430-865047b93ef8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:30.501022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-5a162dd7-9809-4ffb-a44a-f0dd75c6e273 None None] MFA Rules not processed for user `44e1346a838b46ccadab9516fa316617`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:30.502453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5a162dd7-9809-4ffb-a44a-f0dd75c6e273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:30.526765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afaaac-b453-4f91-a430-865047b93ef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:30.528551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afaaac-b453-4f91-a430-865047b93ef8 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:30.543502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 876/1760] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:30.543502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afaaac-b453-4f91-a430-865047b93ef8 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:30.565743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afaaac-b453-4f91-a430-865047b93ef8 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:30.582182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff4d5-5a01-49ad-9124-bb62eeb5713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:30.583407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff4d5-5a01-49ad-9124-bb62eeb5713e admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:30.583820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff4d5-5a01-49ad-9124-bb62eeb5713e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:30.584638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff4d5-5a01-49ad-9124-bb62eeb5713e admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:30.585546 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff4d5-5a01-49ad-9124-bb62eeb5713e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:30.590884 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff4d5-5a01-49ad-9124-bb62eeb5713e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:30.615280 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 877/1762] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:30.615503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 885/1762] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:30.624849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162dd7-9809-4ffb-a44a-f0dd75c6e273 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:30.625857 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff4d5-5a01-49ad-9124-bb62eeb5713e admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:30.648401 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a162dd7-9809-4ffb-a44a-f0dd75c6e273 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:30.654488 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff4d5-5a01-49ad-9124-bb62eeb5713e admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:30.657522 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8f69a-9eec-40ab-9e92-b9ed31811398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:30.658472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8f69a-9eec-40ab-9e92-b9ed31811398 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:30.659030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8f69a-9eec-40ab-9e92-b9ed31811398 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:30.659538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9d2ec-ded3-4709-803f-260161534c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:30.661877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9d2ec-ded3-4709-803f-260161534c1c admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:30.661877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9d2ec-ded3-4709-803f-260161534c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:30.661877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9d2ec-ded3-4709-803f-260161534c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:30.661877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9d2ec-ded3-4709-803f-260161534c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:30.663357 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9d2ec-ded3-4709-803f-260161534c1c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:30.668385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8f69a-9eec-40ab-9e92-b9ed31811398 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:30.671295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8f69a-9eec-40ab-9e92-b9ed31811398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:30.675285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8f69a-9eec-40ab-9e92-b9ed31811398 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:30.678661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 878/1763] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:30.683247 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9d2ec-ded3-4709-803f-260161534c1c admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:30.695934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9d2ec-ded3-4709-803f-260161534c1c admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:30.705785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf99285-6ce6-4c1f-a87e-3bf3308a0e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:30.707792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99285-6ce6-4c1f-a87e-3bf3308a0e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:30.708295 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99285-6ce6-4c1f-a87e-3bf3308a0e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:30.708723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf99285-6ce6-4c1f-a87e-3bf3308a0e8c admin admin] PATH_INFO: `/v3/projects/62a7e03a10cc4e4d84ff86529cee5972/users/f212d979070649f5b28d54d6b4fdfff2/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:30.741005 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99285-6ce6-4c1f-a87e-3bf3308a0e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a7e03a10cc4e4d84ff86529cee5972, user_id=f212d979070649f5b28d54d6b4fdfff2, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:30.745014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf99285-6ce6-4c1f-a87e-3bf3308a0e8c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:30.761371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 886/1764] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:30 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:30.762329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8f69a-9eec-40ab-9e92-b9ed31811398 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:30.793844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 879/1765] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:30 2022] PUT /identity/v3/projects/62a7e03a10cc4e4d84ff86529cee5972/users/f212d979070649f5b28d54d6b4fdfff2/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:30.796920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772a068-5720-420a-9d22-6c8b2fe81cff None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:30.797231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772a068-5720-420a-9d22-6c8b2fe81cff None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:30.797597 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772a068-5720-420a-9d22-6c8b2fe81cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:30.838728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-d772a068-5720-420a-9d22-6c8b2fe81cff None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:30.842883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d772a068-5720-420a-9d22-6c8b2fe81cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:30.895518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8f69a-9eec-40ab-9e92-b9ed31811398 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:30.990220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9dd9a-b482-4599-a542-52375aafdbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:30.991251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9dd9a-b482-4599-a542-52375aafdbae admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:30.991542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9dd9a-b482-4599-a542-52375aafdbae admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:30.991817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9dd9a-b482-4599-a542-52375aafdbae admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:30.992511 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9dd9a-b482-4599-a542-52375aafdbae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:30.994862 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9dd9a-b482-4599-a542-52375aafdbae admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:30.997212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 880/1766] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:31.008439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772a068-5720-420a-9d22-6c8b2fe81cff None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:31.010972 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d772a068-5720-420a-9d22-6c8b2fe81cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:31.029135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 887/1767] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:30 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:31.032772 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9dd9a-b482-4599-a542-52375aafdbae admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:31.044932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9dd9a-b482-4599-a542-52375aafdbae admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:31.050659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcee34-f941-4a9c-97a2-58a1ba70811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:31.051743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcee34-f941-4a9c-97a2-58a1ba70811e admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:31.052198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcee34-f941-4a9c-97a2-58a1ba70811e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:31.052603 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcee34-f941-4a9c-97a2-58a1ba70811e admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:31.053468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fcee34-f941-4a9c-97a2-58a1ba70811e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:31.055327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fcee34-f941-4a9c-97a2-58a1ba70811e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:31.070617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 888/1768] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:48:31.074691 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcee34-f941-4a9c-97a2-58a1ba70811e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:31.083846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772a068-5720-420a-9d22-6c8b2fe81cff None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:31.086718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcee34-f941-4a9c-97a2-58a1ba70811e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:31.087720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b729c-6dd9-4001-94c2-a3bdf00d9230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:31.088378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b729c-6dd9-4001-94c2-a3bdf00d9230 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:31.088661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b729c-6dd9-4001-94c2-a3bdf00d9230 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:31.088995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b729c-6dd9-4001-94c2-a3bdf00d9230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:31.113485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b729c-6dd9-4001-94c2-a3bdf00d9230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:31.114438 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b729c-6dd9-4001-94c2-a3bdf00d9230 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:31.121533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35151495-6ba5-4b48-9f9b-cfc312d72f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:31.123077 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35151495-6ba5-4b48-9f9b-cfc312d72f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:31.125023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35151495-6ba5-4b48-9f9b-cfc312d72f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:31.125583 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35151495-6ba5-4b48-9f9b-cfc312d72f9f admin admin] PATH_INFO: `/v3/projects/9a1471173bc34699b711ddef1072092c/users/71be18aed5bd45bfaf1872371a232b6a/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:31.130953 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 881/1769] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:31.160390 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907657c6-ca15-461a-848b-1d71b0a58b3f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:31.160815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907657c6-ca15-461a-848b-1d71b0a58b3f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:31.161004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907657c6-ca15-461a-848b-1d71b0a58b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:31.173418 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35151495-6ba5-4b48-9f9b-cfc312d72f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1471173bc34699b711ddef1072092c, user_id=71be18aed5bd45bfaf1872371a232b6a, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:31.195348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35151495-6ba5-4b48-9f9b-cfc312d72f9f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:31.223418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-907657c6-ca15-461a-848b-1d71b0a58b3f None None] MFA Rules not processed for user `963a38e769674dbba95a231e47a7191f`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:31.224929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-907657c6-ca15-461a-848b-1d71b0a58b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:31.233776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 889/1770] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:31 2022] PUT /identity/v3/projects/9a1471173bc34699b711ddef1072092c/users/71be18aed5bd45bfaf1872371a232b6a/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:31.238993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35151495-6ba5-4b48-9f9b-cfc312d72f9f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:31.373965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 882/1771] 10.222.0.23 () {58 vars in 1015 bytes} [Wed May 4 13:48:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:31.420422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35151495-6ba5-4b48-9f9b-cfc312d72f9f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:31.432468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24badb93-f8f4-406a-af2a-61a0ce63eaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:31.432468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24badb93-f8f4-406a-af2a-61a0ce63eaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:31.432468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24badb93-f8f4-406a-af2a-61a0ce63eaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:31.432468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24badb93-f8f4-406a-af2a-61a0ce63eaf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:31.432960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24badb93-f8f4-406a-af2a-61a0ce63eaf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:31.434871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24badb93-f8f4-406a-af2a-61a0ce63eaf7 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:31.456678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 890/1772] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:31.458493 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907657c6-ca15-461a-848b-1d71b0a58b3f None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:31.484323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907657c6-ca15-461a-848b-1d71b0a58b3f None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:31.490186 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11b22e-b5eb-49ad-aae4-839386f12377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:31.491588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11b22e-b5eb-49ad-aae4-839386f12377 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:31.492035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11b22e-b5eb-49ad-aae4-839386f12377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:31.492481 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11b22e-b5eb-49ad-aae4-839386f12377 admin admin] PATH_INFO: `/v3/projects/9a1471173bc34699b711ddef1072092c/users/71be18aed5bd45bfaf1872371a232b6a/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:31.495495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11b22e-b5eb-49ad-aae4-839386f12377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1471173bc34699b711ddef1072092c, user_id=71be18aed5bd45bfaf1872371a232b6a, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:31.498608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11b22e-b5eb-49ad-aae4-839386f12377 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:31.521776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 883/1773] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:31 2022] PUT /identity/v3/projects/9a1471173bc34699b711ddef1072092c/users/71be18aed5bd45bfaf1872371a232b6a/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:31.532773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645419f-ec74-4a36-a360-a442baed4f59 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:31.533157 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645419f-ec74-4a36-a360-a442baed4f59 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:31.533503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645419f-ec74-4a36-a360-a442baed4f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:31.575171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-3645419f-ec74-4a36-a360-a442baed4f59 None None] MFA Rules not processed for user `71be18aed5bd45bfaf1872371a232b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:31.576866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3645419f-ec74-4a36-a360-a442baed4f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:31.662519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 891/1774] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:31.670754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11b22e-b5eb-49ad-aae4-839386f12377 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:31.780746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11b22e-b5eb-49ad-aae4-839386f12377 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:31.786342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428184a6-7854-46c8-a55a-3d93da58298c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:31.787080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428184a6-7854-46c8-a55a-3d93da58298c service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:31.787455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428184a6-7854-46c8-a55a-3d93da58298c service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:31.787916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428184a6-7854-46c8-a55a-3d93da58298c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:31.807089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428184a6-7854-46c8-a55a-3d93da58298c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:31.808802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428184a6-7854-46c8-a55a-3d93da58298c service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:31.830683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 884/1775] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:32.149046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41556e0a-507f-4463-ac70-9bcfd46e7460 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:32.149577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41556e0a-507f-4463-ac70-9bcfd46e7460 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:32.149768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41556e0a-507f-4463-ac70-9bcfd46e7460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:32.234928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-41556e0a-507f-4463-ac70-9bcfd46e7460 None None] MFA Rules not processed for user `f212d979070649f5b28d54d6b4fdfff2`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:32.236358 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-41556e0a-507f-4463-ac70-9bcfd46e7460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:32.303011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428184a6-7854-46c8-a55a-3d93da58298c service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:32.325774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428184a6-7854-46c8-a55a-3d93da58298c service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:32.344965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb531b-8b92-4b36-9011-3c3295a57b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:32.345628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb531b-8b92-4b36-9011-3c3295a57b1e service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:32.345911 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb531b-8b92-4b36-9011-3c3295a57b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:32.346279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb531b-8b92-4b36-9011-3c3295a57b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:32.434911 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 892/1776] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:32.438378 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41556e0a-507f-4463-ac70-9bcfd46e7460 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:32.517171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb531b-8b92-4b36-9011-3c3295a57b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:32.518870 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb531b-8b92-4b36-9011-3c3295a57b1e service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:32.569718 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 885/1777] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:32.573439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb531b-8b92-4b36-9011-3c3295a57b1e service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:32.661153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41556e0a-507f-4463-ac70-9bcfd46e7460 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:32.675304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f40204-2a84-4e4b-8bde-88da34e55175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:32.676201 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f40204-2a84-4e4b-8bde-88da34e55175 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:32.676576 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f40204-2a84-4e4b-8bde-88da34e55175 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:32.677015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f40204-2a84-4e4b-8bde-88da34e55175 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:32.680005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f40204-2a84-4e4b-8bde-88da34e55175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:32.683616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f40204-2a84-4e4b-8bde-88da34e55175 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:32.762744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 893/1778] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:32 2022] POST /identity/v3/projects => generated 373 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:32.767065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f40204-2a84-4e4b-8bde-88da34e55175 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:32.862979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb531b-8b92-4b36-9011-3c3295a57b1e service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:32.979023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f40204-2a84-4e4b-8bde-88da34e55175 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:33.001259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8be2a-fa73-4d77-af0a-976d8efcce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:33.005548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8be2a-fa73-4d77-af0a-976d8efcce9b admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:33.009838 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8be2a-fa73-4d77-af0a-976d8efcce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:33.013153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8be2a-fa73-4d77-af0a-976d8efcce9b admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:33.014890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8be2a-fa73-4d77-af0a-976d8efcce9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:33.026258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8be2a-fa73-4d77-af0a-976d8efcce9b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:33.039050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0645d5f-63a1-43c8-a4fb-515d74d347d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:33.040915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0645d5f-63a1-43c8-a4fb-515d74d347d3 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:33.041306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0645d5f-63a1-43c8-a4fb-515d74d347d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:33.041598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0645d5f-63a1-43c8-a4fb-515d74d347d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:33.084743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0645d5f-63a1-43c8-a4fb-515d74d347d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:33.086193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 894/1779] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:32 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:33.091463 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8be2a-fa73-4d77-af0a-976d8efcce9b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:33.093243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0645d5f-63a1-43c8-a4fb-515d74d347d3 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:33.135478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 886/1780] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:33.145941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8be2a-fa73-4d77-af0a-976d8efcce9b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:33.152725 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f4acf-f87f-4560-a156-d19489a4a681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:33.153418 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f4acf-f87f-4560-a156-d19489a4a681 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:33.153718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f4acf-f87f-4560-a156-d19489a4a681 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:33.153988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f4acf-f87f-4560-a156-d19489a4a681 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:33.154872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f4acf-f87f-4560-a156-d19489a4a681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:33.162647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f4acf-f87f-4560-a156-d19489a4a681 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:33.178774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 895/1781] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:33.183526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0645d5f-63a1-43c8-a4fb-515d74d347d3 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:33.201742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0645d5f-63a1-43c8-a4fb-515d74d347d3 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:33.215024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829487e-5e5e-4476-842e-13f96e3b3bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:33.216241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829487e-5e5e-4476-842e-13f96e3b3bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:33.216660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829487e-5e5e-4476-842e-13f96e3b3bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:33.218231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829487e-5e5e-4476-842e-13f96e3b3bdc admin admin] PATH_INFO: `/v3/projects/882b30ebd4c84048a5f56870249eb35b/users/cf8e5c20616a4bf490dc10a3d2be51d6/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:33.258885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829487e-5e5e-4476-842e-13f96e3b3bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=882b30ebd4c84048a5f56870249eb35b, user_id=cf8e5c20616a4bf490dc10a3d2be51d6, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:33.305223 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829487e-5e5e-4476-842e-13f96e3b3bdc admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:33.370353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 887/1782] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:33 2022] PUT /identity/v3/projects/882b30ebd4c84048a5f56870249eb35b/users/cf8e5c20616a4bf490dc10a3d2be51d6/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:33.374625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f4acf-f87f-4560-a156-d19489a4a681 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:33.398459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f4acf-f87f-4560-a156-d19489a4a681 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:33.552505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb0732-4894-4915-90d0-32903d22df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:33.553327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb0732-4894-4915-90d0-32903d22df0d admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:33.553944 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb0732-4894-4915-90d0-32903d22df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:33.554289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb0732-4894-4915-90d0-32903d22df0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:33.555163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb0732-4894-4915-90d0-32903d22df0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:33.557080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb0732-4894-4915-90d0-32903d22df0d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:33.576326 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 896/1783] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:33.576637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829487e-5e5e-4476-842e-13f96e3b3bdc admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:33.608076 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829487e-5e5e-4476-842e-13f96e3b3bdc admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:33.646303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa841-fa34-47a4-b9a2-76bb1b9273c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:33.660721 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa841-fa34-47a4-b9a2-76bb1b9273c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:33.661162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa841-fa34-47a4-b9a2-76bb1b9273c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:33.672173 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa841-fa34-47a4-b9a2-76bb1b9273c2 admin admin] PATH_INFO: `/v3/projects/882b30ebd4c84048a5f56870249eb35b/users/cf8e5c20616a4bf490dc10a3d2be51d6/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:33.678467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa841-fa34-47a4-b9a2-76bb1b9273c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882b30ebd4c84048a5f56870249eb35b, user_id=cf8e5c20616a4bf490dc10a3d2be51d6, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:33.681654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa841-fa34-47a4-b9a2-76bb1b9273c2 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:33.747794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 888/1784] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:33 2022] PUT /identity/v3/projects/882b30ebd4c84048a5f56870249eb35b/users/cf8e5c20616a4bf490dc10a3d2be51d6/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:34.464005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb0732-4894-4915-90d0-32903d22df0d admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:34.466203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-84bb0732-4894-4915-90d0-32903d22df0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:34.490559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb0732-4894-4915-90d0-32903d22df0d admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:34.682456 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c8a8e-9c0d-4054-940f-54805063fd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:34.683383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8a8e-9c0d-4054-940f-54805063fd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:34.685529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8a8e-9c0d-4054-940f-54805063fd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:34.687616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8a8e-9c0d-4054-940f-54805063fd0c admin admin] PATH_INFO: `/v3/users/dfeb14140e484c7895f59cd95b675a23` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:34.691036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c8a8e-9c0d-4054-940f-54805063fd0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfeb14140e484c7895f59cd95b675a23)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:34.693237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c8a8e-9c0d-4054-940f-54805063fd0c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:34.855470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-172c8a8e-9c0d-4054-940f-54805063fd0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfeb14140e484c7895f59cd95b675a23'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:34.875426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-172c8a8e-9c0d-4054-940f-54805063fd0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfeb14140e484c7895f59cd95b675a23'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:34.877184 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-172c8a8e-9c0d-4054-940f-54805063fd0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfeb14140e484c7895f59cd95b675a23'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:34.895495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-172c8a8e-9c0d-4054-940f-54805063fd0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfeb14140e484c7895f59cd95b675a23'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:34.952677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-172c8a8e-9c0d-4054-940f-54805063fd0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfeb14140e484c7895f59cd95b675a23'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:34.976272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 897/1785] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:34 2022] DELETE /identity/v3/users/dfeb14140e484c7895f59cd95b675a23 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:34.980859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfee912-eff0-4d16-a703-b2c6fe472f59 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:34.981374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfee912-eff0-4d16-a703-b2c6fe472f59 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:34.981461 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfee912-eff0-4d16-a703-b2c6fe472f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:35.043274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-0bfee912-eff0-4d16-a703-b2c6fe472f59 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:35.045821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0bfee912-eff0-4d16-a703-b2c6fe472f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:35.097628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aa449-9227-4621-b1a9-c1c9da008f61 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:35.097968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aa449-9227-4621-b1a9-c1c9da008f61 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:35.098321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aa449-9227-4621-b1a9-c1c9da008f61 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:35.099912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 898/1786] 10.222.0.73 () {54 vars in 921 bytes} [Wed May 4 13:48:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 13:48:35.119319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46a9ff-59db-4c5f-9d94-208cc9d65882 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:35.119688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46a9ff-59db-4c5f-9d94-208cc9d65882 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:35.119978 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46a9ff-59db-4c5f-9d94-208cc9d65882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:35.149464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-bd46a9ff-59db-4c5f-9d94-208cc9d65882 None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:35.151518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-bd46a9ff-59db-4c5f-9d94-208cc9d65882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:35.216143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 889/1787] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:35.239793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfee912-eff0-4d16-a703-b2c6fe472f59 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:35.242107 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0bfee912-eff0-4d16-a703-b2c6fe472f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:35.333276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfee912-eff0-4d16-a703-b2c6fe472f59 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:35.338491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36931eae-2542-48fe-9e60-96987b68fcac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:35.340206 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36931eae-2542-48fe-9e60-96987b68fcac service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:35.340643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36931eae-2542-48fe-9e60-96987b68fcac service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:35.341064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36931eae-2542-48fe-9e60-96987b68fcac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:35.354827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36931eae-2542-48fe-9e60-96987b68fcac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:35.356676 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36931eae-2542-48fe-9e60-96987b68fcac service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:35.370148 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 890/1788] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:35.373459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 899/1789] 10.222.0.73 () {58 vars in 1018 bytes} [Wed May 4 13:48:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:35.400909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36931eae-2542-48fe-9e60-96987b68fcac service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:35.403163 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-36931eae-2542-48fe-9e60-96987b68fcac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:35.436371 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36931eae-2542-48fe-9e60-96987b68fcac service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:35.450178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54935468-afa6-4da5-aed7-347e4554839c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:35.452645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54935468-afa6-4da5-aed7-347e4554839c service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:35.453093 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54935468-afa6-4da5-aed7-347e4554839c service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:35.454209 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54935468-afa6-4da5-aed7-347e4554839c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:35.473662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54935468-afa6-4da5-aed7-347e4554839c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:35.475195 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54935468-afa6-4da5-aed7-347e4554839c service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:35.494371 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 891/1790] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:35.830050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ebbf3-e6e3-47ea-b04f-dbb515820156 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:35.831628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ebbf3-e6e3-47ea-b04f-dbb515820156 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:35.832291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ebbf3-e6e3-47ea-b04f-dbb515820156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:35.897850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-be2ebbf3-e6e3-47ea-b04f-dbb515820156 None None] MFA Rules not processed for user `cf8e5c20616a4bf490dc10a3d2be51d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:35.899795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-be2ebbf3-e6e3-47ea-b04f-dbb515820156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:36.020707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 900/1791] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:36.034827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54935468-afa6-4da5-aed7-347e4554839c service nova] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:36.037509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-54935468-afa6-4da5-aed7-347e4554839c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:36.108827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54935468-afa6-4da5-aed7-347e4554839c service nova] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:36.113754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67d48d-1d6f-41aa-95aa-79d5ae0dea08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:36.114668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67d48d-1d6f-41aa-95aa-79d5ae0dea08 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:36.115064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67d48d-1d6f-41aa-95aa-79d5ae0dea08 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:36.115485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67d48d-1d6f-41aa-95aa-79d5ae0dea08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:36.117587 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0e67d48d-1d6f-41aa-95aa-79d5ae0dea08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:36.160670 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ebbf3-e6e3-47ea-b04f-dbb515820156 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:36.162332 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-be2ebbf3-e6e3-47ea-b04f-dbb515820156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:36.186262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ebbf3-e6e3-47ea-b04f-dbb515820156 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:36.192159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:36.193376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:36.193657 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:36.193922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2 admin admin] PATH_INFO: `/v3/projects/bd253d69509d4f9585349fdeee0899ed` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:36.196235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd253d69509d4f9585349fdeee0899ed)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:36.198731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:36.221129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67d48d-1d6f-41aa-95aa-79d5ae0dea08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:36.223793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67d48d-1d6f-41aa-95aa-79d5ae0dea08 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:36.255429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 892/1792] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:36.272266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd253d69509d4f9585349fdeee0899ed', 'request_id': 'req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:36.280136 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd253d69509d4f9585349fdeee0899ed', 'request_id': 'req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:36.291622 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd253d69509d4f9585349fdeee0899ed', 'request_id': 'req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:36.322659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2 admin admin] The token cache is being invalidate because project bd253d69509d4f9585349fdeee0899ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:36.322993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:36.323699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f907e886-f6c5-4c92-8a96-21c2c0e78bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:36.325285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 901/1793] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:36 2022] DELETE /identity/v3/projects/bd253d69509d4f9585349fdeee0899ed => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:36.330261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cdc97-4700-4221-abbd-c0e66c1e2956 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:36.330550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cdc97-4700-4221-abbd-c0e66c1e2956 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:36.330865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cdc97-4700-4221-abbd-c0e66c1e2956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:36.371275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f43cdc97-4700-4221-abbd-c0e66c1e2956 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:36.372864 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f43cdc97-4700-4221-abbd-c0e66c1e2956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:36.503804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776a2fa-56ec-4bba-a758-2732ca6ba262 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:36.504156 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 893/1794] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:36.504262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776a2fa-56ec-4bba-a758-2732ca6ba262 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:36.504479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776a2fa-56ec-4bba-a758-2732ca6ba262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:36.541021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-e776a2fa-56ec-4bba-a758-2732ca6ba262 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:36.542861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e776a2fa-56ec-4bba-a758-2732ca6ba262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:36.553064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 902/1795] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:36.557285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cdc97-4700-4221-abbd-c0e66c1e2956 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:36.568069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cdc97-4700-4221-abbd-c0e66c1e2956 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:36.573590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f9c67-5ef7-4ee2-bac3-ab01ef6c86c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:36.574265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f9c67-5ef7-4ee2-bac3-ab01ef6c86c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:36.574569 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f9c67-5ef7-4ee2-bac3-ab01ef6c86c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:36.574822 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f9c67-5ef7-4ee2-bac3-ab01ef6c86c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:36.575923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f9c67-5ef7-4ee2-bac3-ab01ef6c86c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:36.576246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f9c67-5ef7-4ee2-bac3-ab01ef6c86c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:36.577859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f9c67-5ef7-4ee2-bac3-ab01ef6c86c8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:36.594132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 894/1796] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:48:36.597053 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776a2fa-56ec-4bba-a758-2732ca6ba262 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:36.622934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776a2fa-56ec-4bba-a758-2732ca6ba262 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:36.638067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad550e33-a451-4cb3-9043-01964ab25dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:36.639378 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad550e33-a451-4cb3-9043-01964ab25dff admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:36.639668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad550e33-a451-4cb3-9043-01964ab25dff admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:36.639950 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad550e33-a451-4cb3-9043-01964ab25dff admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:36.645638 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad550e33-a451-4cb3-9043-01964ab25dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:36.650738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad550e33-a451-4cb3-9043-01964ab25dff admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:36.693380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 903/1797] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:36 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:36.697316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f9c67-5ef7-4ee2-bac3-ab01ef6c86c8 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:36.731564 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f9c67-5ef7-4ee2-bac3-ab01ef6c86c8 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:36.815621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc7383-1f19-49a8-9c3a-6bc78caf7f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:36.816311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc7383-1f19-49a8-9c3a-6bc78caf7f5a admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:36.816599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc7383-1f19-49a8-9c3a-6bc78caf7f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:36.816870 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc7383-1f19-49a8-9c3a-6bc78caf7f5a admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:36.817577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc7383-1f19-49a8-9c3a-6bc78caf7f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:36.822172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc7383-1f19-49a8-9c3a-6bc78caf7f5a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:36.866352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 895/1798] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:36 2022] POST /identity/v3/users => generated 284 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:36.870601 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad550e33-a451-4cb3-9043-01964ab25dff admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:36.881874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad550e33-a451-4cb3-9043-01964ab25dff admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:36.891642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869aa15-aadf-4fc2-837d-51795a05d447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:36.892453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869aa15-aadf-4fc2-837d-51795a05d447 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:36.892815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869aa15-aadf-4fc2-837d-51795a05d447 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:36.893184 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869aa15-aadf-4fc2-837d-51795a05d447 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:36.896372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869aa15-aadf-4fc2-837d-51795a05d447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:36.897992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869aa15-aadf-4fc2-837d-51795a05d447 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:36.916531 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 904/1799] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:36.916898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc7383-1f19-49a8-9c3a-6bc78caf7f5a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:36.928804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc7383-1f19-49a8-9c3a-6bc78caf7f5a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:36.934079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41012fc2-c6ee-4c4b-a25c-a5886846361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:36.934765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012fc2-c6ee-4c4b-a25c-a5886846361a admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:36.935051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012fc2-c6ee-4c4b-a25c-a5886846361a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:36.935638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41012fc2-c6ee-4c4b-a25c-a5886846361a admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:36.936394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41012fc2-c6ee-4c4b-a25c-a5886846361a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:36.938212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41012fc2-c6ee-4c4b-a25c-a5886846361a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:36.951365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 896/1800] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:36.953713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869aa15-aadf-4fc2-837d-51795a05d447 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:36.964239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869aa15-aadf-4fc2-837d-51795a05d447 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:36.969047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1363bc-28fb-4cd3-bbeb-c53e0a78fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:36.970113 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1363bc-28fb-4cd3-bbeb-c53e0a78fa4e admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:36.970393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1363bc-28fb-4cd3-bbeb-c53e0a78fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:36.970661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1363bc-28fb-4cd3-bbeb-c53e0a78fa4e admin admin] PATH_INFO: `/v3/projects/abff3b638a3047acacac23ea3637d50a/users/298ac96b8d1f4f27922f579df2f74e3e/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:36.988321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1363bc-28fb-4cd3-bbeb-c53e0a78fa4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=abff3b638a3047acacac23ea3637d50a, user_id=298ac96b8d1f4f27922f579df2f74e3e, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:36.990950 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1363bc-28fb-4cd3-bbeb-c53e0a78fa4e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:37.006874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 905/1801] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:36 2022] PUT /identity/v3/projects/abff3b638a3047acacac23ea3637d50a/users/298ac96b8d1f4f27922f579df2f74e3e/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:37.017437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4ce14-b73d-4750-8543-b2972f3c9dd3 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:37.017775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4ce14-b73d-4750-8543-b2972f3c9dd3 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:37.017993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4ce14-b73d-4750-8543-b2972f3c9dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:37.047543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f4c4ce14-b73d-4750-8543-b2972f3c9dd3 None None] MFA Rules not processed for user `298ac96b8d1f4f27922f579df2f74e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:37.048755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f4c4ce14-b73d-4750-8543-b2972f3c9dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:37.131305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 897/1802] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:37.136507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1363bc-28fb-4cd3-bbeb-c53e0a78fa4e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:37.199001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1363bc-28fb-4cd3-bbeb-c53e0a78fa4e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:37.203548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c64ec-e53a-4c1f-83c2-ff6249998335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:37.204195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c64ec-e53a-4c1f-83c2-ff6249998335 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:37.204473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c64ec-e53a-4c1f-83c2-ff6249998335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:37.204741 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c64ec-e53a-4c1f-83c2-ff6249998335 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:37.205426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c64ec-e53a-4c1f-83c2-ff6249998335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:37.207342 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c64ec-e53a-4c1f-83c2-ff6249998335 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:37.231724 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 906/1803] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:37 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:37.235722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4ce14-b73d-4750-8543-b2972f3c9dd3 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:37.246813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4ce14-b73d-4750-8543-b2972f3c9dd3 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:37.305511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15788a-94b5-4998-a817-d4efeee0d618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:37.306184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15788a-94b5-4998-a817-d4efeee0d618 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:37.306463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15788a-94b5-4998-a817-d4efeee0d618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:37.306736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15788a-94b5-4998-a817-d4efeee0d618 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:37.307493 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15788a-94b5-4998-a817-d4efeee0d618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:37.309610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15788a-94b5-4998-a817-d4efeee0d618 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:37.338523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 898/1804] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:37 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:37.339938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c64ec-e53a-4c1f-83c2-ff6249998335 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:37.359854 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c64ec-e53a-4c1f-83c2-ff6249998335 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:37.368321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca961b-b0e1-4ed0-b276-a49eff63f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:37.369057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca961b-b0e1-4ed0-b276-a49eff63f813 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:37.369325 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca961b-b0e1-4ed0-b276-a49eff63f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:37.369606 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca961b-b0e1-4ed0-b276-a49eff63f813 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:37.370410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca961b-b0e1-4ed0-b276-a49eff63f813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:37.372105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca961b-b0e1-4ed0-b276-a49eff63f813 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:37.385233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 907/1805] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:37.389251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15788a-94b5-4998-a817-d4efeee0d618 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:37.400721 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15788a-94b5-4998-a817-d4efeee0d618 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:37.410376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d515ae6-b382-41da-be4e-7751000cfe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:37.411320 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d515ae6-b382-41da-be4e-7751000cfe8a admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:37.411606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d515ae6-b382-41da-be4e-7751000cfe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:37.411882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d515ae6-b382-41da-be4e-7751000cfe8a admin admin] PATH_INFO: `/v3/projects/8daaed5103d24e4eb1a8cef80efa6a24/users/2a157e04dd264a65a7a10fa24264360e/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:37.428302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d515ae6-b382-41da-be4e-7751000cfe8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8daaed5103d24e4eb1a8cef80efa6a24, user_id=2a157e04dd264a65a7a10fa24264360e, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:37.430979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d515ae6-b382-41da-be4e-7751000cfe8a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:37.447014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 899/1806] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:37 2022] PUT /identity/v3/projects/8daaed5103d24e4eb1a8cef80efa6a24/users/2a157e04dd264a65a7a10fa24264360e/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:37.451683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca961b-b0e1-4ed0-b276-a49eff63f813 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:37.462408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca961b-b0e1-4ed0-b276-a49eff63f813 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:37.519656 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8200c5-ea4c-4b74-9832-78827624f68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:37.520335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8200c5-ea4c-4b74-9832-78827624f68b admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:37.520613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8200c5-ea4c-4b74-9832-78827624f68b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:37.520883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8200c5-ea4c-4b74-9832-78827624f68b admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:37.521607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8200c5-ea4c-4b74-9832-78827624f68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:37.523183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8200c5-ea4c-4b74-9832-78827624f68b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:37.533641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 908/1807] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:37.540021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d515ae6-b382-41da-be4e-7751000cfe8a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:37.551091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d515ae6-b382-41da-be4e-7751000cfe8a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:37.556617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339b3ef-1a69-4ba0-9e8e-382a9955608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:37.557715 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339b3ef-1a69-4ba0-9e8e-382a9955608d admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:37.558199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339b3ef-1a69-4ba0-9e8e-382a9955608d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:37.558647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339b3ef-1a69-4ba0-9e8e-382a9955608d admin admin] PATH_INFO: `/v3/projects/8daaed5103d24e4eb1a8cef80efa6a24/users/2a157e04dd264a65a7a10fa24264360e/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:37.560949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339b3ef-1a69-4ba0-9e8e-382a9955608d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8daaed5103d24e4eb1a8cef80efa6a24, user_id=2a157e04dd264a65a7a10fa24264360e, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:37.563603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339b3ef-1a69-4ba0-9e8e-382a9955608d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:37.573997 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 900/1808] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:37 2022] PUT /identity/v3/projects/8daaed5103d24e4eb1a8cef80efa6a24/users/2a157e04dd264a65a7a10fa24264360e/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:37.585387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e9952-b491-4640-8d6a-a3f331eb462e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:37.585699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e9952-b491-4640-8d6a-a3f331eb462e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:37.585979 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e9952-b491-4640-8d6a-a3f331eb462e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:37.618955 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-544e9952-b491-4640-8d6a-a3f331eb462e None None] MFA Rules not processed for user `2a157e04dd264a65a7a10fa24264360e`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:37.620466 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-544e9952-b491-4640-8d6a-a3f331eb462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:37.694643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 909/1809] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:37.705539 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339b3ef-1a69-4ba0-9e8e-382a9955608d admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:37.708028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1339b3ef-1a69-4ba0-9e8e-382a9955608d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:37.773293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339b3ef-1a69-4ba0-9e8e-382a9955608d admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:37.776932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c89b6c-6fac-4487-acd0-0ecbe3b8bd11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:37.777576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c89b6c-6fac-4487-acd0-0ecbe3b8bd11 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:37.777862 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c89b6c-6fac-4487-acd0-0ecbe3b8bd11 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:37.778136 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c89b6c-6fac-4487-acd0-0ecbe3b8bd11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:37.787491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c89b6c-6fac-4487-acd0-0ecbe3b8bd11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:37.788916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c89b6c-6fac-4487-acd0-0ecbe3b8bd11 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:37.798078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 901/1810] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:37 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:38.473897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e9952-b491-4640-8d6a-a3f331eb462e None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:38.475358 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-544e9952-b491-4640-8d6a-a3f331eb462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:38.543401 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e9952-b491-4640-8d6a-a3f331eb462e None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:38.547785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:38.548654 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:38.548973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:38.549379 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] PATH_INFO: `/v3/users/44e1346a838b46ccadab9516fa316617` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:38.551539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e1346a838b46ccadab9516fa316617)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:38.553630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:38.602933 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e1346a838b46ccadab9516fa316617'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:38.610293 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e1346a838b46ccadab9516fa316617'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:38.610926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e1346a838b46ccadab9516fa316617'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:38.618924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e1346a838b46ccadab9516fa316617'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:38.630263 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e1346a838b46ccadab9516fa316617'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:38.636236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 910/1811] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:38 2022] DELETE /identity/v3/users/44e1346a838b46ccadab9516fa316617 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:38.640860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041bc91-ddf0-4760-b2e6-5011607ab71f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:38.641336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041bc91-ddf0-4760-b2e6-5011607ab71f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:38.641520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041bc91-ddf0-4760-b2e6-5011607ab71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:38.659714 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-0041bc91-ddf0-4760-b2e6-5011607ab71f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:38.660992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0041bc91-ddf0-4760-b2e6-5011607ab71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:38.719803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 902/1812] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:38.731260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:38.732833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:38.814498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7170d2c-146a-4234-8471-cb08f2809d53 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:38.818551 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661dc6c-03d1-4089-8b3b-ff10de33d73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:38.819151 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661dc6c-03d1-4089-8b3b-ff10de33d73a service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:38.819467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661dc6c-03d1-4089-8b3b-ff10de33d73a service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:38.819771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661dc6c-03d1-4089-8b3b-ff10de33d73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:38.834913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661dc6c-03d1-4089-8b3b-ff10de33d73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:38.836377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661dc6c-03d1-4089-8b3b-ff10de33d73a service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:38.847653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 911/1813] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:39.195522 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041bc91-ddf0-4760-b2e6-5011607ab71f None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:39.196934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0041bc91-ddf0-4760-b2e6-5011607ab71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:39.208750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041bc91-ddf0-4760-b2e6-5011607ab71f None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:39.213162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90365e95-391f-46b3-8c10-80a08666acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:39.214021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90365e95-391f-46b3-8c10-80a08666acd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:39.214408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90365e95-391f-46b3-8c10-80a08666acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:39.214577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90365e95-391f-46b3-8c10-80a08666acd8 admin admin] PATH_INFO: `/v3/users/298ac96b8d1f4f27922f579df2f74e3e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:39.215827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90365e95-391f-46b3-8c10-80a08666acd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=298ac96b8d1f4f27922f579df2f74e3e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:39.218175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90365e95-391f-46b3-8c10-80a08666acd8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:39.282143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-90365e95-391f-46b3-8c10-80a08666acd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298ac96b8d1f4f27922f579df2f74e3e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.292503 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-90365e95-391f-46b3-8c10-80a08666acd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298ac96b8d1f4f27922f579df2f74e3e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.302044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-90365e95-391f-46b3-8c10-80a08666acd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298ac96b8d1f4f27922f579df2f74e3e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.302581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-90365e95-391f-46b3-8c10-80a08666acd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298ac96b8d1f4f27922f579df2f74e3e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.303223 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-90365e95-391f-46b3-8c10-80a08666acd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298ac96b8d1f4f27922f579df2f74e3e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.318587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661dc6c-03d1-4089-8b3b-ff10de33d73a service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:39.320787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b661dc6c-03d1-4089-8b3b-ff10de33d73a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:39.322305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 903/1814] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:39 2022] DELETE /identity/v3/users/298ac96b8d1f4f27922f579df2f74e3e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:39.326950 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967c716-b9db-4601-821c-b6076ac9a9eb None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:39.327342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967c716-b9db-4601-821c-b6076ac9a9eb None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:39.327692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967c716-b9db-4601-821c-b6076ac9a9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:39.339984 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661dc6c-03d1-4089-8b3b-ff10de33d73a service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:39.347779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-c967c716-b9db-4601-821c-b6076ac9a9eb None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:39.349454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c967c716-b9db-4601-821c-b6076ac9a9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:39.401217 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:39.402075 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:39.402354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:39.402628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] PATH_INFO: `/v3/projects/16befcb8bfa24e828132152af3a2a94e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:39.403810 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=16befcb8bfa24e828132152af3a2a94e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:39.405687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:39.412680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 904/1815] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:39.422232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967c716-b9db-4601-821c-b6076ac9a9eb None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:39.423658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c967c716-b9db-4601-821c-b6076ac9a9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:39.450020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16befcb8bfa24e828132152af3a2a94e', 'request_id': 'req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.456934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16befcb8bfa24e828132152af3a2a94e', 'request_id': 'req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.464306 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16befcb8bfa24e828132152af3a2a94e', 'request_id': 'req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.474655 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] The token cache is being invalidate because project 16befcb8bfa24e828132152af3a2a94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:39.475278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.475770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.477391 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 912/1816] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:39 2022] DELETE /identity/v3/projects/16befcb8bfa24e828132152af3a2a94e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:39.481051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:39.481681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967c716-b9db-4601-821c-b6076ac9a9eb None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:39.482526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:39.528473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac02a1-6855-49e6-91fd-500614d2c42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:39.529117 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac02a1-6855-49e6-91fd-500614d2c42b service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:39.529400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac02a1-6855-49e6-91fd-500614d2c42b service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:39.529675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac02a1-6855-49e6-91fd-500614d2c42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:39.531560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-14ac02a1-6855-49e6-91fd-500614d2c42b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:39.542326 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b9c5f-73fa-43d4-aa68-33bd2b2ecbaf admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:39.543249 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac02a1-6855-49e6-91fd-500614d2c42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:39.544720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac02a1-6855-49e6-91fd-500614d2c42b service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:39.546873 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:39.547770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:39.548054 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:39.548327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] PATH_INFO: `/v3/users/71be18aed5bd45bfaf1872371a232b6a` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:39.549521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] RBAC: Authorizing `identity:delete_user(user_id=71be18aed5bd45bfaf1872371a232b6a)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:39.551452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:39.554041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 905/1817] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:39.599457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71be18aed5bd45bfaf1872371a232b6a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.606867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71be18aed5bd45bfaf1872371a232b6a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.607520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71be18aed5bd45bfaf1872371a232b6a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.615388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71be18aed5bd45bfaf1872371a232b6a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.627476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71be18aed5bd45bfaf1872371a232b6a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:39.633642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 913/1818] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:39 2022] DELETE /identity/v3/users/71be18aed5bd45bfaf1872371a232b6a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:39.888062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac02a1-6855-49e6-91fd-500614d2c42b service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:39.890013 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-14ac02a1-6855-49e6-91fd-500614d2c42b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:39.904419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac02a1-6855-49e6-91fd-500614d2c42b service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:39.979156 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:39.979857 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:39.980053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:39.980336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:39.980610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] PATH_INFO: `/v3/projects/abff3b638a3047acacac23ea3637d50a` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:39.981334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:39.981781 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] RBAC: Authorizing `identity:delete_project(project_id=abff3b638a3047acacac23ea3637d50a)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:39.983699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:39.994355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34316a18-aac8-4b2b-b4e8-5eea5c4b70de admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:39.999178 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f4739-8b3e-4d78-8509-86d2461c38f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:40.000062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f4739-8b3e-4d78-8509-86d2461c38f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.000343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f4739-8b3e-4d78-8509-86d2461c38f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.000616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f4739-8b3e-4d78-8509-86d2461c38f7 admin admin] PATH_INFO: `/v3/projects/9a1471173bc34699b711ddef1072092c` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.001803 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f4739-8b3e-4d78-8509-86d2461c38f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1471173bc34699b711ddef1072092c)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:40.003777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f4739-8b3e-4d78-8509-86d2461c38f7 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:40.044207 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abff3b638a3047acacac23ea3637d50a', 'request_id': 'req-cbf37553-da63-4e85-a206-83290be5560a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.052140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abff3b638a3047acacac23ea3637d50a', 'request_id': 'req-cbf37553-da63-4e85-a206-83290be5560a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.059707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abff3b638a3047acacac23ea3637d50a', 'request_id': 'req-cbf37553-da63-4e85-a206-83290be5560a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.068133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9a1f4739-8b3e-4d78-8509-86d2461c38f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1471173bc34699b711ddef1072092c', 'request_id': 'req-9a1f4739-8b3e-4d78-8509-86d2461c38f7'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.073323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] The token cache is being invalidate because project abff3b638a3047acacac23ea3637d50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:40.073798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.074482 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.074606 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9a1f4739-8b3e-4d78-8509-86d2461c38f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1471173bc34699b711ddef1072092c', 'request_id': 'req-9a1f4739-8b3e-4d78-8509-86d2461c38f7'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.080610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 906/1819] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:39 2022] DELETE /identity/v3/projects/abff3b638a3047acacac23ea3637d50a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:40.084979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:40.086183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9a1f4739-8b3e-4d78-8509-86d2461c38f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1471173bc34699b711ddef1072092c', 'request_id': 'req-9a1f4739-8b3e-4d78-8509-86d2461c38f7'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.086849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:40.098786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9a1f4739-8b3e-4d78-8509-86d2461c38f7 admin admin] The token cache is being invalidate because project 9a1471173bc34699b711ddef1072092c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:40.099383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9a1f4739-8b3e-4d78-8509-86d2461c38f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.100674 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9a1f4739-8b3e-4d78-8509-86d2461c38f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.102374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 914/1820] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:39 2022] DELETE /identity/v3/projects/9a1471173bc34699b711ddef1072092c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:40.107079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a056eea-49c5-49be-9dec-48fac5c1bea9 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.107402 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a056eea-49c5-49be-9dec-48fac5c1bea9 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.107688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a056eea-49c5-49be-9dec-48fac5c1bea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.126383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-7a056eea-49c5-49be-9dec-48fac5c1bea9 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:40.128140 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7a056eea-49c5-49be-9dec-48fac5c1bea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:40.147679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf37553-da63-4e85-a206-83290be5560a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:40.193749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 915/1821] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:40.195504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687e856-a555-417f-a43c-1723dd1f77b5 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.195794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687e856-a555-417f-a43c-1723dd1f77b5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.196115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687e856-a555-417f-a43c-1723dd1f77b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.207536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:40.208457 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.208743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.209029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] PATH_INFO: `/v3/users/2a157e04dd264a65a7a10fa24264360e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.210372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a157e04dd264a65a7a10fa24264360e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:40.212398 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:40.215828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-6687e856-a555-417f-a43c-1723dd1f77b5 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:40.217061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6687e856-a555-417f-a43c-1723dd1f77b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:40.225368 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 916/1822] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:40.229494 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687e856-a555-417f-a43c-1723dd1f77b5 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:40.239405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687e856-a555-417f-a43c-1723dd1f77b5 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:40.244936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811bff1-0dc8-4e05-b319-b28632998719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:40.245605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bff1-0dc8-4e05-b319-b28632998719 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.245787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bff1-0dc8-4e05-b319-b28632998719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.246016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811bff1-0dc8-4e05-b319-b28632998719 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.246757 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811bff1-0dc8-4e05-b319-b28632998719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:40.247061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811bff1-0dc8-4e05-b319-b28632998719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:40.248720 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811bff1-0dc8-4e05-b319-b28632998719 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:40.261767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 917/1823] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:48:40.266156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811bff1-0dc8-4e05-b319-b28632998719 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:40.268111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a157e04dd264a65a7a10fa24264360e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.278081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811bff1-0dc8-4e05-b319-b28632998719 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:40.279485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a157e04dd264a65a7a10fa24264360e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.284909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43121e-81a2-43ca-a24b-7eeda2c56f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:40.285571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43121e-81a2-43ca-a24b-7eeda2c56f6b admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.285855 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43121e-81a2-43ca-a24b-7eeda2c56f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.286130 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43121e-81a2-43ca-a24b-7eeda2c56f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.286821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43121e-81a2-43ca-a24b-7eeda2c56f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:40.288793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43121e-81a2-43ca-a24b-7eeda2c56f6b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:40.290006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a157e04dd264a65a7a10fa24264360e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.290962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a157e04dd264a65a7a10fa24264360e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.291598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a157e04dd264a65a7a10fa24264360e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.312669 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 907/1824] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:40 2022] DELETE /identity/v3/users/2a157e04dd264a65a7a10fa24264360e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:40.333901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 918/1825] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:40 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:40.337603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:40.339025 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:40.413592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce59b7-9b34-4ce9-8d55-1736590434d5 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:40.470689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e786831-c3d9-4c6d-86c5-5a068c25fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:40.471505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e786831-c3d9-4c6d-86c5-5a068c25fd56 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.471790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e786831-c3d9-4c6d-86c5-5a068c25fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.472099 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e786831-c3d9-4c6d-86c5-5a068c25fd56 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.472812 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e786831-c3d9-4c6d-86c5-5a068c25fd56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:40.474769 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e786831-c3d9-4c6d-86c5-5a068c25fd56 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:40.495283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 908/1826] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:40 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:40.500285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43121e-81a2-43ca-a24b-7eeda2c56f6b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:40.517671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43121e-81a2-43ca-a24b-7eeda2c56f6b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:40.524562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ff8ad-cb47-490b-986e-188384c417bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:40.525230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ff8ad-cb47-490b-986e-188384c417bb admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.525558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ff8ad-cb47-490b-986e-188384c417bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.525834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ff8ad-cb47-490b-986e-188384c417bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.526617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ff8ad-cb47-490b-986e-188384c417bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:40.528307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ff8ad-cb47-490b-986e-188384c417bb admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:40.541021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 919/1827] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:40.544673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e786831-c3d9-4c6d-86c5-5a068c25fd56 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:40.555151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e786831-c3d9-4c6d-86c5-5a068c25fd56 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:40.560649 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a02af-1ddf-401d-93cc-995624520c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:40.561323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a02af-1ddf-401d-93cc-995624520c9f admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.561610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a02af-1ddf-401d-93cc-995624520c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.561890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a02af-1ddf-401d-93cc-995624520c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.562625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a02af-1ddf-401d-93cc-995624520c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:40.564253 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a02af-1ddf-401d-93cc-995624520c9f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:40.575552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 909/1828] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:40.580076 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ff8ad-cb47-490b-986e-188384c417bb admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:40.591411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ff8ad-cb47-490b-986e-188384c417bb admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:40.596000 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2d0aa-50a5-4446-ac45-a08cacb67ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:40.596931 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2d0aa-50a5-4446-ac45-a08cacb67ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.597212 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2d0aa-50a5-4446-ac45-a08cacb67ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.597488 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2d0aa-50a5-4446-ac45-a08cacb67ca8 admin admin] PATH_INFO: `/v3/projects/dcb6451f84de4561bb1abf113db49587/users/a0bd384c54844c0cb312225dc47403d9/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.613272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2d0aa-50a5-4446-ac45-a08cacb67ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb6451f84de4561bb1abf113db49587, user_id=a0bd384c54844c0cb312225dc47403d9, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:40.616046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2d0aa-50a5-4446-ac45-a08cacb67ca8 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:40.629534 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 920/1829] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:40 2022] PUT /identity/v3/projects/dcb6451f84de4561bb1abf113db49587/users/a0bd384c54844c0cb312225dc47403d9/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:40.639387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a02af-1ddf-401d-93cc-995624520c9f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:40.640124 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af3fa3-22d4-432a-9cbd-fe7ccff08b51 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.640412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af3fa3-22d4-432a-9cbd-fe7ccff08b51 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.640782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af3fa3-22d4-432a-9cbd-fe7ccff08b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.646233 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c51a02af-1ddf-401d-93cc-995624520c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:40.659374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a02af-1ddf-401d-93cc-995624520c9f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:40.678564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-93af3fa3-22d4-432a-9cbd-fe7ccff08b51 None None] MFA Rules not processed for user `a0bd384c54844c0cb312225dc47403d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:40.679841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-93af3fa3-22d4-432a-9cbd-fe7ccff08b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:40.727089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b78855-08de-43a1-bad5-68dd0939965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:40.727985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b78855-08de-43a1-bad5-68dd0939965a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.728275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b78855-08de-43a1-bad5-68dd0939965a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.728538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b78855-08de-43a1-bad5-68dd0939965a admin admin] PATH_INFO: `/v3/projects/8daaed5103d24e4eb1a8cef80efa6a24` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.729722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b78855-08de-43a1-bad5-68dd0939965a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8daaed5103d24e4eb1a8cef80efa6a24)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:40.731824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b78855-08de-43a1-bad5-68dd0939965a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:40.749816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 921/1830] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:40.754473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af3fa3-22d4-432a-9cbd-fe7ccff08b51 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:40.767909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af3fa3-22d4-432a-9cbd-fe7ccff08b51 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:40.774315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca5b9f-a224-42a8-9086-1b348cd1359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:40.775065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca5b9f-a224-42a8-9086-1b348cd1359a admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.775422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca5b9f-a224-42a8-9086-1b348cd1359a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.775747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca5b9f-a224-42a8-9086-1b348cd1359a admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.776490 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca5b9f-a224-42a8-9086-1b348cd1359a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:40.778803 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca5b9f-a224-42a8-9086-1b348cd1359a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:40.788155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62b78855-08de-43a1-bad5-68dd0939965a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8daaed5103d24e4eb1a8cef80efa6a24', 'request_id': 'req-62b78855-08de-43a1-bad5-68dd0939965a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.796890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62b78855-08de-43a1-bad5-68dd0939965a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8daaed5103d24e4eb1a8cef80efa6a24', 'request_id': 'req-62b78855-08de-43a1-bad5-68dd0939965a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.805917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62b78855-08de-43a1-bad5-68dd0939965a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8daaed5103d24e4eb1a8cef80efa6a24', 'request_id': 'req-62b78855-08de-43a1-bad5-68dd0939965a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.809954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 922/1831] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:40 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:40.814257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca5b9f-a224-42a8-9086-1b348cd1359a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:40.819096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62b78855-08de-43a1-bad5-68dd0939965a admin admin] The token cache is being invalidate because project 8daaed5103d24e4eb1a8cef80efa6a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:40.819594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62b78855-08de-43a1-bad5-68dd0939965a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.820484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62b78855-08de-43a1-bad5-68dd0939965a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:40.822222 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 910/1832] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:40 2022] DELETE /identity/v3/projects/8daaed5103d24e4eb1a8cef80efa6a24 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:40.827861 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7babcc3-904b-4d8c-8938-bf5f90be884f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.828149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7babcc3-904b-4d8c-8938-bf5f90be884f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.828425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7babcc3-904b-4d8c-8938-bf5f90be884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.846194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b7babcc3-904b-4d8c-8938-bf5f90be884f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:40.848103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b7babcc3-904b-4d8c-8938-bf5f90be884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:40.913727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca5b9f-a224-42a8-9086-1b348cd1359a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:40.924020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a63e0-a1ee-4d55-bd19-7f1b46b15454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:40.927529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a63e0-a1ee-4d55-bd19-7f1b46b15454 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.927745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a63e0-a1ee-4d55-bd19-7f1b46b15454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.928077 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a63e0-a1ee-4d55-bd19-7f1b46b15454 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.928735 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a63e0-a1ee-4d55-bd19-7f1b46b15454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:40.935038 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a63e0-a1ee-4d55-bd19-7f1b46b15454 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:40.943555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 911/1833] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:40.952491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589ef83-f150-4941-a5c4-2203480e49f0 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:40.952699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589ef83-f150-4941-a5c4-2203480e49f0 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:40.952978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589ef83-f150-4941-a5c4-2203480e49f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:40.979845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-3589ef83-f150-4941-a5c4-2203480e49f0 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:40.981103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3589ef83-f150-4941-a5c4-2203480e49f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:40.984172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 923/1834] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:40 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:40.986614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a63e0-a1ee-4d55-bd19-7f1b46b15454 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:40.991879 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-aa5a63e0-a1ee-4d55-bd19-7f1b46b15454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:41.000574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 912/1835] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:41.000574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589ef83-f150-4941-a5c4-2203480e49f0 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:41.006151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589ef83-f150-4941-a5c4-2203480e49f0 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:41.011034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa77b2a-91d1-4e56-b256-291756ab62e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:41.011735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa77b2a-91d1-4e56-b256-291756ab62e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.012129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa77b2a-91d1-4e56-b256-291756ab62e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.012305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa77b2a-91d1-4e56-b256-291756ab62e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.013019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa77b2a-91d1-4e56-b256-291756ab62e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:41.013539 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa77b2a-91d1-4e56-b256-291756ab62e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:41.014902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa77b2a-91d1-4e56-b256-291756ab62e7 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:41.029505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 913/1836] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:41.032037 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a63e0-a1ee-4d55-bd19-7f1b46b15454 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:41.035158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa77b2a-91d1-4e56-b256-291756ab62e7 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:41.041210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937de55-3880-4444-ba65-a2309b600a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:41.042211 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937de55-3880-4444-ba65-a2309b600a76 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.042994 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937de55-3880-4444-ba65-a2309b600a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.043805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937de55-3880-4444-ba65-a2309b600a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.046684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937de55-3880-4444-ba65-a2309b600a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:41.046792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa77b2a-91d1-4e56-b256-291756ab62e7 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:41.048454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937de55-3880-4444-ba65-a2309b600a76 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:41.058364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc9b68-4207-4a80-b59c-fac60bd206c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:41.059407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc9b68-4207-4a80-b59c-fac60bd206c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.060169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc9b68-4207-4a80-b59c-fac60bd206c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.060818 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc9b68-4207-4a80-b59c-fac60bd206c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.061978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc9b68-4207-4a80-b59c-fac60bd206c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:41.064765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc9b68-4207-4a80-b59c-fac60bd206c7 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:41.065941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 924/1837] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:41.067350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937de55-3880-4444-ba65-a2309b600a76 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:41.079619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937de55-3880-4444-ba65-a2309b600a76 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:41.088575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e70ff-7d5d-4e35-90b2-31e44f4a1cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:41.089668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e70ff-7d5d-4e35-90b2-31e44f4a1cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.090027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e70ff-7d5d-4e35-90b2-31e44f4a1cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.091887 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e70ff-7d5d-4e35-90b2-31e44f4a1cf4 admin admin] PATH_INFO: `/v3/projects/bb820e5f8d3a4b1caeb0bf0237538737/users/44e93c51a97f4f2fb0c731560dd59783/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.110516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e70ff-7d5d-4e35-90b2-31e44f4a1cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb820e5f8d3a4b1caeb0bf0237538737, user_id=44e93c51a97f4f2fb0c731560dd59783, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:41.114222 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e70ff-7d5d-4e35-90b2-31e44f4a1cf4 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:41.115683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 914/1838] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:41 2022] POST /identity/v3/projects => generated 391 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:41.120232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc9b68-4207-4a80-b59c-fac60bd206c7 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:41.142707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 925/1839] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:41 2022] PUT /identity/v3/projects/bb820e5f8d3a4b1caeb0bf0237538737/users/44e93c51a97f4f2fb0c731560dd59783/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:41.147316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e70ff-7d5d-4e35-90b2-31e44f4a1cf4 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:41.210663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc9b68-4207-4a80-b59c-fac60bd206c7 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:41.286754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f41c6-81d5-42c2-8331-7c78d62828ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:41.287535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f41c6-81d5-42c2-8331-7c78d62828ab admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.287912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f41c6-81d5-42c2-8331-7c78d62828ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.288256 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f41c6-81d5-42c2-8331-7c78d62828ab admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.289019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f41c6-81d5-42c2-8331-7c78d62828ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:41.291068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f41c6-81d5-42c2-8331-7c78d62828ab admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:41.291927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e70ff-7d5d-4e35-90b2-31e44f4a1cf4 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:41.301075 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce17b3-aaa2-4685-a716-f7d6ab1617b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:41.301767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce17b3-aaa2-4685-a716-f7d6ab1617b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.302138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce17b3-aaa2-4685-a716-f7d6ab1617b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.302461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce17b3-aaa2-4685-a716-f7d6ab1617b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.303267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce17b3-aaa2-4685-a716-f7d6ab1617b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:41.307361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce17b3-aaa2-4685-a716-f7d6ab1617b0 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:41.321996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 915/1840] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:41 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:41.322531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f41c6-81d5-42c2-8331-7c78d62828ab admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:41.331588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 926/1841] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:41.332489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce17b3-aaa2-4685-a716-f7d6ab1617b0 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:41.335774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f41c6-81d5-42c2-8331-7c78d62828ab admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:41.341232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3d736-8512-4f36-ab9e-c7523b9b0133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:41.341906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3d736-8512-4f36-ab9e-c7523b9b0133 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.342189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3d736-8512-4f36-ab9e-c7523b9b0133 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.342463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3d736-8512-4f36-ab9e-c7523b9b0133 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.343439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3d736-8512-4f36-ab9e-c7523b9b0133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:41.345925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3d736-8512-4f36-ab9e-c7523b9b0133 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:41.354103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce17b3-aaa2-4685-a716-f7d6ab1617b0 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:41.360120 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 916/1842] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:41.364570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3d736-8512-4f36-ab9e-c7523b9b0133 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:41.366216 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd323f-0cac-429b-b618-be581eba980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:41.367476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd323f-0cac-429b-b618-be581eba980f admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.367947 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd323f-0cac-429b-b618-be581eba980f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.368341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd323f-0cac-429b-b618-be581eba980f admin admin] PATH_INFO: `/v3/projects/bb820e5f8d3a4b1caeb0bf0237538737/users/44e93c51a97f4f2fb0c731560dd59783/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.370800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd323f-0cac-429b-b618-be581eba980f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb820e5f8d3a4b1caeb0bf0237538737, user_id=44e93c51a97f4f2fb0c731560dd59783, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:41.373696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd323f-0cac-429b-b618-be581eba980f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:41.384669 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3d736-8512-4f36-ab9e-c7523b9b0133 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:41.389874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 927/1843] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:41 2022] PUT /identity/v3/projects/bb820e5f8d3a4b1caeb0bf0237538737/users/44e93c51a97f4f2fb0c731560dd59783/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:41.401400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b2972-2f54-4859-945b-e3e9ea93153a None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.403414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b2972-2f54-4859-945b-e3e9ea93153a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.403697 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b2972-2f54-4859-945b-e3e9ea93153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.467556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-016b2972-2f54-4859-945b-e3e9ea93153a None None] MFA Rules not processed for user `44e93c51a97f4f2fb0c731560dd59783`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:41.468779 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-016b2972-2f54-4859-945b-e3e9ea93153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:41.473096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed60f7-3d28-4446-8632-a2385709076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:41.475019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed60f7-3d28-4446-8632-a2385709076b admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.475336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed60f7-3d28-4446-8632-a2385709076b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.477682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed60f7-3d28-4446-8632-a2385709076b admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.478672 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed60f7-3d28-4446-8632-a2385709076b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:41.487990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed60f7-3d28-4446-8632-a2385709076b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:41.502373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 917/1844] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:41.506530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed60f7-3d28-4446-8632-a2385709076b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:41.526869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed60f7-3d28-4446-8632-a2385709076b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:41.544066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad6aeb-7afa-4d3b-9ddf-971c44984139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:41.544892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad6aeb-7afa-4d3b-9ddf-971c44984139 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.545170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad6aeb-7afa-4d3b-9ddf-971c44984139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.545446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad6aeb-7afa-4d3b-9ddf-971c44984139 admin admin] PATH_INFO: `/v3/projects/1879df6f8e44479f95b873109ab19441/users/4b1ee27bf06647d19093d5b20d93f101/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.562680 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 928/1845] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:41.582839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad6aeb-7afa-4d3b-9ddf-971c44984139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1879df6f8e44479f95b873109ab19441, user_id=4b1ee27bf06647d19093d5b20d93f101, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:41.587810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad6aeb-7afa-4d3b-9ddf-971c44984139 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:41.608907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 918/1846] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:41 2022] PUT /identity/v3/projects/1879df6f8e44479f95b873109ab19441/users/4b1ee27bf06647d19093d5b20d93f101/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:41.619236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83786a0-6da9-4217-81b3-c41ed4fad595 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.619624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83786a0-6da9-4217-81b3-c41ed4fad595 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.619917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83786a0-6da9-4217-81b3-c41ed4fad595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.669657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad6aeb-7afa-4d3b-9ddf-971c44984139 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:41.672215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-77ad6aeb-7afa-4d3b-9ddf-971c44984139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:41.672345 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-e83786a0-6da9-4217-81b3-c41ed4fad595 None None] MFA Rules not processed for user `4b1ee27bf06647d19093d5b20d93f101`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:41.673561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e83786a0-6da9-4217-81b3-c41ed4fad595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:41.760637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad6aeb-7afa-4d3b-9ddf-971c44984139 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:41.772220 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29817af-f68b-45a7-bee1-0970d698d8e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:41.774637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29817af-f68b-45a7-bee1-0970d698d8e0 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.774926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29817af-f68b-45a7-bee1-0970d698d8e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.775233 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29817af-f68b-45a7-bee1-0970d698d8e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.799800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 929/1847] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:41.804006 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83786a0-6da9-4217-81b3-c41ed4fad595 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:41.885596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83786a0-6da9-4217-81b3-c41ed4fad595 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:41.886289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29817af-f68b-45a7-bee1-0970d698d8e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:41.889676 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29817af-f68b-45a7-bee1-0970d698d8e0 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:41.892097 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae0f86-09d8-4ead-beaa-3c29d41c9505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:41.893930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae0f86-09d8-4ead-beaa-3c29d41c9505 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:41.894221 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae0f86-09d8-4ead-beaa-3c29d41c9505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:41.894822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae0f86-09d8-4ead-beaa-3c29d41c9505 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:41.895198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae0f86-09d8-4ead-beaa-3c29d41c9505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:41.897654 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae0f86-09d8-4ead-beaa-3c29d41c9505 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:41.906140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 919/1848] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:41.938442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 930/1849] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:41 2022] POST /identity/v3/projects => generated 393 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:41.946115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29817af-f68b-45a7-bee1-0970d698d8e0 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:41.957139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29817af-f68b-45a7-bee1-0970d698d8e0 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:42.071078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd27e2-5469-487c-a33b-f36b415a6a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:42.071836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd27e2-5469-487c-a33b-f36b415a6a08 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:42.072185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd27e2-5469-487c-a33b-f36b415a6a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:42.072472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd27e2-5469-487c-a33b-f36b415a6a08 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:42.073176 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd27e2-5469-487c-a33b-f36b415a6a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:42.077779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd27e2-5469-487c-a33b-f36b415a6a08 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:42.084286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae0f86-09d8-4ead-beaa-3c29d41c9505 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:42.106859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae0f86-09d8-4ead-beaa-3c29d41c9505 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:42.118580 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 920/1850] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:41 2022] POST /identity/v3/users => generated 303 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:42.120243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd27e2-5469-487c-a33b-f36b415a6a08 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:42.125036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:42.126125 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:42.127190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:42.127559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] PATH_INFO: `/v3/users/a0bd384c54844c0cb312225dc47403d9` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:42.130543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0bd384c54844c0cb312225dc47403d9)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:42.134113 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:42.146007 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd27e2-5469-487c-a33b-f36b415a6a08 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:42.158170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5a674-62a7-449a-9402-0f545835909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:42.159004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a674-62a7-449a-9402-0f545835909f admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:42.159470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a674-62a7-449a-9402-0f545835909f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:42.159837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a674-62a7-449a-9402-0f545835909f admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:42.160794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5a674-62a7-449a-9402-0f545835909f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:42.163236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5a674-62a7-449a-9402-0f545835909f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:42.176890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 921/1851] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:42.178035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5a674-62a7-449a-9402-0f545835909f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:42.227162 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0bd384c54844c0cb312225dc47403d9'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:42.240178 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0bd384c54844c0cb312225dc47403d9'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:42.240961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0bd384c54844c0cb312225dc47403d9'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:42.256626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0bd384c54844c0cb312225dc47403d9'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:42.280205 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5a674-62a7-449a-9402-0f545835909f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:42.281713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0bd384c54844c0cb312225dc47403d9'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:42.291988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ff82-fe42-41f6-af8a-a5c15b1223f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:42.292745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ff82-fe42-41f6-af8a-a5c15b1223f4 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:42.293102 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ff82-fe42-41f6-af8a-a5c15b1223f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:42.293454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ff82-fe42-41f6-af8a-a5c15b1223f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:42.306427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 931/1852] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:42 2022] DELETE /identity/v3/users/a0bd384c54844c0cb312225dc47403d9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:42.306427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:42.306667 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8675ff82-fe42-41f6-af8a-a5c15b1223f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:42.308795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:42.435351 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675ff82-fe42-41f6-af8a-a5c15b1223f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:42.437339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675ff82-fe42-41f6-af8a-a5c15b1223f4 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:42.451383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 922/1853] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:42.453357 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757780a-09ea-43c1-9144-d88e8f7ef3ef None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:42.453858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757780a-09ea-43c1-9144-d88e8f7ef3ef None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:42.454473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757780a-09ea-43c1-9144-d88e8f7ef3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:42.476581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-3757780a-09ea-43c1-9144-d88e8f7ef3ef None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:42.478335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3757780a-09ea-43c1-9144-d88e8f7ef3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:42.525263 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9528a5-5655-413b-8fc5-5f61de69196d admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:42.551461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdbd0d-7581-4e20-b2e1-bba18894c32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:42.552644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdbd0d-7581-4e20-b2e1-bba18894c32e admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:42.552644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdbd0d-7581-4e20-b2e1-bba18894c32e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:42.552920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdbd0d-7581-4e20-b2e1-bba18894c32e admin admin] PATH_INFO: `/v3/projects/d04cc612c0a94642949b667f3119bf84/users/a78f5107e08941dea43643498e8e1b19/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:42.594859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdbd0d-7581-4e20-b2e1-bba18894c32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04cc612c0a94642949b667f3119bf84, user_id=a78f5107e08941dea43643498e8e1b19, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:42.603942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 923/1854] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:42.605328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdbd0d-7581-4e20-b2e1-bba18894c32e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:42.628416 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757780a-09ea-43c1-9144-d88e8f7ef3ef None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:42.629989 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3757780a-09ea-43c1-9144-d88e8f7ef3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:42.653763 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 932/1855] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:42 2022] PUT /identity/v3/projects/d04cc612c0a94642949b667f3119bf84/users/a78f5107e08941dea43643498e8e1b19/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:42.657738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdbd0d-7581-4e20-b2e1-bba18894c32e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:42.830220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdbd0d-7581-4e20-b2e1-bba18894c32e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:42.845791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634ff72-166e-4afb-8472-7bbbccbbe703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:42.848194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634ff72-166e-4afb-8472-7bbbccbbe703 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:42.849923 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634ff72-166e-4afb-8472-7bbbccbbe703 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:42.850446 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634ff72-166e-4afb-8472-7bbbccbbe703 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:42.852259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634ff72-166e-4afb-8472-7bbbccbbe703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:42.856578 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634ff72-166e-4afb-8472-7bbbccbbe703 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:42.873890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 933/1856] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:42.878362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634ff72-166e-4afb-8472-7bbbccbbe703 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:42.890560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634ff72-166e-4afb-8472-7bbbccbbe703 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:42.899905 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d504a-6659-4618-a3d3-6f63f294afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:42.901005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d504a-6659-4618-a3d3-6f63f294afae admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:42.901350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d504a-6659-4618-a3d3-6f63f294afae admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:42.901721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d504a-6659-4618-a3d3-6f63f294afae admin admin] PATH_INFO: `/v3/projects/d04cc612c0a94642949b667f3119bf84/users/a78f5107e08941dea43643498e8e1b19/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:42.904479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d504a-6659-4618-a3d3-6f63f294afae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04cc612c0a94642949b667f3119bf84, user_id=a78f5107e08941dea43643498e8e1b19, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:42.909478 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d504a-6659-4618-a3d3-6f63f294afae admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:42.921210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 934/1857] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:42 2022] PUT /identity/v3/projects/d04cc612c0a94642949b667f3119bf84/users/a78f5107e08941dea43643498e8e1b19/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:42.933029 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1af29b-217d-41e9-8d91-edfbf0216e69 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:42.933422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1af29b-217d-41e9-8d91-edfbf0216e69 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:42.933801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1af29b-217d-41e9-8d91-edfbf0216e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:42.979798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-1e1af29b-217d-41e9-8d91-edfbf0216e69 None None] MFA Rules not processed for user `a78f5107e08941dea43643498e8e1b19`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:42.981429 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1e1af29b-217d-41e9-8d91-edfbf0216e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:43.021074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757780a-09ea-43c1-9144-d88e8f7ef3ef None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:43.083376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 935/1858] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:43.085926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f45baa-fd98-461a-a7ce-dde55eda24ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:43.086795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f45baa-fd98-461a-a7ce-dde55eda24ba service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:43.086994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f45baa-fd98-461a-a7ce-dde55eda24ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:43.087392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f45baa-fd98-461a-a7ce-dde55eda24ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:43.105989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1af29b-217d-41e9-8d91-edfbf0216e69 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:43.108867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1e1af29b-217d-41e9-8d91-edfbf0216e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:43.164956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f45baa-fd98-461a-a7ce-dde55eda24ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:43.166753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f45baa-fd98-461a-a7ce-dde55eda24ba service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:43.173424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1af29b-217d-41e9-8d91-edfbf0216e69 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:43.177907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538436d-b777-4aa6-834a-7d02eb6a4b01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:43.178727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538436d-b777-4aa6-834a-7d02eb6a4b01 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:43.179030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538436d-b777-4aa6-834a-7d02eb6a4b01 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:43.179404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538436d-b777-4aa6-834a-7d02eb6a4b01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:43.182772 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 924/1859] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:43.188822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538436d-b777-4aa6-834a-7d02eb6a4b01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:43.190299 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538436d-b777-4aa6-834a-7d02eb6a4b01 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:43.201898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 936/1860] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:43.272899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f45baa-fd98-461a-a7ce-dde55eda24ba service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:43.285544 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f45baa-fd98-461a-a7ce-dde55eda24ba service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:43.289572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add8602-c982-46d6-9136-c154b0994076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:43.290376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add8602-c982-46d6-9136-c154b0994076 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:43.290657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add8602-c982-46d6-9136-c154b0994076 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:43.290930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add8602-c982-46d6-9136-c154b0994076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:43.293109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9add8602-c982-46d6-9136-c154b0994076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:43.375858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add8602-c982-46d6-9136-c154b0994076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:43.377395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add8602-c982-46d6-9136-c154b0994076 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:43.386111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 925/1861] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:43.472328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538436d-b777-4aa6-834a-7d02eb6a4b01 service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:43.474336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2538436d-b777-4aa6-834a-7d02eb6a4b01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:43.504078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538436d-b777-4aa6-834a-7d02eb6a4b01 service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:43.510405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:43.511295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:43.511586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:43.511861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] PATH_INFO: `/v3/projects/dcb6451f84de4561bb1abf113db49587` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:43.513047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb6451f84de4561bb1abf113db49587)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:43.515067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:43.577049 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb6451f84de4561bb1abf113db49587', 'request_id': 'req-32d954e7-8966-49f3-90f3-66259dbdbdfd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:43.583750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb6451f84de4561bb1abf113db49587', 'request_id': 'req-32d954e7-8966-49f3-90f3-66259dbdbdfd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:43.593275 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb6451f84de4561bb1abf113db49587', 'request_id': 'req-32d954e7-8966-49f3-90f3-66259dbdbdfd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:43.608431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] The token cache is being invalidate because project dcb6451f84de4561bb1abf113db49587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:43.609360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:43.610692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:43.613442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 937/1862] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:43 2022] DELETE /identity/v3/projects/dcb6451f84de4561bb1abf113db49587 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:43.619117 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add8602-c982-46d6-9136-c154b0994076 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:43.643385 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add8602-c982-46d6-9136-c154b0994076 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:43.706795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a95603-a9a2-4710-a42d-e1263e6a726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:43.707695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a95603-a9a2-4710-a42d-e1263e6a726c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:43.707970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a95603-a9a2-4710-a42d-e1263e6a726c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:43.708240 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a95603-a9a2-4710-a42d-e1263e6a726c admin admin] PATH_INFO: `/v3/users/44e93c51a97f4f2fb0c731560dd59783` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:43.709509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a95603-a9a2-4710-a42d-e1263e6a726c admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e93c51a97f4f2fb0c731560dd59783)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:43.711442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a95603-a9a2-4710-a42d-e1263e6a726c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:43.756822 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-66a95603-a9a2-4710-a42d-e1263e6a726c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e93c51a97f4f2fb0c731560dd59783'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:43.763195 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-66a95603-a9a2-4710-a42d-e1263e6a726c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e93c51a97f4f2fb0c731560dd59783'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:43.770516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-66a95603-a9a2-4710-a42d-e1263e6a726c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e93c51a97f4f2fb0c731560dd59783'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:43.771197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-66a95603-a9a2-4710-a42d-e1263e6a726c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e93c51a97f4f2fb0c731560dd59783'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:43.772013 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-66a95603-a9a2-4710-a42d-e1263e6a726c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e93c51a97f4f2fb0c731560dd59783'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:43.790109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 926/1863] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:43 2022] DELETE /identity/v3/users/44e93c51a97f4f2fb0c731560dd59783 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:44.136089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:44.137730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:44.161700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d954e7-8966-49f3-90f3-66259dbdbdfd admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:44.222916 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a3c59-e4d7-4182-a94c-802646cd8d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:44.223914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a3c59-e4d7-4182-a94c-802646cd8d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:44.224261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a3c59-e4d7-4182-a94c-802646cd8d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:44.224537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a3c59-e4d7-4182-a94c-802646cd8d23 admin admin] PATH_INFO: `/v3/projects/bb820e5f8d3a4b1caeb0bf0237538737` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:44.225704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a3c59-e4d7-4182-a94c-802646cd8d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb820e5f8d3a4b1caeb0bf0237538737)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:44.227621 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a3c59-e4d7-4182-a94c-802646cd8d23 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:44.274606 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-610a3c59-e4d7-4182-a94c-802646cd8d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb820e5f8d3a4b1caeb0bf0237538737', 'request_id': 'req-610a3c59-e4d7-4182-a94c-802646cd8d23'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:44.280627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-610a3c59-e4d7-4182-a94c-802646cd8d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb820e5f8d3a4b1caeb0bf0237538737', 'request_id': 'req-610a3c59-e4d7-4182-a94c-802646cd8d23'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:44.287750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-610a3c59-e4d7-4182-a94c-802646cd8d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb820e5f8d3a4b1caeb0bf0237538737', 'request_id': 'req-610a3c59-e4d7-4182-a94c-802646cd8d23'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:44.297458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-610a3c59-e4d7-4182-a94c-802646cd8d23 admin admin] The token cache is being invalidate because project bb820e5f8d3a4b1caeb0bf0237538737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:44.297739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-610a3c59-e4d7-4182-a94c-802646cd8d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:44.298350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-610a3c59-e4d7-4182-a94c-802646cd8d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:44.300440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 938/1864] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:44 2022] DELETE /identity/v3/projects/bb820e5f8d3a4b1caeb0bf0237538737 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:44.305406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea44420-8b1b-4b98-a3ec-4d4d82c361e0 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:44.305850 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea44420-8b1b-4b98-a3ec-4d4d82c361e0 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:44.305968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea44420-8b1b-4b98-a3ec-4d4d82c361e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:44.324138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-7ea44420-8b1b-4b98-a3ec-4d4d82c361e0 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:44.325314 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7ea44420-8b1b-4b98-a3ec-4d4d82c361e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:44.384062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 927/1865] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:44.393198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e0de9-79d7-4a9f-b7cb-044fc6c56aff None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:44.393483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e0de9-79d7-4a9f-b7cb-044fc6c56aff None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:44.393763 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e0de9-79d7-4a9f-b7cb-044fc6c56aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:44.412846 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-166e0de9-79d7-4a9f-b7cb-044fc6c56aff None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:44.414133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-166e0de9-79d7-4a9f-b7cb-044fc6c56aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:44.422331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 939/1866] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:44.427285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea44420-8b1b-4b98-a3ec-4d4d82c361e0 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:44.437077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea44420-8b1b-4b98-a3ec-4d4d82c361e0 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:44.442446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c55ea8-5c8b-41a6-a39a-8e996ef87d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:44.443129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c55ea8-5c8b-41a6-a39a-8e996ef87d80 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:44.443441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c55ea8-5c8b-41a6-a39a-8e996ef87d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:44.443715 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c55ea8-5c8b-41a6-a39a-8e996ef87d80 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:44.444456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c55ea8-5c8b-41a6-a39a-8e996ef87d80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:44.444760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c55ea8-5c8b-41a6-a39a-8e996ef87d80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:44.446478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c55ea8-5c8b-41a6-a39a-8e996ef87d80 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:44.462346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 928/1867] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:44.463642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e0de9-79d7-4a9f-b7cb-044fc6c56aff None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:44.473410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e0de9-79d7-4a9f-b7cb-044fc6c56aff None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:44.478145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e08eed-da6f-4c29-a42f-b51d40a6d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:44.478883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e08eed-da6f-4c29-a42f-b51d40a6d1ae admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:44.479245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e08eed-da6f-4c29-a42f-b51d40a6d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:44.479584 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e08eed-da6f-4c29-a42f-b51d40a6d1ae admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:44.480346 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e08eed-da6f-4c29-a42f-b51d40a6d1ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:44.482340 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e08eed-da6f-4c29-a42f-b51d40a6d1ae admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:44.513007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 940/1868] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:44 2022] POST /identity/v3/projects => generated 407 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:44.514492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c55ea8-5c8b-41a6-a39a-8e996ef87d80 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:44.524258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c55ea8-5c8b-41a6-a39a-8e996ef87d80 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:44.581555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee713d-6a69-404c-a7ea-9651639a27ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:44.582213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee713d-6a69-404c-a7ea-9651639a27ff admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:44.582492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee713d-6a69-404c-a7ea-9651639a27ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:44.582767 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee713d-6a69-404c-a7ea-9651639a27ff admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:44.583477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee713d-6a69-404c-a7ea-9651639a27ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:44.585361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee713d-6a69-404c-a7ea-9651639a27ff admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:44.605015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 929/1869] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:44 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:44.609109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e08eed-da6f-4c29-a42f-b51d40a6d1ae admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:44.619853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e08eed-da6f-4c29-a42f-b51d40a6d1ae admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:44.624588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555614fa-e810-4d23-93f1-d92176e5eb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:44.625244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555614fa-e810-4d23-93f1-d92176e5eb8a admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:44.625522 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555614fa-e810-4d23-93f1-d92176e5eb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:44.625815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555614fa-e810-4d23-93f1-d92176e5eb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:44.626536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555614fa-e810-4d23-93f1-d92176e5eb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:44.628129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555614fa-e810-4d23-93f1-d92176e5eb8a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:44.638168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 941/1870] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:44.641980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee713d-6a69-404c-a7ea-9651639a27ff admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:44.651514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee713d-6a69-404c-a7ea-9651639a27ff admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:44.656090 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1aa37-371a-436f-9623-cea710617aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:44.656735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1aa37-371a-436f-9623-cea710617aeb admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:44.657035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1aa37-371a-436f-9623-cea710617aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:44.657314 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1aa37-371a-436f-9623-cea710617aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:44.658030 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1aa37-371a-436f-9623-cea710617aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:44.660129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1aa37-371a-436f-9623-cea710617aeb admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:44.669719 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 930/1871] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:44.673818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555614fa-e810-4d23-93f1-d92176e5eb8a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:44.684108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555614fa-e810-4d23-93f1-d92176e5eb8a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:44.688688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64f64a-05be-48bf-ac18-6f6156c59cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:44.689551 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64f64a-05be-48bf-ac18-6f6156c59cce admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:44.689834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64f64a-05be-48bf-ac18-6f6156c59cce admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:44.690112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64f64a-05be-48bf-ac18-6f6156c59cce admin admin] PATH_INFO: `/v3/projects/bc6ef4b22c94402baed64e3558c53640/users/486e9687b6cb4720b89dc5214f3d79b6/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:44.705619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64f64a-05be-48bf-ac18-6f6156c59cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6ef4b22c94402baed64e3558c53640, user_id=486e9687b6cb4720b89dc5214f3d79b6, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:44.707793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64f64a-05be-48bf-ac18-6f6156c59cce admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:44.721181 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 942/1872] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:44 2022] PUT /identity/v3/projects/bc6ef4b22c94402baed64e3558c53640/users/486e9687b6cb4720b89dc5214f3d79b6/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:44.731948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48941c5d-3459-42d6-aa8f-50db2cc2b03f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:44.732266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48941c5d-3459-42d6-aa8f-50db2cc2b03f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:44.734452 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48941c5d-3459-42d6-aa8f-50db2cc2b03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:44.760323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-48941c5d-3459-42d6-aa8f-50db2cc2b03f None None] MFA Rules not processed for user `486e9687b6cb4720b89dc5214f3d79b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:44.761505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-48941c5d-3459-42d6-aa8f-50db2cc2b03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:44.821964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 931/1873] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:44.826587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64f64a-05be-48bf-ac18-6f6156c59cce admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:44.885049 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64f64a-05be-48bf-ac18-6f6156c59cce admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:44.889625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd7e64-4a3e-46dc-9627-17aec0e071c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:44.890303 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd7e64-4a3e-46dc-9627-17aec0e071c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:44.890585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd7e64-4a3e-46dc-9627-17aec0e071c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:44.890880 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd7e64-4a3e-46dc-9627-17aec0e071c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:44.891590 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd7e64-4a3e-46dc-9627-17aec0e071c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:44.893476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd7e64-4a3e-46dc-9627-17aec0e071c2 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:44.919381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 943/1874] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:44 2022] POST /identity/v3/projects => generated 409 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:44.923337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48941c5d-3459-42d6-aa8f-50db2cc2b03f None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:44.934309 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48941c5d-3459-42d6-aa8f-50db2cc2b03f None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:44.989122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d99fcd-64f4-45ba-a5ec-3848fa33287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:44.989802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d99fcd-64f4-45ba-a5ec-3848fa33287c admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:44.990086 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d99fcd-64f4-45ba-a5ec-3848fa33287c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:44.990359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d99fcd-64f4-45ba-a5ec-3848fa33287c admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:44.991044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d99fcd-64f4-45ba-a5ec-3848fa33287c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:44.992984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d99fcd-64f4-45ba-a5ec-3848fa33287c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:45.013699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 932/1875] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:44 2022] POST /identity/v3/users => generated 311 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:45.017845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd7e64-4a3e-46dc-9627-17aec0e071c2 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:45.028491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd7e64-4a3e-46dc-9627-17aec0e071c2 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:45.033142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b7ed4-d9e8-482c-93be-4e296f3c72d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:45.034366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7ed4-d9e8-482c-93be-4e296f3c72d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:45.034661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7ed4-d9e8-482c-93be-4e296f3c72d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:45.034936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7ed4-d9e8-482c-93be-4e296f3c72d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:45.035683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b7ed4-d9e8-482c-93be-4e296f3c72d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:45.037251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b7ed4-d9e8-482c-93be-4e296f3c72d5 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:45.047671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 944/1876] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:48:45.051818 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d99fcd-64f4-45ba-a5ec-3848fa33287c admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:45.061556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d99fcd-64f4-45ba-a5ec-3848fa33287c admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:45.066485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984c222-1510-44ad-b53e-401d6d4c6b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:45.067400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984c222-1510-44ad-b53e-401d6d4c6b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:45.067684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984c222-1510-44ad-b53e-401d6d4c6b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:45.067954 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984c222-1510-44ad-b53e-401d6d4c6b27 admin admin] PATH_INFO: `/v3/projects/908b9194ecd4489d86030f30e0306817/users/44d65e17fa20468fbaf143fa22354651/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:45.082892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984c222-1510-44ad-b53e-401d6d4c6b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908b9194ecd4489d86030f30e0306817, user_id=44d65e17fa20468fbaf143fa22354651, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:45.085557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984c222-1510-44ad-b53e-401d6d4c6b27 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:45.101255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 933/1877] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:45 2022] PUT /identity/v3/projects/908b9194ecd4489d86030f30e0306817/users/44d65e17fa20468fbaf143fa22354651/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:45.108392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b7ed4-d9e8-482c-93be-4e296f3c72d5 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:45.115659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b7ed4-d9e8-482c-93be-4e296f3c72d5 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:45.180683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de9a01-1806-452c-9eb4-6a5d23e2021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:45.181369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9a01-1806-452c-9eb4-6a5d23e2021d admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:45.181631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9a01-1806-452c-9eb4-6a5d23e2021d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:45.181904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de9a01-1806-452c-9eb4-6a5d23e2021d admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:45.182625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de9a01-1806-452c-9eb4-6a5d23e2021d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:45.184279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de9a01-1806-452c-9eb4-6a5d23e2021d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:45.194537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 945/1878] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:45.198625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984c222-1510-44ad-b53e-401d6d4c6b27 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:45.216098 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984c222-1510-44ad-b53e-401d6d4c6b27 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:45.220863 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077603e5-6161-40bb-9228-8f78ab4056ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:45.222318 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077603e5-6161-40bb-9228-8f78ab4056ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:45.222674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077603e5-6161-40bb-9228-8f78ab4056ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:45.222926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077603e5-6161-40bb-9228-8f78ab4056ba admin admin] PATH_INFO: `/v3/projects/908b9194ecd4489d86030f30e0306817/users/44d65e17fa20468fbaf143fa22354651/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:45.224925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077603e5-6161-40bb-9228-8f78ab4056ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=908b9194ecd4489d86030f30e0306817, user_id=44d65e17fa20468fbaf143fa22354651, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:45.227827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077603e5-6161-40bb-9228-8f78ab4056ba admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:45.238772 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 934/1879] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:45 2022] PUT /identity/v3/projects/908b9194ecd4489d86030f30e0306817/users/44d65e17fa20468fbaf143fa22354651/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:45.250343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdda152-0457-4b90-a901-6ca6b68c1351 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:45.250632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdda152-0457-4b90-a901-6ca6b68c1351 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:45.250982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdda152-0457-4b90-a901-6ca6b68c1351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:45.276987 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-cbdda152-0457-4b90-a901-6ca6b68c1351 None None] MFA Rules not processed for user `44d65e17fa20468fbaf143fa22354651`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:45.278411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-cbdda152-0457-4b90-a901-6ca6b68c1351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:45.350215 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 946/1880] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:45 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:45.361418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077603e5-6161-40bb-9228-8f78ab4056ba admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:45.363826 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-077603e5-6161-40bb-9228-8f78ab4056ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:45.425551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077603e5-6161-40bb-9228-8f78ab4056ba admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:45.429572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e660a8-cf96-4a6f-b991-da28bfd70f86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:45.430221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e660a8-cf96-4a6f-b991-da28bfd70f86 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:45.430503 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e660a8-cf96-4a6f-b991-da28bfd70f86 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:45.430779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e660a8-cf96-4a6f-b991-da28bfd70f86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:45.439889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e660a8-cf96-4a6f-b991-da28bfd70f86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:45.441599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e660a8-cf96-4a6f-b991-da28bfd70f86 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:45.451284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 935/1881] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:45 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:45.626451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdda152-0457-4b90-a901-6ca6b68c1351 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:45.636552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdda152-0457-4b90-a901-6ca6b68c1351 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:45.640535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723937ed-20df-4b47-b138-30f27afb3386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:45.641173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723937ed-20df-4b47-b138-30f27afb3386 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:45.641507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723937ed-20df-4b47-b138-30f27afb3386 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:45.641852 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723937ed-20df-4b47-b138-30f27afb3386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:45.699958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723937ed-20df-4b47-b138-30f27afb3386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:45.701649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723937ed-20df-4b47-b138-30f27afb3386 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:45.711039 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 947/1882] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:47.378970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e660a8-cf96-4a6f-b991-da28bfd70f86 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:47.382165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-24e660a8-cf96-4a6f-b991-da28bfd70f86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:47.452788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e660a8-cf96-4a6f-b991-da28bfd70f86 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:47.457317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:47.458184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:47.458462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:47.458731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] PATH_INFO: `/v3/users/8609ff70f50c448cb4c369309fdf4423` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:47.459940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8609ff70f50c448cb4c369309fdf4423)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:47.461888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:47.508786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8609ff70f50c448cb4c369309fdf4423'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:47.517064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8609ff70f50c448cb4c369309fdf4423'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:47.524739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8609ff70f50c448cb4c369309fdf4423'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:47.525414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8609ff70f50c448cb4c369309fdf4423'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:47.526033 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8609ff70f50c448cb4c369309fdf4423'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:47.542586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 936/1883] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:47 2022] DELETE /identity/v3/users/8609ff70f50c448cb4c369309fdf4423 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:47.546929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1140e88-d2f6-423b-a0e1-5407264c5fd9 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:47.547404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1140e88-d2f6-423b-a0e1-5407264c5fd9 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:47.547542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1140e88-d2f6-423b-a0e1-5407264c5fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:47.564594 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d1140e88-d2f6-423b-a0e1-5407264c5fd9 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:47.566650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d1140e88-d2f6-423b-a0e1-5407264c5fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:47.624279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 948/1884] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:47.633836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:47.635263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:47.691114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2173f6a-ef06-4b78-9045-ca9dbaef7210 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:47.694756 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9fd05-c96e-438e-b5ba-e9f104d4c726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:47.695434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9fd05-c96e-438e-b5ba-e9f104d4c726 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:47.695716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9fd05-c96e-438e-b5ba-e9f104d4c726 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:47.696010 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9fd05-c96e-438e-b5ba-e9f104d4c726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:47.705053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9fd05-c96e-438e-b5ba-e9f104d4c726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:47.706500 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9fd05-c96e-438e-b5ba-e9f104d4c726 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:47.715923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 937/1885] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:47.978133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1140e88-d2f6-423b-a0e1-5407264c5fd9 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:47.979709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d1140e88-d2f6-423b-a0e1-5407264c5fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:47.992047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1140e88-d2f6-423b-a0e1-5407264c5fd9 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:47.996916 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:47.998023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:47.998519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:47.999002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] PATH_INFO: `/v3/projects/cef39d07b8904c24a580eecab6c81bf4` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:48.000286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef39d07b8904c24a580eecab6c81bf4)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:48.002909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:48.054026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef39d07b8904c24a580eecab6c81bf4', 'request_id': 'req-a65b784a-2860-42eb-9299-4e1d7247da92'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.060693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef39d07b8904c24a580eecab6c81bf4', 'request_id': 'req-a65b784a-2860-42eb-9299-4e1d7247da92'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.071685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef39d07b8904c24a580eecab6c81bf4', 'request_id': 'req-a65b784a-2860-42eb-9299-4e1d7247da92'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.083780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] The token cache is being invalidate because project cef39d07b8904c24a580eecab6c81bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:48.084173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.084706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.086300 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 949/1886] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:47 2022] DELETE /identity/v3/projects/cef39d07b8904c24a580eecab6c81bf4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:48.090209 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9fd05-c96e-438e-b5ba-e9f104d4c726 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:48.100325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9fd05-c96e-438e-b5ba-e9f104d4c726 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:48.160863 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc9024-6a25-4d7f-9887-e5e345d12a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:48.161967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc9024-6a25-4d7f-9887-e5e345d12a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:48.162256 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc9024-6a25-4d7f-9887-e5e345d12a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:48.162531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc9024-6a25-4d7f-9887-e5e345d12a5d admin admin] PATH_INFO: `/v3/users/66f47bf7cf5e486c88d3979b011a1c8d` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:48.174058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc9024-6a25-4d7f-9887-e5e345d12a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f47bf7cf5e486c88d3979b011a1c8d)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:48.175242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc9024-6a25-4d7f-9887-e5e345d12a5d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:48.243419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-99cc9024-6a25-4d7f-9887-e5e345d12a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f47bf7cf5e486c88d3979b011a1c8d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.255148 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-99cc9024-6a25-4d7f-9887-e5e345d12a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f47bf7cf5e486c88d3979b011a1c8d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.265647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-99cc9024-6a25-4d7f-9887-e5e345d12a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f47bf7cf5e486c88d3979b011a1c8d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.266556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-99cc9024-6a25-4d7f-9887-e5e345d12a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f47bf7cf5e486c88d3979b011a1c8d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.267272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-99cc9024-6a25-4d7f-9887-e5e345d12a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f47bf7cf5e486c88d3979b011a1c8d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.305219 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 938/1887] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:48 2022] DELETE /identity/v3/users/66f47bf7cf5e486c88d3979b011a1c8d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:48.504343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:48.509279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:48.528529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b784a-2860-42eb-9299-4e1d7247da92 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:48.727431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:48.728640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:48.729654 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:48.730084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] PATH_INFO: `/v3/users/4b1ee27bf06647d19093d5b20d93f101` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:48.731556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1ee27bf06647d19093d5b20d93f101)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:48.733587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:48.817624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1ee27bf06647d19093d5b20d93f101'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.828813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1ee27bf06647d19093d5b20d93f101'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.829416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1ee27bf06647d19093d5b20d93f101'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.838532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1ee27bf06647d19093d5b20d93f101'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.850596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1ee27bf06647d19093d5b20d93f101'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:48.857287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 950/1888] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:48 2022] DELETE /identity/v3/users/4b1ee27bf06647d19093d5b20d93f101 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:48.865326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985c5ba-823b-4d81-8eb3-cf38f9e99e09 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:48.865799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985c5ba-823b-4d81-8eb3-cf38f9e99e09 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:48.866032 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985c5ba-823b-4d81-8eb3-cf38f9e99e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:48.867426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:48.869321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:48.910594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-4985c5ba-823b-4d81-8eb3-cf38f9e99e09 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:48.911975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4985c5ba-823b-4d81-8eb3-cf38f9e99e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:48.957729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e854da-b3bf-4356-b1e6-fc6a1c552c6e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:48.963331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc8915-d9db-45a9-b927-f79d81eee3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:48.964575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc8915-d9db-45a9-b927-f79d81eee3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:48.964575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc8915-d9db-45a9-b927-f79d81eee3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:48.965168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc8915-d9db-45a9-b927-f79d81eee3bd admin admin] PATH_INFO: `/v3/projects/91b377393a214cfaad14397d8118cf58` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:48.966549 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc8915-d9db-45a9-b927-f79d81eee3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b377393a214cfaad14397d8118cf58)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:48.968577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc8915-d9db-45a9-b927-f79d81eee3bd admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:48.979140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 939/1889] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:48.996274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985c5ba-823b-4d81-8eb3-cf38f9e99e09 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:48.997646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4985c5ba-823b-4d81-8eb3-cf38f9e99e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:49.020510 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-adcc8915-d9db-45a9-b927-f79d81eee3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b377393a214cfaad14397d8118cf58', 'request_id': 'req-adcc8915-d9db-45a9-b927-f79d81eee3bd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.026543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-adcc8915-d9db-45a9-b927-f79d81eee3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b377393a214cfaad14397d8118cf58', 'request_id': 'req-adcc8915-d9db-45a9-b927-f79d81eee3bd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.034233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-adcc8915-d9db-45a9-b927-f79d81eee3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b377393a214cfaad14397d8118cf58', 'request_id': 'req-adcc8915-d9db-45a9-b927-f79d81eee3bd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.044244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-adcc8915-d9db-45a9-b927-f79d81eee3bd admin admin] The token cache is being invalidate because project 91b377393a214cfaad14397d8118cf58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:49.044526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-adcc8915-d9db-45a9-b927-f79d81eee3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.045153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-adcc8915-d9db-45a9-b927-f79d81eee3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.046708 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 951/1890] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:48 2022] DELETE /identity/v3/projects/91b377393a214cfaad14397d8118cf58 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:49.052034 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91e062-4e85-4deb-a808-29e898117184 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.052311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91e062-4e85-4deb-a808-29e898117184 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.052580 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91e062-4e85-4deb-a808-29e898117184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.057275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985c5ba-823b-4d81-8eb3-cf38f9e99e09 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.070841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-9a91e062-4e85-4deb-a808-29e898117184 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:49.072126 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-9a91e062-4e85-4deb-a808-29e898117184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:49.104565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0062b-0052-44c4-8b55-f6ab5f44fb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.105132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0062b-0052-44c4-8b55-f6ab5f44fb05 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.105405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0062b-0052-44c4-8b55-f6ab5f44fb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.105672 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0062b-0052-44c4-8b55-f6ab5f44fb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.107434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-07e0062b-0052-44c4-8b55-f6ab5f44fb05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:49.128583 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 952/1891] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:49.136437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3370e-db75-461b-b6ec-48b0259d58b8 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.136730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3370e-db75-461b-b6ec-48b0259d58b8 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.137009 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3370e-db75-461b-b6ec-48b0259d58b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.154138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-fea3370e-db75-461b-b6ec-48b0259d58b8 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:49.155355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fea3370e-db75-461b-b6ec-48b0259d58b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:49.163745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 953/1892] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:49.167586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0062b-0052-44c4-8b55-f6ab5f44fb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.167765 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3370e-db75-461b-b6ec-48b0259d58b8 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.169029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0062b-0052-44c4-8b55-f6ab5f44fb05 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.176858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3370e-db75-461b-b6ec-48b0259d58b8 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.179246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 940/1893] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:49.181541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dd77b-4421-4a90-8835-8b11da2b9ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.182178 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd77b-4421-4a90-8835-8b11da2b9ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.182460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd77b-4421-4a90-8835-8b11da2b9ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.182733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd77b-4421-4a90-8835-8b11da2b9ae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.183486 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dd77b-4421-4a90-8835-8b11da2b9ae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:49.183790 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dd77b-4421-4a90-8835-8b11da2b9ae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.185508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dd77b-4421-4a90-8835-8b11da2b9ae4 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.200135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 954/1894] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:48:49.201459 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0062b-0052-44c4-8b55-f6ab5f44fb05 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.210725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0062b-0052-44c4-8b55-f6ab5f44fb05 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.215577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ce39-d962-4232-9300-9ae8dac10366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.216308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ce39-d962-4232-9300-9ae8dac10366 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.216638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ce39-d962-4232-9300-9ae8dac10366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.216978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ce39-d962-4232-9300-9ae8dac10366 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.217794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499ce39-d962-4232-9300-9ae8dac10366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.219762 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499ce39-d962-4232-9300-9ae8dac10366 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.248746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 941/1895] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:49 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:49.249919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dd77b-4421-4a90-8835-8b11da2b9ae4 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.259877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dd77b-4421-4a90-8835-8b11da2b9ae4 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.322412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab8233-c6c1-4c16-af0a-d0a12fba2aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.323154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab8233-c6c1-4c16-af0a-d0a12fba2aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.323471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab8233-c6c1-4c16-af0a-d0a12fba2aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.323740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab8233-c6c1-4c16-af0a-d0a12fba2aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.324426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab8233-c6c1-4c16-af0a-d0a12fba2aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.326529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab8233-c6c1-4c16-af0a-d0a12fba2aa0 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.350707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 955/1896] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:49 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:49.354784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ce39-d962-4232-9300-9ae8dac10366 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.366754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ce39-d962-4232-9300-9ae8dac10366 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.371592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75c4b-0e54-4cbf-b962-67e131665927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.372324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75c4b-0e54-4cbf-b962-67e131665927 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.372848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75c4b-0e54-4cbf-b962-67e131665927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.373192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75c4b-0e54-4cbf-b962-67e131665927 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.374019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75c4b-0e54-4cbf-b962-67e131665927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.375698 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75c4b-0e54-4cbf-b962-67e131665927 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.387243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 942/1897] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:49.391296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab8233-c6c1-4c16-af0a-d0a12fba2aa0 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.402013 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab8233-c6c1-4c16-af0a-d0a12fba2aa0 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.406984 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d751af-0801-47e7-96dc-dbe25a2e91e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.407698 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d751af-0801-47e7-96dc-dbe25a2e91e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.407982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d751af-0801-47e7-96dc-dbe25a2e91e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.408258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d751af-0801-47e7-96dc-dbe25a2e91e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.409523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d751af-0801-47e7-96dc-dbe25a2e91e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.412122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d751af-0801-47e7-96dc-dbe25a2e91e9 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.422324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 956/1898] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:49.428596 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75c4b-0e54-4cbf-b962-67e131665927 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.438151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75c4b-0e54-4cbf-b962-67e131665927 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.443338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b92d27-9ba3-465c-9364-32778920818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.444378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b92d27-9ba3-465c-9364-32778920818a admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.444657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b92d27-9ba3-465c-9364-32778920818a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.444927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b92d27-9ba3-465c-9364-32778920818a admin admin] PATH_INFO: `/v3/projects/049a1fcd87d64b53814970e40c7ae17f/users/1a9489d57046409992c576128e24e944/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.467064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d751af-0801-47e7-96dc-dbe25a2e91e9 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.467564 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b92d27-9ba3-465c-9364-32778920818a admin admin] RBAC: Authorizing `identity:create_grant(project_id=049a1fcd87d64b53814970e40c7ae17f, user_id=1a9489d57046409992c576128e24e944, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.470060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-86d751af-0801-47e7-96dc-dbe25a2e91e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:49.472828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b92d27-9ba3-465c-9364-32778920818a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.493239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d751af-0801-47e7-96dc-dbe25a2e91e9 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.502018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 943/1899] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:49 2022] PUT /identity/v3/projects/049a1fcd87d64b53814970e40c7ae17f/users/1a9489d57046409992c576128e24e944/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:49.510247 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9919-2a8b-48d5-ba10-e4d9bd3f4f92 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.510668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9919-2a8b-48d5-ba10-e4d9bd3f4f92 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.511079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf9919-2a8b-48d5-ba10-e4d9bd3f4f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.548348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-cfaf9919-2a8b-48d5-ba10-e4d9bd3f4f92 None None] MFA Rules not processed for user `1a9489d57046409992c576128e24e944`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:49.549771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cfaf9919-2a8b-48d5-ba10-e4d9bd3f4f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:49.574119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.575285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.575575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.575855 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] PATH_INFO: `/v3/projects/1879df6f8e44479f95b873109ab19441` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.577067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1879df6f8e44479f95b873109ab19441)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.578958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.628140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 944/1900] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:49.629553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf9919-2a8b-48d5-ba10-e4d9bd3f4f92 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.648155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf9919-2a8b-48d5-ba10-e4d9bd3f4f92 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.652787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1879df6f8e44479f95b873109ab19441', 'request_id': 'req-6bb00ad4-45a4-46bc-895c-94cb43979eb5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.659725 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1879df6f8e44479f95b873109ab19441', 'request_id': 'req-6bb00ad4-45a4-46bc-895c-94cb43979eb5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.669556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1879df6f8e44479f95b873109ab19441', 'request_id': 'req-6bb00ad4-45a4-46bc-895c-94cb43979eb5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.681256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] The token cache is being invalidate because project 1879df6f8e44479f95b873109ab19441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:49.681787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.682563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.684537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 957/1901] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:49 2022] DELETE /identity/v3/projects/1879df6f8e44479f95b873109ab19441 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:49.688352 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.689786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:49.708135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185151f-6f85-4705-b6f3-05265f2ed8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.708800 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185151f-6f85-4705-b6f3-05265f2ed8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.709132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185151f-6f85-4705-b6f3-05265f2ed8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.709370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185151f-6f85-4705-b6f3-05265f2ed8c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.710162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185151f-6f85-4705-b6f3-05265f2ed8c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.712602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185151f-6f85-4705-b6f3-05265f2ed8c7 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.737360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 945/1902] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:49 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:49.741396 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185151f-6f85-4705-b6f3-05265f2ed8c7 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.742979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1185151f-6f85-4705-b6f3-05265f2ed8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:49.754824 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb00ad4-45a4-46bc-895c-94cb43979eb5 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.815913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185151f-6f85-4705-b6f3-05265f2ed8c7 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.821253 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6def7d-09a2-48bc-a28f-8abcd1dae7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.821916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6def7d-09a2-48bc-a28f-8abcd1dae7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.822194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6def7d-09a2-48bc-a28f-8abcd1dae7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.822736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6def7d-09a2-48bc-a28f-8abcd1dae7e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.823342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6def7d-09a2-48bc-a28f-8abcd1dae7e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.825690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6def7d-09a2-48bc-a28f-8abcd1dae7e9 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.827666 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.828647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.829104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.829541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] PATH_INFO: `/v3/users/a78f5107e08941dea43643498e8e1b19` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.831729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a78f5107e08941dea43643498e8e1b19)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.833772 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.852821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 946/1903] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:49 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:49.853887 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6def7d-09a2-48bc-a28f-8abcd1dae7e9 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.864349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6def7d-09a2-48bc-a28f-8abcd1dae7e9 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.870002 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829d43a-2a23-481d-b4a5-ec22940582fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.870725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829d43a-2a23-481d-b4a5-ec22940582fb admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.871035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829d43a-2a23-481d-b4a5-ec22940582fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.871338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829d43a-2a23-481d-b4a5-ec22940582fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.872066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829d43a-2a23-481d-b4a5-ec22940582fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.874853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829d43a-2a23-481d-b4a5-ec22940582fb admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.886039 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a78f5107e08941dea43643498e8e1b19'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.886586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 947/1904] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:48:49.890760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829d43a-2a23-481d-b4a5-ec22940582fb admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.894598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a78f5107e08941dea43643498e8e1b19'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.895482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a78f5107e08941dea43643498e8e1b19'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.902170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829d43a-2a23-481d-b4a5-ec22940582fb admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:49.903027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a78f5107e08941dea43643498e8e1b19'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.907161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c334e8f-c098-4a3c-8a0e-df3ca097da30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:49.908075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c334e8f-c098-4a3c-8a0e-df3ca097da30 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:49.908403 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c334e8f-c098-4a3c-8a0e-df3ca097da30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:49.908710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c334e8f-c098-4a3c-8a0e-df3ca097da30 admin admin] PATH_INFO: `/v3/projects/e0bb4609a2494b28a8dc914f099f47f5/users/8fae7fc926f74d4c833e287700bf6fff/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:49.917462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a78f5107e08941dea43643498e8e1b19'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:49.923745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 958/1905] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:49 2022] DELETE /identity/v3/users/a78f5107e08941dea43643498e8e1b19 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:49.924334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c334e8f-c098-4a3c-8a0e-df3ca097da30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bb4609a2494b28a8dc914f099f47f5, user_id=8fae7fc926f74d4c833e287700bf6fff, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:49.927553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c334e8f-c098-4a3c-8a0e-df3ca097da30 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:49.945584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 948/1906] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:49 2022] PUT /identity/v3/projects/e0bb4609a2494b28a8dc914f099f47f5/users/8fae7fc926f74d4c833e287700bf6fff/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:49.946734 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:49.948314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:50.034619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faad91-243f-4b60-97f5-2d5630502b52 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:50.115011 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44f934-ad09-467d-9b11-c64b8e671e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:50.115793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44f934-ad09-467d-9b11-c64b8e671e53 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.116144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44f934-ad09-467d-9b11-c64b8e671e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.116492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44f934-ad09-467d-9b11-c64b8e671e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.117310 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44f934-ad09-467d-9b11-c64b8e671e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:50.118954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44f934-ad09-467d-9b11-c64b8e671e53 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:50.129260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 959/1907] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:48:50.133433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c334e8f-c098-4a3c-8a0e-df3ca097da30 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:50.146700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c334e8f-c098-4a3c-8a0e-df3ca097da30 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:50.152526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc12d0e-1432-4348-b3b9-3af027d047f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:50.153456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc12d0e-1432-4348-b3b9-3af027d047f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.153738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc12d0e-1432-4348-b3b9-3af027d047f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.154642 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc12d0e-1432-4348-b3b9-3af027d047f2 admin admin] PATH_INFO: `/v3/projects/e0bb4609a2494b28a8dc914f099f47f5/users/8fae7fc926f74d4c833e287700bf6fff/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.157344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc12d0e-1432-4348-b3b9-3af027d047f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bb4609a2494b28a8dc914f099f47f5, user_id=8fae7fc926f74d4c833e287700bf6fff, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:50.161526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc12d0e-1432-4348-b3b9-3af027d047f2 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:50.176966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 949/1908] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:50 2022] PUT /identity/v3/projects/e0bb4609a2494b28a8dc914f099f47f5/users/8fae7fc926f74d4c833e287700bf6fff/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:50.189166 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7912105-b8d7-40f8-9c04-25a03df7c6a8 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.189454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7912105-b8d7-40f8-9c04-25a03df7c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.189733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7912105-b8d7-40f8-9c04-25a03df7c6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.203987 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc12d0e-1432-4348-b3b9-3af027d047f2 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:50.206208 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2bc12d0e-1432-4348-b3b9-3af027d047f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:50.224069 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b7912105-b8d7-40f8-9c04-25a03df7c6a8 None None] MFA Rules not processed for user `8fae7fc926f74d4c833e287700bf6fff`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:50.225361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b7912105-b8d7-40f8-9c04-25a03df7c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:50.269867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc12d0e-1432-4348-b3b9-3af027d047f2 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:50.274756 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc915255-a55c-4fd1-b01a-f3afe26528ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:50.275702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc915255-a55c-4fd1-b01a-f3afe26528ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.276051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc915255-a55c-4fd1-b01a-f3afe26528ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.276392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc915255-a55c-4fd1-b01a-f3afe26528ef admin admin] PATH_INFO: `/v3/projects/d04cc612c0a94642949b667f3119bf84` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.277721 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc915255-a55c-4fd1-b01a-f3afe26528ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04cc612c0a94642949b667f3119bf84)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:50.279709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc915255-a55c-4fd1-b01a-f3afe26528ef admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:50.295108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 960/1909] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:50.306523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7912105-b8d7-40f8-9c04-25a03df7c6a8 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:50.307969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b7912105-b8d7-40f8-9c04-25a03df7c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:50.328104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-cc915255-a55c-4fd1-b01a-f3afe26528ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04cc612c0a94642949b667f3119bf84', 'request_id': 'req-cc915255-a55c-4fd1-b01a-f3afe26528ef'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:50.334850 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-cc915255-a55c-4fd1-b01a-f3afe26528ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04cc612c0a94642949b667f3119bf84', 'request_id': 'req-cc915255-a55c-4fd1-b01a-f3afe26528ef'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:50.342645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-cc915255-a55c-4fd1-b01a-f3afe26528ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04cc612c0a94642949b667f3119bf84', 'request_id': 'req-cc915255-a55c-4fd1-b01a-f3afe26528ef'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:50.354045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-cc915255-a55c-4fd1-b01a-f3afe26528ef admin admin] The token cache is being invalidate because project d04cc612c0a94642949b667f3119bf84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:50.354332 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-cc915255-a55c-4fd1-b01a-f3afe26528ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:50.355015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-cc915255-a55c-4fd1-b01a-f3afe26528ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:50.356712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 950/1910] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:50 2022] DELETE /identity/v3/projects/d04cc612c0a94642949b667f3119bf84 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:50.361235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1029a19-a66e-44d9-85e9-773b9174eaf8 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.361523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1029a19-a66e-44d9-85e9-773b9174eaf8 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.361855 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1029a19-a66e-44d9-85e9-773b9174eaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.364895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7912105-b8d7-40f8-9c04-25a03df7c6a8 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:50.379383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-d1029a19-a66e-44d9-85e9-773b9174eaf8 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:50.380584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d1029a19-a66e-44d9-85e9-773b9174eaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:50.412257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e444a8a-3b84-407c-8b2b-a1735f108a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:50.413163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e444a8a-3b84-407c-8b2b-a1735f108a45 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.413591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e444a8a-3b84-407c-8b2b-a1735f108a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.413872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e444a8a-3b84-407c-8b2b-a1735f108a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.415672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3e444a8a-3b84-407c-8b2b-a1735f108a45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:50.437100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 951/1911] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:50.445193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96207289-d8f2-4447-bb04-e6b0888b5054 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.445477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96207289-d8f2-4447-bb04-e6b0888b5054 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.445753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96207289-d8f2-4447-bb04-e6b0888b5054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.463397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-96207289-d8f2-4447-bb04-e6b0888b5054 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:50.464588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-96207289-d8f2-4447-bb04-e6b0888b5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:50.472974 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 952/1912] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:50.477123 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96207289-d8f2-4447-bb04-e6b0888b5054 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:50.477260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e444a8a-3b84-407c-8b2b-a1735f108a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:50.478739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e444a8a-3b84-407c-8b2b-a1735f108a45 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:50.485523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96207289-d8f2-4447-bb04-e6b0888b5054 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:50.488380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 961/1913] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:50.490139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48b23a-7436-441c-acc7-e987db9b118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:50.490782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48b23a-7436-441c-acc7-e987db9b118b admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.491059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48b23a-7436-441c-acc7-e987db9b118b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.491470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48b23a-7436-441c-acc7-e987db9b118b admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.492187 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48b23a-7436-441c-acc7-e987db9b118b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:50.492487 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48b23a-7436-441c-acc7-e987db9b118b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:50.494242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48b23a-7436-441c-acc7-e987db9b118b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:50.507559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 953/1914] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:48:50.510511 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e444a8a-3b84-407c-8b2b-a1735f108a45 service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:50.522270 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e444a8a-3b84-407c-8b2b-a1735f108a45 service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:50.527359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94504ac0-b195-4611-8cfa-8086e31fbdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:50.527613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94504ac0-b195-4611-8cfa-8086e31fbdbe admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.527991 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94504ac0-b195-4611-8cfa-8086e31fbdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.528230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94504ac0-b195-4611-8cfa-8086e31fbdbe admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.528920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94504ac0-b195-4611-8cfa-8086e31fbdbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:50.530828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94504ac0-b195-4611-8cfa-8086e31fbdbe admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:50.536313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48b23a-7436-441c-acc7-e987db9b118b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:50.537993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ce48b23a-7436-441c-acc7-e987db9b118b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:50.550543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48b23a-7436-441c-acc7-e987db9b118b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:50.554317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba42aab-116c-4200-9b4e-035b407eb449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:50.554990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42aab-116c-4200-9b4e-035b407eb449 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.555353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42aab-116c-4200-9b4e-035b407eb449 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.555624 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42aab-116c-4200-9b4e-035b407eb449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.557666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9ba42aab-116c-4200-9b4e-035b407eb449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:50.567614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 962/1915] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:50 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:50.567819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94504ac0-b195-4611-8cfa-8086e31fbdbe admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:50.616600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba42aab-116c-4200-9b4e-035b407eb449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:50.618028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba42aab-116c-4200-9b4e-035b407eb449 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:50.626823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 954/1916] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:50.632210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94504ac0-b195-4611-8cfa-8086e31fbdbe admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:50.636813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568c74e-f12e-45b6-9b31-a0fb44c24c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:50.637483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568c74e-f12e-45b6-9b31-a0fb44c24c29 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.637764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568c74e-f12e-45b6-9b31-a0fb44c24c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.638043 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568c74e-f12e-45b6-9b31-a0fb44c24c29 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.638914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568c74e-f12e-45b6-9b31-a0fb44c24c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:50.641006 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568c74e-f12e-45b6-9b31-a0fb44c24c29 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:50.664900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 963/1917] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:50 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:50.668807 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba42aab-116c-4200-9b4e-035b407eb449 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:50.681153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba42aab-116c-4200-9b4e-035b407eb449 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:50.687365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8f682-3112-41ef-a3f8-4c93e9063237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:50.688206 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8f682-3112-41ef-a3f8-4c93e9063237 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.688586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8f682-3112-41ef-a3f8-4c93e9063237 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.688967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8f682-3112-41ef-a3f8-4c93e9063237 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.690645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8f682-3112-41ef-a3f8-4c93e9063237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:50.692490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8f682-3112-41ef-a3f8-4c93e9063237 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:50.705317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 955/1918] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:50.710582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568c74e-f12e-45b6-9b31-a0fb44c24c29 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:50.720234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568c74e-f12e-45b6-9b31-a0fb44c24c29 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:50.724840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bed295-aa42-4062-b8bc-037fb2e814f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:50.725494 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bed295-aa42-4062-b8bc-037fb2e814f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.725776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bed295-aa42-4062-b8bc-037fb2e814f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.726051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bed295-aa42-4062-b8bc-037fb2e814f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.726774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bed295-aa42-4062-b8bc-037fb2e814f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:50.728376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bed295-aa42-4062-b8bc-037fb2e814f4 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:50.737947 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 964/1919] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:50.742020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8f682-3112-41ef-a3f8-4c93e9063237 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:50.751605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8f682-3112-41ef-a3f8-4c93e9063237 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:50.756681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7af52-e6b1-46c7-bd9d-9c49ed6821c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:50.757555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7af52-e6b1-46c7-bd9d-9c49ed6821c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.757833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7af52-e6b1-46c7-bd9d-9c49ed6821c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.758109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7af52-e6b1-46c7-bd9d-9c49ed6821c8 admin admin] PATH_INFO: `/v3/projects/4f2e7709f2f1473ba5b6582059031b6b/users/a1019f86abf94343ac555d977aec85c8/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.774710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7af52-e6b1-46c7-bd9d-9c49ed6821c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2e7709f2f1473ba5b6582059031b6b, user_id=a1019f86abf94343ac555d977aec85c8, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:50.777495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7af52-e6b1-46c7-bd9d-9c49ed6821c8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:50.790663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 956/1920] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:50 2022] PUT /identity/v3/projects/4f2e7709f2f1473ba5b6582059031b6b/users/a1019f86abf94343ac555d977aec85c8/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:50.801652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310279f-3164-4ed9-b903-f932e01821da None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.802412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310279f-3164-4ed9-b903-f932e01821da None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.802751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310279f-3164-4ed9-b903-f932e01821da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.833523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-1310279f-3164-4ed9-b903-f932e01821da None None] MFA Rules not processed for user `a1019f86abf94343ac555d977aec85c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:50.834723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1310279f-3164-4ed9-b903-f932e01821da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:50.916128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 965/1921] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:50.920465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7af52-e6b1-46c7-bd9d-9c49ed6821c8 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:50.989932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7af52-e6b1-46c7-bd9d-9c49ed6821c8 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:50.994507 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc384b-5684-4e3c-b50c-af7c1f5f3d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:50.995153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc384b-5684-4e3c-b50c-af7c1f5f3d7e admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:50.995459 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc384b-5684-4e3c-b50c-af7c1f5f3d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:50.995731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc384b-5684-4e3c-b50c-af7c1f5f3d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:50.996413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc384b-5684-4e3c-b50c-af7c1f5f3d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:50.998280 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc384b-5684-4e3c-b50c-af7c1f5f3d7e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:51.026387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 957/1922] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:50 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:51.027630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310279f-3164-4ed9-b903-f932e01821da None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:51.038247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310279f-3164-4ed9-b903-f932e01821da None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:51.094795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c759-733e-48a4-820b-a32790d5b605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:51.095501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c759-733e-48a4-820b-a32790d5b605 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:51.095782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c759-733e-48a4-820b-a32790d5b605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:51.096183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c759-733e-48a4-820b-a32790d5b605 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:51.096767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7c759-733e-48a4-820b-a32790d5b605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:51.098660 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7c759-733e-48a4-820b-a32790d5b605 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:51.123687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 966/1923] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:51 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:51.128273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc384b-5684-4e3c-b50c-af7c1f5f3d7e admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:51.138688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc384b-5684-4e3c-b50c-af7c1f5f3d7e admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:51.143898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23eacb-3367-4e52-b310-d7b44f747224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:51.144721 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23eacb-3367-4e52-b310-d7b44f747224 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:51.145555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23eacb-3367-4e52-b310-d7b44f747224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:51.145555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23eacb-3367-4e52-b310-d7b44f747224 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:51.146693 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23eacb-3367-4e52-b310-d7b44f747224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:51.148279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23eacb-3367-4e52-b310-d7b44f747224 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:51.159770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 958/1924] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:48:51.163922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c759-733e-48a4-820b-a32790d5b605 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:51.173848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c759-733e-48a4-820b-a32790d5b605 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:51.179177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fc473-6a48-4eb8-8100-a77f9e812c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:51.180082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fc473-6a48-4eb8-8100-a77f9e812c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:51.180360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fc473-6a48-4eb8-8100-a77f9e812c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:51.180627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fc473-6a48-4eb8-8100-a77f9e812c9d admin admin] PATH_INFO: `/v3/projects/c996023b6b8c4527b6c6e66b2afc85ce/users/2fde21ab86fd43cfa1034a06360aee6b/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:51.197810 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fc473-6a48-4eb8-8100-a77f9e812c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c996023b6b8c4527b6c6e66b2afc85ce, user_id=2fde21ab86fd43cfa1034a06360aee6b, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:51.200496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fc473-6a48-4eb8-8100-a77f9e812c9d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:51.214442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 967/1925] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:51 2022] PUT /identity/v3/projects/c996023b6b8c4527b6c6e66b2afc85ce/users/2fde21ab86fd43cfa1034a06360aee6b/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:51.218594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23eacb-3367-4e52-b310-d7b44f747224 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:51.228643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23eacb-3367-4e52-b310-d7b44f747224 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:51.329670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4a074-26dc-4581-9c85-8a7273e44110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:51.330361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4a074-26dc-4581-9c85-8a7273e44110 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:51.330642 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4a074-26dc-4581-9c85-8a7273e44110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:51.330918 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4a074-26dc-4581-9c85-8a7273e44110 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:51.331687 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4a074-26dc-4581-9c85-8a7273e44110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:51.333289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4a074-26dc-4581-9c85-8a7273e44110 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:51.347285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 959/1926] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:51.349017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fc473-6a48-4eb8-8100-a77f9e812c9d admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:51.370901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fc473-6a48-4eb8-8100-a77f9e812c9d admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:51.375750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb5ff4-2207-442d-8678-4cf902918166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:51.376709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb5ff4-2207-442d-8678-4cf902918166 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:51.377073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb5ff4-2207-442d-8678-4cf902918166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:51.377372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb5ff4-2207-442d-8678-4cf902918166 admin admin] PATH_INFO: `/v3/projects/c996023b6b8c4527b6c6e66b2afc85ce/users/2fde21ab86fd43cfa1034a06360aee6b/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:51.379384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb5ff4-2207-442d-8678-4cf902918166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c996023b6b8c4527b6c6e66b2afc85ce, user_id=2fde21ab86fd43cfa1034a06360aee6b, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:51.382001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb5ff4-2207-442d-8678-4cf902918166 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:51.392478 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 968/1927] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:51 2022] PUT /identity/v3/projects/c996023b6b8c4527b6c6e66b2afc85ce/users/2fde21ab86fd43cfa1034a06360aee6b/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:51.403887 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d11a68-be3b-4118-a2fe-2175aec66bde None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:51.404292 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d11a68-be3b-4118-a2fe-2175aec66bde None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:51.404685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d11a68-be3b-4118-a2fe-2175aec66bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:51.432740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-18d11a68-be3b-4118-a2fe-2175aec66bde None None] MFA Rules not processed for user `2fde21ab86fd43cfa1034a06360aee6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:51.434044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-18d11a68-be3b-4118-a2fe-2175aec66bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:51.503359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 960/1928] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:51.512698 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb5ff4-2207-442d-8678-4cf902918166 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:51.514377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-93cb5ff4-2207-442d-8678-4cf902918166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:51.573640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb5ff4-2207-442d-8678-4cf902918166 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:51.577391 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34ed13-9c2c-47dc-95ce-3a481a91d671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:51.578029 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34ed13-9c2c-47dc-95ce-3a481a91d671 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:51.578307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34ed13-9c2c-47dc-95ce-3a481a91d671 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:51.578607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34ed13-9c2c-47dc-95ce-3a481a91d671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:51.588346 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34ed13-9c2c-47dc-95ce-3a481a91d671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:51.590147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34ed13-9c2c-47dc-95ce-3a481a91d671 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:51.600037 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 969/1929] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:51.736667 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d11a68-be3b-4118-a2fe-2175aec66bde None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:51.800913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d11a68-be3b-4118-a2fe-2175aec66bde None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:51.805538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:51.806409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:51.806689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:51.806961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] PATH_INFO: `/v3/users/a1019f86abf94343ac555d977aec85c8` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:51.808181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1019f86abf94343ac555d977aec85c8)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:51.810105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:51.857551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1019f86abf94343ac555d977aec85c8'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:51.865969 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1019f86abf94343ac555d977aec85c8'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:51.873180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1019f86abf94343ac555d977aec85c8'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:51.873845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1019f86abf94343ac555d977aec85c8'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:51.874460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1019f86abf94343ac555d977aec85c8'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:51.891149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 961/1930] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:51 2022] DELETE /identity/v3/users/a1019f86abf94343ac555d977aec85c8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:51.896288 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc85d17-f327-4ca6-95d2-8e3746f533b7 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:51.896788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc85d17-f327-4ca6-95d2-8e3746f533b7 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:51.896788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc85d17-f327-4ca6-95d2-8e3746f533b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:51.914668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-3fc85d17-f327-4ca6-95d2-8e3746f533b7 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:51.915925 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3fc85d17-f327-4ca6-95d2-8e3746f533b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:51.984466 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 970/1931] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:51.993815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:51.995340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:52.057579 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07985d86-c3db-40d8-94f7-060390191833 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:52.061156 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fece33-3f17-4d16-baca-1d56331b0055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:52.061794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fece33-3f17-4d16-baca-1d56331b0055 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:52.062077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fece33-3f17-4d16-baca-1d56331b0055 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:52.062347 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fece33-3f17-4d16-baca-1d56331b0055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:52.072515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fece33-3f17-4d16-baca-1d56331b0055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:52.074092 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fece33-3f17-4d16-baca-1d56331b0055 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:52.083985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 962/1932] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:52.384347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc85d17-f327-4ca6-95d2-8e3746f533b7 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:52.385888 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3fc85d17-f327-4ca6-95d2-8e3746f533b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:52.405152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc85d17-f327-4ca6-95d2-8e3746f533b7 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:52.421294 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:52.422637 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:52.422920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:52.423798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] PATH_INFO: `/v3/projects/4f2e7709f2f1473ba5b6582059031b6b` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:52.425453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2e7709f2f1473ba5b6582059031b6b)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:52.428399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:52.481854 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2e7709f2f1473ba5b6582059031b6b', 'request_id': 'req-6831cfa1-211a-468d-bcd4-9afc0f761334'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:52.488521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2e7709f2f1473ba5b6582059031b6b', 'request_id': 'req-6831cfa1-211a-468d-bcd4-9afc0f761334'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:52.497135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2e7709f2f1473ba5b6582059031b6b', 'request_id': 'req-6831cfa1-211a-468d-bcd4-9afc0f761334'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:52.508859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] The token cache is being invalidate because project 4f2e7709f2f1473ba5b6582059031b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:52.509147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:52.509782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:52.511541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 971/1933] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:52 2022] DELETE /identity/v3/projects/4f2e7709f2f1473ba5b6582059031b6b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:52.515495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fece33-3f17-4d16-baca-1d56331b0055 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:52.524867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fece33-3f17-4d16-baca-1d56331b0055 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:52.583734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aae291-f276-48d3-9a21-ef5742f2d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:52.584608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aae291-f276-48d3-9a21-ef5742f2d584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:52.584885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aae291-f276-48d3-9a21-ef5742f2d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:52.585155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aae291-f276-48d3-9a21-ef5742f2d584 admin admin] PATH_INFO: `/v3/users/2fde21ab86fd43cfa1034a06360aee6b` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:52.586502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aae291-f276-48d3-9a21-ef5742f2d584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fde21ab86fd43cfa1034a06360aee6b)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:52.588446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aae291-f276-48d3-9a21-ef5742f2d584 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:52.634778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a1aae291-f276-48d3-9a21-ef5742f2d584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fde21ab86fd43cfa1034a06360aee6b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:52.642230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a1aae291-f276-48d3-9a21-ef5742f2d584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fde21ab86fd43cfa1034a06360aee6b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:52.649091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a1aae291-f276-48d3-9a21-ef5742f2d584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fde21ab86fd43cfa1034a06360aee6b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:52.649711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a1aae291-f276-48d3-9a21-ef5742f2d584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fde21ab86fd43cfa1034a06360aee6b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:52.650300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a1aae291-f276-48d3-9a21-ef5742f2d584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fde21ab86fd43cfa1034a06360aee6b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:52.667734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 963/1934] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:52 2022] DELETE /identity/v3/users/2fde21ab86fd43cfa1034a06360aee6b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:52.932774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:52.934314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:52.948400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831cfa1-211a-468d-bcd4-9afc0f761334 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:53.014772 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:53.015674 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.016089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.016275 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61 admin admin] PATH_INFO: `/v3/projects/c996023b6b8c4527b6c6e66b2afc85ce` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.017476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c996023b6b8c4527b6c6e66b2afc85ce)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:53.019479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:53.065248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c996023b6b8c4527b6c6e66b2afc85ce', 'request_id': 'req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:53.071328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c996023b6b8c4527b6c6e66b2afc85ce', 'request_id': 'req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:53.077771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c996023b6b8c4527b6c6e66b2afc85ce', 'request_id': 'req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:53.087561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61 admin admin] The token cache is being invalidate because project c996023b6b8c4527b6c6e66b2afc85ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:53.087842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:53.088450 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c6f6dd62-61c1-43c8-a0f6-dbafaad03c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:53.089966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 972/1935] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:52 2022] DELETE /identity/v3/projects/c996023b6b8c4527b6c6e66b2afc85ce => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:53.094805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c6895-812b-49f2-b716-b26aa5b91ffc None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.095366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c6895-812b-49f2-b716-b26aa5b91ffc None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.095483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c6895-812b-49f2-b716-b26aa5b91ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.113325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-dc5c6895-812b-49f2-b716-b26aa5b91ffc None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:53.114492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-dc5c6895-812b-49f2-b716-b26aa5b91ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:53.172966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 964/1936] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:53.181653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e93014-e614-4433-8634-11e28002fa60 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.181882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e93014-e614-4433-8634-11e28002fa60 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.182158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e93014-e614-4433-8634-11e28002fa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.200574 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-46e93014-e614-4433-8634-11e28002fa60 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:53.201762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-46e93014-e614-4433-8634-11e28002fa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:53.210045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 973/1937] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:53.214346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c6895-812b-49f2-b716-b26aa5b91ffc None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:53.224375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c6895-812b-49f2-b716-b26aa5b91ffc None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:53.228879 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad17ac-6ff1-4cdf-b876-70bf34bf6056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:53.229518 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad17ac-6ff1-4cdf-b876-70bf34bf6056 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.229814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad17ac-6ff1-4cdf-b876-70bf34bf6056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.230070 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad17ac-6ff1-4cdf-b876-70bf34bf6056 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.230830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad17ac-6ff1-4cdf-b876-70bf34bf6056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:53.231135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad17ac-6ff1-4cdf-b876-70bf34bf6056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:53.232802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad17ac-6ff1-4cdf-b876-70bf34bf6056 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:53.244237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 965/1938] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:53.248442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e93014-e614-4433-8634-11e28002fa60 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:53.257425 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e93014-e614-4433-8634-11e28002fa60 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:53.262059 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf73d0-a9fa-4437-b086-17bae213e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:53.262787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf73d0-a9fa-4437-b086-17bae213e304 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.263074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf73d0-a9fa-4437-b086-17bae213e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.263377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf73d0-a9fa-4437-b086-17bae213e304 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.264061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf73d0-a9fa-4437-b086-17bae213e304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:53.265968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf73d0-a9fa-4437-b086-17bae213e304 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:53.293380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 974/1939] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:53 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:53.297856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad17ac-6ff1-4cdf-b876-70bf34bf6056 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:53.307734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad17ac-6ff1-4cdf-b876-70bf34bf6056 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:53.361942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa5136-ba17-4416-9d46-d2881623f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:53.362604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa5136-ba17-4416-9d46-d2881623f38d admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.362892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa5136-ba17-4416-9d46-d2881623f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.363164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa5136-ba17-4416-9d46-d2881623f38d admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.363886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa5136-ba17-4416-9d46-d2881623f38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:53.365789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa5136-ba17-4416-9d46-d2881623f38d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:53.385045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 966/1940] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:53 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:53.389147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf73d0-a9fa-4437-b086-17bae213e304 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:53.399717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf73d0-a9fa-4437-b086-17bae213e304 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:53.404287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc382018-b2d6-462c-972e-2178e17fca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:53.404932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc382018-b2d6-462c-972e-2178e17fca2f admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.405214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc382018-b2d6-462c-972e-2178e17fca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.405489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc382018-b2d6-462c-972e-2178e17fca2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.406211 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc382018-b2d6-462c-972e-2178e17fca2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:53.407835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc382018-b2d6-462c-972e-2178e17fca2f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:53.418524 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 975/1941] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:53.422261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa5136-ba17-4416-9d46-d2881623f38d admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:53.431977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa5136-ba17-4416-9d46-d2881623f38d admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:53.436611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d6ddd-5a0d-4a9c-80c4-152f02544894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:53.437266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d6ddd-5a0d-4a9c-80c4-152f02544894 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.437546 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d6ddd-5a0d-4a9c-80c4-152f02544894 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.437820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d6ddd-5a0d-4a9c-80c4-152f02544894 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.438792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d6ddd-5a0d-4a9c-80c4-152f02544894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:53.440754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d6ddd-5a0d-4a9c-80c4-152f02544894 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:53.451162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 967/1942] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:53.455079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc382018-b2d6-462c-972e-2178e17fca2f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:53.466115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc382018-b2d6-462c-972e-2178e17fca2f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:53.472881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767b069-2d96-49b9-a754-7fb13dc5169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:53.474210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767b069-2d96-49b9-a754-7fb13dc5169c admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.474528 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767b069-2d96-49b9-a754-7fb13dc5169c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.474946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767b069-2d96-49b9-a754-7fb13dc5169c admin admin] PATH_INFO: `/v3/projects/d19c5fc0051b416fbb7abb75fca98a0b/users/ac33696e36c84a3181ce835c7dffef2b/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.490663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767b069-2d96-49b9-a754-7fb13dc5169c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19c5fc0051b416fbb7abb75fca98a0b, user_id=ac33696e36c84a3181ce835c7dffef2b, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:53.493473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767b069-2d96-49b9-a754-7fb13dc5169c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:53.507047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 976/1943] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:53 2022] PUT /identity/v3/projects/d19c5fc0051b416fbb7abb75fca98a0b/users/ac33696e36c84a3181ce835c7dffef2b/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:53.517861 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f85a0f-50a7-4211-85e5-4925dd14ae71 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.518778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f85a0f-50a7-4211-85e5-4925dd14ae71 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.519056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f85a0f-50a7-4211-85e5-4925dd14ae71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.547850 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-60f85a0f-50a7-4211-85e5-4925dd14ae71 None None] MFA Rules not processed for user `ac33696e36c84a3181ce835c7dffef2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:53.549076 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-60f85a0f-50a7-4211-85e5-4925dd14ae71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:53.635318 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 968/1944] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:53.640248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767b069-2d96-49b9-a754-7fb13dc5169c admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:53.708719 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767b069-2d96-49b9-a754-7fb13dc5169c admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:53.716479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcce461-b33a-43f1-9e76-7b6543c8f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:53.717173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcce461-b33a-43f1-9e76-7b6543c8f137 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.717500 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcce461-b33a-43f1-9e76-7b6543c8f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.717775 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcce461-b33a-43f1-9e76-7b6543c8f137 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.718468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcce461-b33a-43f1-9e76-7b6543c8f137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:53.720449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcce461-b33a-43f1-9e76-7b6543c8f137 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:53.756511 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 977/1945] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:53 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:53.760548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f85a0f-50a7-4211-85e5-4925dd14ae71 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:53.771028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f85a0f-50a7-4211-85e5-4925dd14ae71 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:53.834487 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b93ea-0fac-46f9-ac06-7e45e8d527e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:53.835355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b93ea-0fac-46f9-ac06-7e45e8d527e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.835617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b93ea-0fac-46f9-ac06-7e45e8d527e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.835953 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b93ea-0fac-46f9-ac06-7e45e8d527e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.836633 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b93ea-0fac-46f9-ac06-7e45e8d527e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:53.838626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b93ea-0fac-46f9-ac06-7e45e8d527e0 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:53.860162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 969/1946] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:53 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:53.864628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcce461-b33a-43f1-9e76-7b6543c8f137 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:53.874616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcce461-b33a-43f1-9e76-7b6543c8f137 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:53.879582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4d593-79b5-467c-92f3-edfaccc1c416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:53.880394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4d593-79b5-467c-92f3-edfaccc1c416 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.880679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4d593-79b5-467c-92f3-edfaccc1c416 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.880961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4d593-79b5-467c-92f3-edfaccc1c416 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.881686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4d593-79b5-467c-92f3-edfaccc1c416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:53.883282 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4d593-79b5-467c-92f3-edfaccc1c416 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:53.894152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 978/1947] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:53.898405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b93ea-0fac-46f9-ac06-7e45e8d527e0 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:53.911022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b93ea-0fac-46f9-ac06-7e45e8d527e0 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:53.916218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49980fe-740b-433c-adbb-98a87c3ff6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:53.917101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49980fe-740b-433c-adbb-98a87c3ff6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:53.917379 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49980fe-740b-433c-adbb-98a87c3ff6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:53.917646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49980fe-740b-433c-adbb-98a87c3ff6eb admin admin] PATH_INFO: `/v3/projects/016c642a2b90490ea778ab97fc228190/users/fc27ba218dc0494d9d0a84550fd99748/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:53.933037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49980fe-740b-433c-adbb-98a87c3ff6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=016c642a2b90490ea778ab97fc228190, user_id=fc27ba218dc0494d9d0a84550fd99748, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:53.935838 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49980fe-740b-433c-adbb-98a87c3ff6eb admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:53.948893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 970/1948] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:53 2022] PUT /identity/v3/projects/016c642a2b90490ea778ab97fc228190/users/fc27ba218dc0494d9d0a84550fd99748/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:53.952801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4d593-79b5-467c-92f3-edfaccc1c416 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:53.963871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4d593-79b5-467c-92f3-edfaccc1c416 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:54.021503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae72cf-053a-44dc-a345-87a0ca2d92c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:54.022180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae72cf-053a-44dc-a345-87a0ca2d92c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:54.022462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae72cf-053a-44dc-a345-87a0ca2d92c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:54.022742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae72cf-053a-44dc-a345-87a0ca2d92c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:54.023490 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae72cf-053a-44dc-a345-87a0ca2d92c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:54.025059 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae72cf-053a-44dc-a345-87a0ca2d92c9 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:54.035065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 979/1949] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:48:54.041476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49980fe-740b-433c-adbb-98a87c3ff6eb admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:54.050953 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49980fe-740b-433c-adbb-98a87c3ff6eb admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:54.055856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e5fa0-607f-47d3-ae57-0e3e4add0cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:54.056738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e5fa0-607f-47d3-ae57-0e3e4add0cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:54.057016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e5fa0-607f-47d3-ae57-0e3e4add0cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:54.057290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e5fa0-607f-47d3-ae57-0e3e4add0cdd admin admin] PATH_INFO: `/v3/projects/016c642a2b90490ea778ab97fc228190/users/fc27ba218dc0494d9d0a84550fd99748/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:54.059078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae72cf-053a-44dc-a345-87a0ca2d92c9 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:54.059548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e5fa0-607f-47d3-ae57-0e3e4add0cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=016c642a2b90490ea778ab97fc228190, user_id=fc27ba218dc0494d9d0a84550fd99748, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:54.061366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7dae72cf-053a-44dc-a345-87a0ca2d92c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:54.062197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e5fa0-607f-47d3-ae57-0e3e4add0cdd admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:54.074653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 971/1950] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:54 2022] PUT /identity/v3/projects/016c642a2b90490ea778ab97fc228190/users/fc27ba218dc0494d9d0a84550fd99748/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:54.085047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae72cf-053a-44dc-a345-87a0ca2d92c9 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:54.086558 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60443ea3-ff84-410a-a6ab-c3a01134e9e2 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:54.086844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60443ea3-ff84-410a-a6ab-c3a01134e9e2 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:54.087136 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60443ea3-ff84-410a-a6ab-c3a01134e9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:54.113238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-60443ea3-ff84-410a-a6ab-c3a01134e9e2 None None] MFA Rules not processed for user `fc27ba218dc0494d9d0a84550fd99748`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:54.114441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-60443ea3-ff84-410a-a6ab-c3a01134e9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:54.131314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458303b-bc97-46f2-b5cc-c3881b51923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:54.132189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458303b-bc97-46f2-b5cc-c3881b51923c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:54.132468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458303b-bc97-46f2-b5cc-c3881b51923c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:54.132742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458303b-bc97-46f2-b5cc-c3881b51923c admin admin] PATH_INFO: `/v3/users/1a9489d57046409992c576128e24e944` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:54.134009 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458303b-bc97-46f2-b5cc-c3881b51923c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9489d57046409992c576128e24e944)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:54.135924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458303b-bc97-46f2-b5cc-c3881b51923c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:54.180496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8458303b-bc97-46f2-b5cc-c3881b51923c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9489d57046409992c576128e24e944'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:54.182871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 972/1951] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:54.189689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8458303b-bc97-46f2-b5cc-c3881b51923c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9489d57046409992c576128e24e944'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:54.190648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8458303b-bc97-46f2-b5cc-c3881b51923c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9489d57046409992c576128e24e944'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:54.193912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60443ea3-ff84-410a-a6ab-c3a01134e9e2 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:54.195282 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-60443ea3-ff84-410a-a6ab-c3a01134e9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:54.197786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8458303b-bc97-46f2-b5cc-c3881b51923c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9489d57046409992c576128e24e944'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:54.209610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8458303b-bc97-46f2-b5cc-c3881b51923c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9489d57046409992c576128e24e944'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:54.215368 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 980/1952] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:54 2022] DELETE /identity/v3/users/1a9489d57046409992c576128e24e944 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:54.219746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db7d65-bd25-4971-99ea-76f69cdeabef None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:54.220028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db7d65-bd25-4971-99ea-76f69cdeabef None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:54.220303 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db7d65-bd25-4971-99ea-76f69cdeabef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:54.237609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-80db7d65-bd25-4971-99ea-76f69cdeabef None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:54.238771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-80db7d65-bd25-4971-99ea-76f69cdeabef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:54.252418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60443ea3-ff84-410a-a6ab-c3a01134e9e2 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:54.295622 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 981/1953] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:54.305437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db7d65-bd25-4971-99ea-76f69cdeabef None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:54.307306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510cde8-49a1-4975-ae66-426869dc7444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:54.307947 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510cde8-49a1-4975-ae66-426869dc7444 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:54.308047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-80db7d65-bd25-4971-99ea-76f69cdeabef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:54.309692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510cde8-49a1-4975-ae66-426869dc7444 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:54.309692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510cde8-49a1-4975-ae66-426869dc7444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:54.312191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2510cde8-49a1-4975-ae66-426869dc7444 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:54.368737 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db7d65-bd25-4971-99ea-76f69cdeabef None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:54.372359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d94c07-5c9f-4bd0-b22c-c014a54edeed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:54.373012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d94c07-5c9f-4bd0-b22c-c014a54edeed service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:54.373277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d94c07-5c9f-4bd0-b22c-c014a54edeed service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:54.373549 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d94c07-5c9f-4bd0-b22c-c014a54edeed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:54.382925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510cde8-49a1-4975-ae66-426869dc7444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:54.383868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d94c07-5c9f-4bd0-b22c-c014a54edeed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:54.384440 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510cde8-49a1-4975-ae66-426869dc7444 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:54.385621 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d94c07-5c9f-4bd0-b22c-c014a54edeed service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:54.396122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 973/1954] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:54.396684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 982/1955] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:54.692506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d94c07-5c9f-4bd0-b22c-c014a54edeed service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:54.696037 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d6d94c07-5c9f-4bd0-b22c-c014a54edeed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:54.715104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d94c07-5c9f-4bd0-b22c-c014a54edeed service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:54.720249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:54.721074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:54.721997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:54.722281 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] PATH_INFO: `/v3/projects/049a1fcd87d64b53814970e40c7ae17f` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:54.723528 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=049a1fcd87d64b53814970e40c7ae17f)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:54.727552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:54.784419 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049a1fcd87d64b53814970e40c7ae17f', 'request_id': 'req-39e72fc4-81fb-4519-ac08-1a66f398c717'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:54.791524 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049a1fcd87d64b53814970e40c7ae17f', 'request_id': 'req-39e72fc4-81fb-4519-ac08-1a66f398c717'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:54.804414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049a1fcd87d64b53814970e40c7ae17f', 'request_id': 'req-39e72fc4-81fb-4519-ac08-1a66f398c717'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:54.819807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] The token cache is being invalidate because project 049a1fcd87d64b53814970e40c7ae17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:54.820105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:54.820765 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:54.822907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 983/1956] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:54 2022] DELETE /identity/v3/projects/049a1fcd87d64b53814970e40c7ae17f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:54.827165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510cde8-49a1-4975-ae66-426869dc7444 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:54.839996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510cde8-49a1-4975-ae66-426869dc7444 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:54.904872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac959919-4e99-4437-ba0d-2a323ffbd415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:54.905808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959919-4e99-4437-ba0d-2a323ffbd415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:54.906312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959919-4e99-4437-ba0d-2a323ffbd415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:54.906643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959919-4e99-4437-ba0d-2a323ffbd415 admin admin] PATH_INFO: `/v3/users/8fae7fc926f74d4c833e287700bf6fff` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:54.908140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac959919-4e99-4437-ba0d-2a323ffbd415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fae7fc926f74d4c833e287700bf6fff)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:54.910749 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac959919-4e99-4437-ba0d-2a323ffbd415 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:54.979891 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ac959919-4e99-4437-ba0d-2a323ffbd415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fae7fc926f74d4c833e287700bf6fff'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:54.991396 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ac959919-4e99-4437-ba0d-2a323ffbd415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fae7fc926f74d4c833e287700bf6fff'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.000670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ac959919-4e99-4437-ba0d-2a323ffbd415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fae7fc926f74d4c833e287700bf6fff'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.004019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ac959919-4e99-4437-ba0d-2a323ffbd415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fae7fc926f74d4c833e287700bf6fff'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.013613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ac959919-4e99-4437-ba0d-2a323ffbd415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fae7fc926f74d4c833e287700bf6fff'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.035917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 974/1957] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:54 2022] DELETE /identity/v3/users/8fae7fc926f74d4c833e287700bf6fff => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:55.110952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:55.113724 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:55.135367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e72fc4-81fb-4519-ac08-1a66f398c717 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:55.224347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:55.226773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:55.227020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:55.227615 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] PATH_INFO: `/v3/users/ac33696e36c84a3181ce835c7dffef2b` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:55.228924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac33696e36c84a3181ce835c7dffef2b)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:55.235884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:55.308227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac33696e36c84a3181ce835c7dffef2b'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.325032 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac33696e36c84a3181ce835c7dffef2b'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.325696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac33696e36c84a3181ce835c7dffef2b'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.333980 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac33696e36c84a3181ce835c7dffef2b'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.346301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac33696e36c84a3181ce835c7dffef2b'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.352465 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 984/1958] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:55 2022] DELETE /identity/v3/users/ac33696e36c84a3181ce835c7dffef2b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:55.356893 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286a56a-1b81-4eff-a15e-7ff75defd424 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:55.357428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286a56a-1b81-4eff-a15e-7ff75defd424 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:55.357428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286a56a-1b81-4eff-a15e-7ff75defd424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:55.371098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:55.373103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:55.382078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b286a56a-1b81-4eff-a15e-7ff75defd424 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:55.384566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b286a56a-1b81-4eff-a15e-7ff75defd424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:55.470472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56bede-95c4-4a67-a314-5f309e660a18 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:55.476007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90186fd8-368b-4f57-8275-a7236d1fdb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:55.476862 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90186fd8-368b-4f57-8275-a7236d1fdb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:55.477324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90186fd8-368b-4f57-8275-a7236d1fdb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:55.477832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90186fd8-368b-4f57-8275-a7236d1fdb0c admin admin] PATH_INFO: `/v3/projects/e0bb4609a2494b28a8dc914f099f47f5` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:55.479185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90186fd8-368b-4f57-8275-a7236d1fdb0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0bb4609a2494b28a8dc914f099f47f5)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:55.483155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 975/1959] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:55.483335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90186fd8-368b-4f57-8275-a7236d1fdb0c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:55.490673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286a56a-1b81-4eff-a15e-7ff75defd424 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:55.492260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b286a56a-1b81-4eff-a15e-7ff75defd424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:55.537464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-90186fd8-368b-4f57-8275-a7236d1fdb0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0bb4609a2494b28a8dc914f099f47f5', 'request_id': 'req-90186fd8-368b-4f57-8275-a7236d1fdb0c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.544169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-90186fd8-368b-4f57-8275-a7236d1fdb0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0bb4609a2494b28a8dc914f099f47f5', 'request_id': 'req-90186fd8-368b-4f57-8275-a7236d1fdb0c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.556876 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-90186fd8-368b-4f57-8275-a7236d1fdb0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0bb4609a2494b28a8dc914f099f47f5', 'request_id': 'req-90186fd8-368b-4f57-8275-a7236d1fdb0c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.564375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286a56a-1b81-4eff-a15e-7ff75defd424 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:55.573385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-90186fd8-368b-4f57-8275-a7236d1fdb0c admin admin] The token cache is being invalidate because project e0bb4609a2494b28a8dc914f099f47f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:55.574074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-90186fd8-368b-4f57-8275-a7236d1fdb0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.575262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-90186fd8-368b-4f57-8275-a7236d1fdb0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:55.577510 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 985/1960] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:55 2022] DELETE /identity/v3/projects/e0bb4609a2494b28a8dc914f099f47f5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:55.583016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea178fa-5094-48c7-b95f-ca488b17c8d5 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:55.583364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea178fa-5094-48c7-b95f-ca488b17c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:55.583803 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea178fa-5094-48c7-b95f-ca488b17c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:55.605895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-2ea178fa-5094-48c7-b95f-ca488b17c8d5 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:55.607846 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2ea178fa-5094-48c7-b95f-ca488b17c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:55.619880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf13cf-782c-4dbf-8b66-00d8b37d2683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:55.621192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf13cf-782c-4dbf-8b66-00d8b37d2683 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:55.621647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf13cf-782c-4dbf-8b66-00d8b37d2683 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:55.621936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf13cf-782c-4dbf-8b66-00d8b37d2683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:55.624858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c4bf13cf-782c-4dbf-8b66-00d8b37d2683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:55.689447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 986/1961] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:55.691850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb8e53-a8f3-4c2c-b369-b3e4a0ceaefc None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:55.692144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb8e53-a8f3-4c2c-b369-b3e4a0ceaefc None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:55.692668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb8e53-a8f3-4c2c-b369-b3e4a0ceaefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:55.700788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf13cf-782c-4dbf-8b66-00d8b37d2683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:55.702607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf13cf-782c-4dbf-8b66-00d8b37d2683 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:55.710865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-aefb8e53-a8f3-4c2c-b369-b3e4a0ceaefc None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:55.712090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-aefb8e53-a8f3-4c2c-b369-b3e4a0ceaefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:55.713122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 976/1962] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:55.720093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 987/1963] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:55.724228 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf13cf-782c-4dbf-8b66-00d8b37d2683 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:55.734405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf13cf-782c-4dbf-8b66-00d8b37d2683 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:55.740044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eba5e-140f-47d4-ae38-926b48e46731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:55.740769 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eba5e-140f-47d4-ae38-926b48e46731 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:55.741050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eba5e-140f-47d4-ae38-926b48e46731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:55.741327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eba5e-140f-47d4-ae38-926b48e46731 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:55.742044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eba5e-140f-47d4-ae38-926b48e46731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:55.742347 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eba5e-140f-47d4-ae38-926b48e46731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:55.743967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eba5e-140f-47d4-ae38-926b48e46731 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:55.760303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 977/1964] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:48:55.761553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb8e53-a8f3-4c2c-b369-b3e4a0ceaefc None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:55.771380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb8e53-a8f3-4c2c-b369-b3e4a0ceaefc None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:55.777064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a4d16-8fc4-4616-b61f-30ef19252b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:55.777741 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a4d16-8fc4-4616-b61f-30ef19252b5c admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:55.778068 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a4d16-8fc4-4616-b61f-30ef19252b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:55.778371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a4d16-8fc4-4616-b61f-30ef19252b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:55.779305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a4d16-8fc4-4616-b61f-30ef19252b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:55.782237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a4d16-8fc4-4616-b61f-30ef19252b5c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:55.817473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 988/1965] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:55 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:55.824569 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eba5e-140f-47d4-ae38-926b48e46731 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:55.839421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eba5e-140f-47d4-ae38-926b48e46731 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:55.934682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de4ead-9e5b-4854-bf23-4bbac592fdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:55.935408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de4ead-9e5b-4854-bf23-4bbac592fdbf admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:55.935813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de4ead-9e5b-4854-bf23-4bbac592fdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:55.936347 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de4ead-9e5b-4854-bf23-4bbac592fdbf admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:55.937053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de4ead-9e5b-4854-bf23-4bbac592fdbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:55.938975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de4ead-9e5b-4854-bf23-4bbac592fdbf admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:55.963466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 978/1966] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:55 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:55.967571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a4d16-8fc4-4616-b61f-30ef19252b5c admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:55.979070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a4d16-8fc4-4616-b61f-30ef19252b5c admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:55.984146 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa16713-fe8c-4c27-b9e9-7d5d26f60226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:55.985000 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16713-fe8c-4c27-b9e9-7d5d26f60226 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:55.985388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16713-fe8c-4c27-b9e9-7d5d26f60226 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:55.985773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16713-fe8c-4c27-b9e9-7d5d26f60226 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:55.986733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa16713-fe8c-4c27-b9e9-7d5d26f60226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:55.989068 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa16713-fe8c-4c27-b9e9-7d5d26f60226 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:56.000408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 989/1967] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:56.005143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de4ead-9e5b-4854-bf23-4bbac592fdbf admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:56.015031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de4ead-9e5b-4854-bf23-4bbac592fdbf admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:56.020542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3ae25-f83a-4df0-915f-6139d736c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:56.021201 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3ae25-f83a-4df0-915f-6139d736c560 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:56.021755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3ae25-f83a-4df0-915f-6139d736c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:56.021755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3ae25-f83a-4df0-915f-6139d736c560 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:56.022943 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3ae25-f83a-4df0-915f-6139d736c560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:56.024081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3ae25-f83a-4df0-915f-6139d736c560 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:56.037788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 979/1968] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:56.040364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa16713-fe8c-4c27-b9e9-7d5d26f60226 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:56.040633 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3ae25-f83a-4df0-915f-6139d736c560 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:56.042612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-9fa16713-fe8c-4c27-b9e9-7d5d26f60226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:56.051159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3ae25-f83a-4df0-915f-6139d736c560 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:56.068109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b435f0-df62-48e9-8f15-66a75dbbf202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:56.069202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b435f0-df62-48e9-8f15-66a75dbbf202 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:56.069548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b435f0-df62-48e9-8f15-66a75dbbf202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:56.069899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b435f0-df62-48e9-8f15-66a75dbbf202 admin admin] PATH_INFO: `/v3/projects/3b6106caf15645e38327af58aa144264/users/ae0573f633014f299958149359f786ed/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:56.070689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa16713-fe8c-4c27-b9e9-7d5d26f60226 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:56.079778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:56.082091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:56.082429 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:56.082658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] PATH_INFO: `/v3/projects/d19c5fc0051b416fbb7abb75fca98a0b` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:56.084689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19c5fc0051b416fbb7abb75fca98a0b)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:56.087110 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:56.092965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b435f0-df62-48e9-8f15-66a75dbbf202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6106caf15645e38327af58aa144264, user_id=ae0573f633014f299958149359f786ed, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:56.096026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b435f0-df62-48e9-8f15-66a75dbbf202 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:56.113464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 980/1969] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:56 2022] PUT /identity/v3/projects/3b6106caf15645e38327af58aa144264/users/ae0573f633014f299958149359f786ed/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:56.125161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428c7e8-968f-4f7d-8846-99cc3713c7ab None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:56.125832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428c7e8-968f-4f7d-8846-99cc3713c7ab None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:56.126428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428c7e8-968f-4f7d-8846-99cc3713c7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:56.142652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19c5fc0051b416fbb7abb75fca98a0b', 'request_id': 'req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.149496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19c5fc0051b416fbb7abb75fca98a0b', 'request_id': 'req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.158563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19c5fc0051b416fbb7abb75fca98a0b', 'request_id': 'req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.175588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-d428c7e8-968f-4f7d-8846-99cc3713c7ab None None] MFA Rules not processed for user `ae0573f633014f299958149359f786ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:56.176013 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] The token cache is being invalidate because project d19c5fc0051b416fbb7abb75fca98a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:56.176305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.177026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.177147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d428c7e8-968f-4f7d-8846-99cc3713c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:56.178993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 990/1970] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:56 2022] DELETE /identity/v3/projects/d19c5fc0051b416fbb7abb75fca98a0b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:56.182722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:56.184061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:56.246748 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 981/1971] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:56.248683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9294b-2e21-48d6-8b83-19fbb97b6e0f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:56.254125 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47247a-05ea-485a-b0da-301d76e9d3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:56.255153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47247a-05ea-485a-b0da-301d76e9d3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:56.255343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47247a-05ea-485a-b0da-301d76e9d3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:56.255620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47247a-05ea-485a-b0da-301d76e9d3a9 admin admin] PATH_INFO: `/v3/users/fc27ba218dc0494d9d0a84550fd99748` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:56.256857 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47247a-05ea-485a-b0da-301d76e9d3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc27ba218dc0494d9d0a84550fd99748)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:56.258199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428c7e8-968f-4f7d-8846-99cc3713c7ab None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:56.258938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47247a-05ea-485a-b0da-301d76e9d3a9 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:56.260399 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d428c7e8-968f-4f7d-8846-99cc3713c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:56.322998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1b47247a-05ea-485a-b0da-301d76e9d3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc27ba218dc0494d9d0a84550fd99748'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.324236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428c7e8-968f-4f7d-8846-99cc3713c7ab None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:56.333411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1b47247a-05ea-485a-b0da-301d76e9d3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc27ba218dc0494d9d0a84550fd99748'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.333570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc903d9-5c39-4dbd-aae0-c21b238b4d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:56.334103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc903d9-5c39-4dbd-aae0-c21b238b4d60 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:56.334385 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc903d9-5c39-4dbd-aae0-c21b238b4d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:56.334656 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc903d9-5c39-4dbd-aae0-c21b238b4d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:56.335571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1b47247a-05ea-485a-b0da-301d76e9d3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc27ba218dc0494d9d0a84550fd99748'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.337590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-5fc903d9-5c39-4dbd-aae0-c21b238b4d60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:56.348847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc903d9-5c39-4dbd-aae0-c21b238b4d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:56.350277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc903d9-5c39-4dbd-aae0-c21b238b4d60 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:56.358769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1b47247a-05ea-485a-b0da-301d76e9d3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc27ba218dc0494d9d0a84550fd99748'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.359319 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 982/1972] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:56.373232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1b47247a-05ea-485a-b0da-301d76e9d3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc27ba218dc0494d9d0a84550fd99748'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.382099 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc903d9-5c39-4dbd-aae0-c21b238b4d60 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:56.383548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-5fc903d9-5c39-4dbd-aae0-c21b238b4d60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:56.395781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 991/1973] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:56 2022] DELETE /identity/v3/users/fc27ba218dc0494d9d0a84550fd99748 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:56.420560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc903d9-5c39-4dbd-aae0-c21b238b4d60 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:56.540018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd48823-1b07-408f-9d8c-063d5d158f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:56.541273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd48823-1b07-408f-9d8c-063d5d158f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:56.541766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd48823-1b07-408f-9d8c-063d5d158f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:56.542221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd48823-1b07-408f-9d8c-063d5d158f87 admin admin] PATH_INFO: `/v3/users/ae0573f633014f299958149359f786ed` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:56.543814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd48823-1b07-408f-9d8c-063d5d158f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0573f633014f299958149359f786ed)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:56.546359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd48823-1b07-408f-9d8c-063d5d158f87 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:56.625235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-fbd48823-1b07-408f-9d8c-063d5d158f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0573f633014f299958149359f786ed'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.636803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-fbd48823-1b07-408f-9d8c-063d5d158f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0573f633014f299958149359f786ed'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.658228 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-fbd48823-1b07-408f-9d8c-063d5d158f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0573f633014f299958149359f786ed'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.659555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-fbd48823-1b07-408f-9d8c-063d5d158f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0573f633014f299958149359f786ed'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.660190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-fbd48823-1b07-408f-9d8c-063d5d158f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0573f633014f299958149359f786ed'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:56.678357 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881a6df-ef88-452d-8177-b8b610f3615c None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:56.678938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881a6df-ef88-452d-8177-b8b610f3615c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:56.679393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881a6df-ef88-452d-8177-b8b610f3615c None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:56.681403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 992/1974] 10.222.0.73 () {54 vars in 921 bytes} [Wed May 4 13:48:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:48:56.685977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 983/1975] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:56 2022] DELETE /identity/v3/users/ae0573f633014f299958149359f786ed => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:56.690996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d73baa-589d-4896-af8a-60cd9b9e23a1 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:56.691385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d73baa-589d-4896-af8a-60cd9b9e23a1 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:56.691728 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d73baa-589d-4896-af8a-60cd9b9e23a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:56.730799 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-e3d73baa-589d-4896-af8a-60cd9b9e23a1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:56.731918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e3d73baa-589d-4896-af8a-60cd9b9e23a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:56.793138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8760fa-1ea0-4a62-b25a-051c4c360d37 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:56.793510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8760fa-1ea0-4a62-b25a-051c4c360d37 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:56.793942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8760fa-1ea0-4a62-b25a-051c4c360d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:56.833990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-0f8760fa-1ea0-4a62-b25a-051c4c360d37 None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:56.835262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0f8760fa-1ea0-4a62-b25a-051c4c360d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:56.886433 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 993/1976] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:56.887475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d73baa-589d-4896-af8a-60cd9b9e23a1 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:56.889766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e3d73baa-589d-4896-af8a-60cd9b9e23a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:56.923610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d73baa-589d-4896-af8a-60cd9b9e23a1 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:56.936353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:56.937574 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:56.937996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:56.938419 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] PATH_INFO: `/v3/users/486e9687b6cb4720b89dc5214f3d79b6` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:56.940968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] RBAC: Authorizing `identity:delete_user(user_id=486e9687b6cb4720b89dc5214f3d79b6)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:56.943425 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:56.979027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 984/1977] 10.222.0.73 () {58 vars in 1018 bytes} [Wed May 4 13:48:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:56.981842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8760fa-1ea0-4a62-b25a-051c4c360d37 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:56.985155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0f8760fa-1ea0-4a62-b25a-051c4c360d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:57.026702 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486e9687b6cb4720b89dc5214f3d79b6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.040453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486e9687b6cb4720b89dc5214f3d79b6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.041413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486e9687b6cb4720b89dc5214f3d79b6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.058857 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486e9687b6cb4720b89dc5214f3d79b6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.082289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8760fa-1ea0-4a62-b25a-051c4c360d37 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:57.087559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486e9687b6cb4720b89dc5214f3d79b6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.092610 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d7c69-b769-4701-8c22-b46c7d3a1150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:57.093527 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d7c69-b769-4701-8c22-b46c7d3a1150 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:57.094961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d7c69-b769-4701-8c22-b46c7d3a1150 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:57.095269 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d7c69-b769-4701-8c22-b46c7d3a1150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:57.101707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 994/1978] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:56 2022] DELETE /identity/v3/users/486e9687b6cb4720b89dc5214f3d79b6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:57.102644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:57.103897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-af8d7c69-b769-4701-8c22-b46c7d3a1150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:57.107117 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:57.119276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d7c69-b769-4701-8c22-b46c7d3a1150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:57.121023 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d7c69-b769-4701-8c22-b46c7d3a1150 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:57.131849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 985/1979] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:57.132978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d7c69-b769-4701-8c22-b46c7d3a1150 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:57.134390 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-af8d7c69-b769-4701-8c22-b46c7d3a1150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:57.150897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d7c69-b769-4701-8c22-b46c7d3a1150 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:57.239601 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61239d84-7531-4c0e-8590-c9249701489a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:57.246100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb54a8-3aa5-4d39-8f2f-80a503792080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:57.247899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb54a8-3aa5-4d39-8f2f-80a503792080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:57.248289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb54a8-3aa5-4d39-8f2f-80a503792080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:57.248854 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb54a8-3aa5-4d39-8f2f-80a503792080 admin admin] PATH_INFO: `/v3/projects/016c642a2b90490ea778ab97fc228190` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:57.251426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb54a8-3aa5-4d39-8f2f-80a503792080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016c642a2b90490ea778ab97fc228190)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:57.255478 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb54a8-3aa5-4d39-8f2f-80a503792080 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:57.263639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec29247-ec04-4813-a502-9954db290d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:57.265271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec29247-ec04-4813-a502-9954db290d78 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:57.265559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec29247-ec04-4813-a502-9954db290d78 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:57.265847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec29247-ec04-4813-a502-9954db290d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:57.286123 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3ec29247-ec04-4813-a502-9954db290d78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:57.334162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec29247-ec04-4813-a502-9954db290d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:57.337329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec29247-ec04-4813-a502-9954db290d78 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:57.347139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-23cb54a8-3aa5-4d39-8f2f-80a503792080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016c642a2b90490ea778ab97fc228190', 'request_id': 'req-23cb54a8-3aa5-4d39-8f2f-80a503792080'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.354374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-23cb54a8-3aa5-4d39-8f2f-80a503792080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016c642a2b90490ea778ab97fc228190', 'request_id': 'req-23cb54a8-3aa5-4d39-8f2f-80a503792080'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.386126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 986/1980] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:57.389698 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-23cb54a8-3aa5-4d39-8f2f-80a503792080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016c642a2b90490ea778ab97fc228190', 'request_id': 'req-23cb54a8-3aa5-4d39-8f2f-80a503792080'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.389827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705c62c-4c69-4d99-9b01-3cceb0540cb3 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:57.390048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705c62c-4c69-4d99-9b01-3cceb0540cb3 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:57.390367 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705c62c-4c69-4d99-9b01-3cceb0540cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:57.423723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-9705c62c-4c69-4d99-9b01-3cceb0540cb3 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:57.425424 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9705c62c-4c69-4d99-9b01-3cceb0540cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:57.437713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-23cb54a8-3aa5-4d39-8f2f-80a503792080 admin admin] The token cache is being invalidate because project 016c642a2b90490ea778ab97fc228190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:57.437713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-23cb54a8-3aa5-4d39-8f2f-80a503792080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.441892 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-23cb54a8-3aa5-4d39-8f2f-80a503792080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.457765 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 995/1981] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:57 2022] DELETE /identity/v3/projects/016c642a2b90490ea778ab97fc228190 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:57.462427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109651c-3b55-4b86-8af1-5302d50471d6 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:57.464614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109651c-3b55-4b86-8af1-5302d50471d6 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:57.475453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109651c-3b55-4b86-8af1-5302d50471d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:57.540028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 987/1982] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:57.540632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-6109651c-3b55-4b86-8af1-5302d50471d6 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:57.541874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6109651c-3b55-4b86-8af1-5302d50471d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:57.546091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705c62c-4c69-4d99-9b01-3cceb0540cb3 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:57.548826 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9705c62c-4c69-4d99-9b01-3cceb0540cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:57.577930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 996/1983] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:57.582285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176204c-a958-426c-8973-d6cad79fe475 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:57.588339 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176204c-a958-426c-8973-d6cad79fe475 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:57.590703 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176204c-a958-426c-8973-d6cad79fe475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:57.654683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-1176204c-a958-426c-8973-d6cad79fe475 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:57.656121 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1176204c-a958-426c-8973-d6cad79fe475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:57.676945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 997/1984] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:57.678940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176204c-a958-426c-8973-d6cad79fe475 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:57.680695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1176204c-a958-426c-8973-d6cad79fe475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:57.682444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705c62c-4c69-4d99-9b01-3cceb0540cb3 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:57.688040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b9bab-52ab-4047-9973-8e07a279ed22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:57.689680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b9bab-52ab-4047-9973-8e07a279ed22 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:57.690216 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b9bab-52ab-4047-9973-8e07a279ed22 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:57.691168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b9bab-52ab-4047-9973-8e07a279ed22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:57.693961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176204c-a958-426c-8973-d6cad79fe475 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:57.698842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c83ad-b119-4bd1-a716-c6f1a62f9004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:57.699927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c83ad-b119-4bd1-a716-c6f1a62f9004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:57.700236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c83ad-b119-4bd1-a716-c6f1a62f9004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:57.700514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c83ad-b119-4bd1-a716-c6f1a62f9004 admin admin] PATH_INFO: `/v3/projects/3b6106caf15645e38327af58aa144264` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:57.701702 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c83ad-b119-4bd1-a716-c6f1a62f9004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6106caf15645e38327af58aa144264)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:57.703629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c83ad-b119-4bd1-a716-c6f1a62f9004 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:57.704213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b9bab-52ab-4047-9973-8e07a279ed22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:57.707480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b9bab-52ab-4047-9973-8e07a279ed22 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:57.719318 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 988/1985] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:57.720153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b9bab-52ab-4047-9973-8e07a279ed22 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:57.734427 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b9bab-52ab-4047-9973-8e07a279ed22 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:57.740440 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636cbb4-0da6-4712-9417-0777a19fa655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:57.741914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636cbb4-0da6-4712-9417-0777a19fa655 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:57.742405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636cbb4-0da6-4712-9417-0777a19fa655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:57.742792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636cbb4-0da6-4712-9417-0777a19fa655 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:57.744019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636cbb4-0da6-4712-9417-0777a19fa655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:57.744416 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636cbb4-0da6-4712-9417-0777a19fa655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:57.746740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636cbb4-0da6-4712-9417-0777a19fa655 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:57.760866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-512c83ad-b119-4bd1-a716-c6f1a62f9004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6106caf15645e38327af58aa144264', 'request_id': 'req-512c83ad-b119-4bd1-a716-c6f1a62f9004'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.762182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 989/1986] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:57.766521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636cbb4-0da6-4712-9417-0777a19fa655 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:57.776601 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-512c83ad-b119-4bd1-a716-c6f1a62f9004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6106caf15645e38327af58aa144264', 'request_id': 'req-512c83ad-b119-4bd1-a716-c6f1a62f9004'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.779313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636cbb4-0da6-4712-9417-0777a19fa655 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:57.788643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-512c83ad-b119-4bd1-a716-c6f1a62f9004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6106caf15645e38327af58aa144264', 'request_id': 'req-512c83ad-b119-4bd1-a716-c6f1a62f9004'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.810091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-512c83ad-b119-4bd1-a716-c6f1a62f9004 admin admin] The token cache is being invalidate because project 3b6106caf15645e38327af58aa144264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:57.810572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-512c83ad-b119-4bd1-a716-c6f1a62f9004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.811628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-512c83ad-b119-4bd1-a716-c6f1a62f9004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:57.814112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 998/1987] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:57 2022] DELETE /identity/v3/projects/3b6106caf15645e38327af58aa144264 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:57.819512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130d991-fdb4-4328-a6d4-6c9f77368b07 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:57.819864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130d991-fdb4-4328-a6d4-6c9f77368b07 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:57.821644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130d991-fdb4-4328-a6d4-6c9f77368b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:57.844203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-1130d991-fdb4-4328-a6d4-6c9f77368b07 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:57.845468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1130d991-fdb4-4328-a6d4-6c9f77368b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:57.884220 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d84ac-8c07-450c-9366-2d3f17d986b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:57.885095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d84ac-8c07-450c-9366-2d3f17d986b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:57.885620 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d84ac-8c07-450c-9366-2d3f17d986b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:57.886096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d84ac-8c07-450c-9366-2d3f17d986b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:57.886929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d84ac-8c07-450c-9366-2d3f17d986b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:57.889738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d84ac-8c07-450c-9366-2d3f17d986b2 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:57.943799 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 999/1988] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:57.956625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 990/1989] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:57 2022] POST /identity/v3/projects => generated 361 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:48:57.957830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d84ac-8c07-450c-9366-2d3f17d986b2 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:57.959591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-276d84ac-8c07-450c-9366-2d3f17d986b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:57.959804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023d73e-3874-4ab3-be06-5a63aa19e2c4 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:57.960308 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023d73e-3874-4ab3-be06-5a63aa19e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:57.960878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023d73e-3874-4ab3-be06-5a63aa19e2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:57.989298 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-c023d73e-3874-4ab3-be06-5a63aa19e2c4 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:57.991130 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c023d73e-3874-4ab3-be06-5a63aa19e2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:58.071738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d84ac-8c07-450c-9366-2d3f17d986b2 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.075432 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1000/1990] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:58.079344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9eb99-c9ca-4298-bd15-c258792c98a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.079738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023d73e-3874-4ab3-be06-5a63aa19e2c4 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.080071 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9eb99-c9ca-4298-bd15-c258792c98a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.080404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9eb99-c9ca-4298-bd15-c258792c98a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.081180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9eb99-c9ca-4298-bd15-c258792c98a6 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.081873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9eb99-c9ca-4298-bd15-c258792c98a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.083816 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9eb99-c9ca-4298-bd15-c258792c98a6 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.093836 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023d73e-3874-4ab3-be06-5a63aa19e2c4 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.100389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b8a5-851b-4e21-b0db-db46bb163d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.101093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b8a5-851b-4e21-b0db-db46bb163d00 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.101368 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b8a5-851b-4e21-b0db-db46bb163d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.101640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b8a5-851b-4e21-b0db-db46bb163d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.102365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9b8a5-851b-4e21-b0db-db46bb163d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:58.102670 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9b8a5-851b-4e21-b0db-db46bb163d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.104352 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9b8a5-851b-4e21-b0db-db46bb163d00 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.115516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 991/1991] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:57 2022] POST /identity/v3/users => generated 281 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:58.119252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1001/1992] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:48:58.120511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9eb99-c9ca-4298-bd15-c258792c98a6 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.126581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b8a5-851b-4e21-b0db-db46bb163d00 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.133035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9eb99-c9ca-4298-bd15-c258792c98a6 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.138501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9b8a5-851b-4e21-b0db-db46bb163d00 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.144602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0e393-87ff-4ece-845e-d37c630f751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.145306 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0e393-87ff-4ece-845e-d37c630f751b admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.145589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0e393-87ff-4ece-845e-d37c630f751b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.145889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0e393-87ff-4ece-845e-d37c630f751b admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.146918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0e393-87ff-4ece-845e-d37c630f751b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.147277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57476ed1-d71f-45e1-b71d-1970e5f88af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.148029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57476ed1-d71f-45e1-b71d-1970e5f88af0 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.148852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57476ed1-d71f-45e1-b71d-1970e5f88af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.149244 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57476ed1-d71f-45e1-b71d-1970e5f88af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.149822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0e393-87ff-4ece-845e-d37c630f751b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.150124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57476ed1-d71f-45e1-b71d-1970e5f88af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.152072 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57476ed1-d71f-45e1-b71d-1970e5f88af0 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.166588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 992/1993] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:58.170455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57476ed1-d71f-45e1-b71d-1970e5f88af0 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.172590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-57476ed1-d71f-45e1-b71d-1970e5f88af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:58.182455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1002/1994] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:58 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:58.182455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0e393-87ff-4ece-845e-d37c630f751b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.194939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57476ed1-d71f-45e1-b71d-1970e5f88af0 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.242161 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0e393-87ff-4ece-845e-d37c630f751b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.246825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c68a02-e8fd-4892-b4c2-674d75933a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.247513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c68a02-e8fd-4892-b4c2-674d75933a8b admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.247797 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c68a02-e8fd-4892-b4c2-674d75933a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.248081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c68a02-e8fd-4892-b4c2-674d75933a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.248796 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c68a02-e8fd-4892-b4c2-674d75933a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.249039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.249896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.250182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.250365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c68a02-e8fd-4892-b4c2-674d75933a8b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.250463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] PATH_INFO: `/v3/projects/bc6ef4b22c94402baed64e3558c53640` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.252727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6ef4b22c94402baed64e3558c53640)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.254714 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.260673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1003/1995] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:58.261282 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c68a02-e8fd-4892-b4c2-674d75933a8b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.271515 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c68a02-e8fd-4892-b4c2-674d75933a8b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.276402 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48a363-fa04-482d-a176-dcad17947b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.277131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48a363-fa04-482d-a176-dcad17947b76 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.277511 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48a363-fa04-482d-a176-dcad17947b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.277806 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48a363-fa04-482d-a176-dcad17947b76 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.278580 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48a363-fa04-482d-a176-dcad17947b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.280729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48a363-fa04-482d-a176-dcad17947b76 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.304511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6ef4b22c94402baed64e3558c53640', 'request_id': 'req-bbe60e9c-732e-43f3-9031-f122f01bf254'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:58.306191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1004/1996] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:58 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:58.307090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48a363-fa04-482d-a176-dcad17947b76 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.311014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6ef4b22c94402baed64e3558c53640', 'request_id': 'req-bbe60e9c-732e-43f3-9031-f122f01bf254'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:58.318007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48a363-fa04-482d-a176-dcad17947b76 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.320292 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6ef4b22c94402baed64e3558c53640', 'request_id': 'req-bbe60e9c-732e-43f3-9031-f122f01bf254'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:58.331644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] The token cache is being invalidate because project bc6ef4b22c94402baed64e3558c53640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:58.331915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:58.332558 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:58.334308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 993/1997] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:58 2022] DELETE /identity/v3/projects/bc6ef4b22c94402baed64e3558c53640 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:58.334899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.336438 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:58.386265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8443a-4624-4fca-a685-5372081af08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.387172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8443a-4624-4fca-a685-5372081af08d admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.387521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8443a-4624-4fca-a685-5372081af08d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.387770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8443a-4624-4fca-a685-5372081af08d admin admin] PATH_INFO: `/v3/projects/872371478fd44439aedd51b292a72aee/users/f1c28c6facdb4db49e2db3da91a77f40/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.404662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8443a-4624-4fca-a685-5372081af08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=872371478fd44439aedd51b292a72aee, user_id=f1c28c6facdb4db49e2db3da91a77f40, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.407375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8443a-4624-4fca-a685-5372081af08d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.416795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe60e9c-732e-43f3-9031-f122f01bf254 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.422002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1005/1998] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:58 2022] PUT /identity/v3/projects/872371478fd44439aedd51b292a72aee/users/f1c28c6facdb4db49e2db3da91a77f40/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:58.422883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8443a-4624-4fca-a685-5372081af08d admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.425041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-bbe8443a-4624-4fca-a685-5372081af08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:58.484996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8d306-4003-4d34-a544-9dceb3880cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.485665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8d306-4003-4d34-a544-9dceb3880cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.485948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8d306-4003-4d34-a544-9dceb3880cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.486225 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8d306-4003-4d34-a544-9dceb3880cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.487523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8d306-4003-4d34-a544-9dceb3880cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.489116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8d306-4003-4d34-a544-9dceb3880cd2 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.494930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8443a-4624-4fca-a685-5372081af08d admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.501785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 994/1999] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:58.501785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fc6fb-7699-4b36-af5b-1b8d90ee7b98 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.502011 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.502124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fc6fb-7699-4b36-af5b-1b8d90ee7b98 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.502124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fc6fb-7699-4b36-af5b-1b8d90ee7b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.502946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.502946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.502946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] PATH_INFO: `/v3/users/44d65e17fa20468fbaf143fa22354651` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.503822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d65e17fa20468fbaf143fa22354651)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.505712 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.530173 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b15fc6fb-7699-4b36-af5b-1b8d90ee7b98 None None] MFA Rules not processed for user `f1c28c6facdb4db49e2db3da91a77f40`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:58.531419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b15fc6fb-7699-4b36-af5b-1b8d90ee7b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:58.567277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d65e17fa20468fbaf143fa22354651'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:58.577896 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d65e17fa20468fbaf143fa22354651'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:58.578570 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d65e17fa20468fbaf143fa22354651'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:58.588620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d65e17fa20468fbaf143fa22354651'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:58.605781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d65e17fa20468fbaf143fa22354651'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:58.613222 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1006/2000] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:58 2022] DELETE /identity/v3/users/44d65e17fa20468fbaf143fa22354651 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:58.613763 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 995/2001] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:58.614271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.616034 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:58.670034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fc6fb-7699-4b36-af5b-1b8d90ee7b98 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.671527 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b15fc6fb-7699-4b36-af5b-1b8d90ee7b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:58.736291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba32463-9c9d-42a2-abf2-5614f8753837 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.741692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645537-e968-4d1b-897c-d3b1dcf394aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.742357 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645537-e968-4d1b-897c-d3b1dcf394aa admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.742635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645537-e968-4d1b-897c-d3b1dcf394aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.742906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645537-e968-4d1b-897c-d3b1dcf394aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.743783 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645537-e968-4d1b-897c-d3b1dcf394aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.745530 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645537-e968-4d1b-897c-d3b1dcf394aa admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.754283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fc6fb-7699-4b36-af5b-1b8d90ee7b98 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.758700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1007/2002] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:58.762577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645537-e968-4d1b-897c-d3b1dcf394aa admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.774687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645537-e968-4d1b-897c-d3b1dcf394aa admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:58.782610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f246d-299b-4b25-89a6-123be528a46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.785019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f246d-299b-4b25-89a6-123be528a46b admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.785366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f246d-299b-4b25-89a6-123be528a46b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.785709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f246d-299b-4b25-89a6-123be528a46b admin admin] PATH_INFO: `/v3/projects/ca7aec3a284b477a97ad2a9027d25261/users/43853c8fc63d4fa7ac4b9c6e7c2f723b/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.826596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f246d-299b-4b25-89a6-123be528a46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7aec3a284b477a97ad2a9027d25261, user_id=43853c8fc63d4fa7ac4b9c6e7c2f723b, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.830711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f246d-299b-4b25-89a6-123be528a46b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.834888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5256383-3490-4428-9960-8af2e9c93c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:58.837099 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5256383-3490-4428-9960-8af2e9c93c4e service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.837399 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5256383-3490-4428-9960-8af2e9c93c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.838187 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5256383-3490-4428-9960-8af2e9c93c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.857329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1008/2003] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:48:58 2022] PUT /identity/v3/projects/ca7aec3a284b477a97ad2a9027d25261/users/43853c8fc63d4fa7ac4b9c6e7c2f723b/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:48:58.873383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f4677-9886-43af-a5ca-44124fb857ea None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:58.874099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f4677-9886-43af-a5ca-44124fb857ea None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:58.874576 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f4677-9886-43af-a5ca-44124fb857ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:58.905530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5256383-3490-4428-9960-8af2e9c93c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:58.907843 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5256383-3490-4428-9960-8af2e9c93c4e service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:58.911498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-7f6f4677-9886-43af-a5ca-44124fb857ea None None] MFA Rules not processed for user `43853c8fc63d4fa7ac4b9c6e7c2f723b`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:58.913237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7f6f4677-9886-43af-a5ca-44124fb857ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:58.935177 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 996/2004] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:58.936234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5256383-3490-4428-9960-8af2e9c93c4e service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:58.937654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c5256383-3490-4428-9960-8af2e9c93c4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:58.955277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5256383-3490-4428-9960-8af2e9c93c4e service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:59.006667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1009/2005] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:59.023569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f4677-9886-43af-a5ca-44124fb857ea None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:59.025219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7f6f4677-9886-43af-a5ca-44124fb857ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:59.038603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:59.039627 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.039977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.040315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] PATH_INFO: `/v3/users/f1c28c6facdb4db49e2db3da91a77f40` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.041775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c28c6facdb4db49e2db3da91a77f40)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:59.044038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:59.115037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c28c6facdb4db49e2db3da91a77f40'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.123903 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c28c6facdb4db49e2db3da91a77f40'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.131727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c28c6facdb4db49e2db3da91a77f40'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.133170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c28c6facdb4db49e2db3da91a77f40'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.133863 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c28c6facdb4db49e2db3da91a77f40'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.136752 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f4677-9886-43af-a5ca-44124fb857ea None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:59.140922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019e662-1df8-4d9f-a592-289b3c062bd5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf2b88cc78d4defa7cefb7bf0ae6144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:59.141677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019e662-1df8-4d9f-a592-289b3c062bd5 service glance] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.141990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019e662-1df8-4d9f-a592-289b3c062bd5 service glance] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.142260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019e662-1df8-4d9f-a592-289b3c062bd5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.146387 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e019e662-1df8-4d9f-a592-289b3c062bd5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:59.161287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019e662-1df8-4d9f-a592-289b3c062bd5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:59.161981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 997/2006] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:58 2022] DELETE /identity/v3/users/f1c28c6facdb4db49e2db3da91a77f40 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:59.162793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019e662-1df8-4d9f-a592-289b3c062bd5 service glance] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:59.165027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:59.168100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:59.173320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1010/2007] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:48:59.175305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f6bfd-eb50-4797-9729-4d8be6f2917a None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.175599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f6bfd-eb50-4797-9729-4d8be6f2917a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.175874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f6bfd-eb50-4797-9729-4d8be6f2917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.207843 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-765f6bfd-eb50-4797-9729-4d8be6f2917a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:59.209348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-765f6bfd-eb50-4797-9729-4d8be6f2917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:59.275885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9c25b-fe8d-4c9a-86b0-19c323141ec8 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:59.281139 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cff30-434f-4823-9c14-16320ca57612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:59.282000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cff30-434f-4823-9c14-16320ca57612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.282277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cff30-434f-4823-9c14-16320ca57612 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.282550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cff30-434f-4823-9c14-16320ca57612 admin admin] PATH_INFO: `/v3/projects/908b9194ecd4489d86030f30e0306817` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.284431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cff30-434f-4823-9c14-16320ca57612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=908b9194ecd4489d86030f30e0306817)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:59.286341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cff30-434f-4823-9c14-16320ca57612 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:59.291045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1011/2008] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:59.305006 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f6bfd-eb50-4797-9729-4d8be6f2917a None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:59.306823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-765f6bfd-eb50-4797-9729-4d8be6f2917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:59.347844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-648cff30-434f-4823-9c14-16320ca57612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908b9194ecd4489d86030f30e0306817', 'request_id': 'req-648cff30-434f-4823-9c14-16320ca57612'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.359353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-648cff30-434f-4823-9c14-16320ca57612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908b9194ecd4489d86030f30e0306817', 'request_id': 'req-648cff30-434f-4823-9c14-16320ca57612'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.372548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-648cff30-434f-4823-9c14-16320ca57612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908b9194ecd4489d86030f30e0306817', 'request_id': 'req-648cff30-434f-4823-9c14-16320ca57612'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.386807 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-648cff30-434f-4823-9c14-16320ca57612 admin admin] The token cache is being invalidate because project 908b9194ecd4489d86030f30e0306817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:48:59.387099 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-648cff30-434f-4823-9c14-16320ca57612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.388222 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-648cff30-434f-4823-9c14-16320ca57612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.389930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 998/2009] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:48:59 2022] DELETE /identity/v3/projects/908b9194ecd4489d86030f30e0306817 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:59.394101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f6bfd-eb50-4797-9729-4d8be6f2917a None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:59.395938 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e523d1-e482-4ec4-8034-548754f474f3 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.396338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e523d1-e482-4ec4-8034-548754f474f3 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.396740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e523d1-e482-4ec4-8034-548754f474f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.421238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-38e523d1-e482-4ec4-8034-548754f474f3 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:59.422718 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-38e523d1-e482-4ec4-8034-548754f474f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:59.464581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55cc6b-f2e2-4a50-84ec-52f11b499940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:59.465305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55cc6b-f2e2-4a50-84ec-52f11b499940 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.465624 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55cc6b-f2e2-4a50-84ec-52f11b499940 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.465906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55cc6b-f2e2-4a50-84ec-52f11b499940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.468637 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7b55cc6b-f2e2-4a50-84ec-52f11b499940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:59.503932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 999/2010] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:48:59.516553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67163199-2700-49af-835a-2605892a626f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.516849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67163199-2700-49af-835a-2605892a626f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.517131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67163199-2700-49af-835a-2605892a626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.542125 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-67163199-2700-49af-835a-2605892a626f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:59.543524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-67163199-2700-49af-835a-2605892a626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:59.555083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1000/2011] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:59.556056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67163199-2700-49af-835a-2605892a626f None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:59.557581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-67163199-2700-49af-835a-2605892a626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:59.578467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67163199-2700-49af-835a-2605892a626f None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:59.587055 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55cc6b-f2e2-4a50-84ec-52f11b499940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:59.588296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c1804-db2c-4153-8532-9d45c02daf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:59.588879 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55cc6b-f2e2-4a50-84ec-52f11b499940 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:59.589979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1804-db2c-4153-8532-9d45c02daf34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.590515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1804-db2c-4153-8532-9d45c02daf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.590899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1804-db2c-4153-8532-9d45c02daf34 admin admin] PATH_INFO: `/v3/users/52fd78a8cb7742b7937721cd32b0b43a` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.594023 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c1804-db2c-4153-8532-9d45c02daf34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52fd78a8cb7742b7937721cd32b0b43a)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:59.604981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c1804-db2c-4153-8532-9d45c02daf34 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:59.612812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1012/2012] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:48:59.614474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55cc6b-f2e2-4a50-84ec-52f11b499940 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:59.627908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55cc6b-f2e2-4a50-84ec-52f11b499940 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:59.635328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce3655-9f88-4f24-b868-9f0842688d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:59.636407 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce3655-9f88-4f24-b868-9f0842688d53 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.636769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce3655-9f88-4f24-b868-9f0842688d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.637903 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce3655-9f88-4f24-b868-9f0842688d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.641137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce3655-9f88-4f24-b868-9f0842688d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:48:59.641770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce3655-9f88-4f24-b868-9f0842688d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:59.644878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce3655-9f88-4f24-b868-9f0842688d53 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:59.668986 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b2c1804-db2c-4153-8532-9d45c02daf34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52fd78a8cb7742b7937721cd32b0b43a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.672723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1013/2013] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:48:59.680491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce3655-9f88-4f24-b868-9f0842688d53 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:59.690884 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b2c1804-db2c-4153-8532-9d45c02daf34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52fd78a8cb7742b7937721cd32b0b43a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.701666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b2c1804-db2c-4153-8532-9d45c02daf34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52fd78a8cb7742b7937721cd32b0b43a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.702582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b2c1804-db2c-4153-8532-9d45c02daf34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52fd78a8cb7742b7937721cd32b0b43a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.704128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce3655-9f88-4f24-b868-9f0842688d53 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:59.704743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b2c1804-db2c-4153-8532-9d45c02daf34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52fd78a8cb7742b7937721cd32b0b43a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:48:59.716049 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48bf60-b08f-4995-b3b6-99d291adb25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:59.719144 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48bf60-b08f-4995-b3b6-99d291adb25e admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.719452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48bf60-b08f-4995-b3b6-99d291adb25e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.721793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48bf60-b08f-4995-b3b6-99d291adb25e admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.722598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48bf60-b08f-4995-b3b6-99d291adb25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:59.727663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48bf60-b08f-4995-b3b6-99d291adb25e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:59.749644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1001/2014] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:48:59 2022] DELETE /identity/v3/users/52fd78a8cb7742b7937721cd32b0b43a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:48:59.751970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12949c8-db18-43a5-b24c-77073941f264 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.751970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12949c8-db18-43a5-b24c-77073941f264 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.751970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12949c8-db18-43a5-b24c-77073941f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.776186 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1014/2015] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:48:59 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:59.777095 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48bf60-b08f-4995-b3b6-99d291adb25e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:59.779228 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4a48bf60-b08f-4995-b3b6-99d291adb25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:59.791393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-e12949c8-db18-43a5-b24c-77073941f264 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:48:59.792851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e12949c8-db18-43a5-b24c-77073941f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:59.857909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48bf60-b08f-4995-b3b6-99d291adb25e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:59.863469 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000e507-7670-430d-b6ba-d3bd0e3de784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:59.864274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000e507-7670-430d-b6ba-d3bd0e3de784 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.864732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000e507-7670-430d-b6ba-d3bd0e3de784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.865313 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000e507-7670-430d-b6ba-d3bd0e3de784 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.865973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000e507-7670-430d-b6ba-d3bd0e3de784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:59.868211 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000e507-7670-430d-b6ba-d3bd0e3de784 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:59.920979 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1015/2016] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:48:59 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:48:59.921122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1002/2017] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:48:59.925137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000e507-7670-430d-b6ba-d3bd0e3de784 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:59.937477 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000e507-7670-430d-b6ba-d3bd0e3de784 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:48:59.943024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a36fc-4c41-430e-b321-4a74aa150918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:48:59.943753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a36fc-4c41-430e-b321-4a74aa150918 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:48:59.944037 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a36fc-4c41-430e-b321-4a74aa150918 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:48:59.944423 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a36fc-4c41-430e-b321-4a74aa150918 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:48:59.945045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a36fc-4c41-430e-b321-4a74aa150918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:48:59.946633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a36fc-4c41-430e-b321-4a74aa150918 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:48:59.950546 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12949c8-db18-43a5-b24c-77073941f264 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:59.952528 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e12949c8-db18-43a5-b24c-77073941f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:48:59.959973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1016/2018] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:48:59.964960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a36fc-4c41-430e-b321-4a74aa150918 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:48:59.988978 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a36fc-4c41-430e-b321-4a74aa150918 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.007592 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca977e-aa55-4d86-a863-147ec737fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.008305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca977e-aa55-4d86-a863-147ec737fe79 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.008590 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca977e-aa55-4d86-a863-147ec737fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.008872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca977e-aa55-4d86-a863-147ec737fe79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.009610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca977e-aa55-4d86-a863-147ec737fe79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.011200 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca977e-aa55-4d86-a863-147ec737fe79 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:00.032894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1017/2019] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:00.036416 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12949c8-db18-43a5-b24c-77073941f264 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.037272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca977e-aa55-4d86-a863-147ec737fe79 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:00.053101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca977e-aa55-4d86-a863-147ec737fe79 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.056939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc619d-61b2-4788-9e01-96c1c8943575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.057951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc619d-61b2-4788-9e01-96c1c8943575 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.058351 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc619d-61b2-4788-9e01-96c1c8943575 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.058788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc619d-61b2-4788-9e01-96c1c8943575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.059922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d30987-d2fe-4bc0-9497-60e3ad919755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.061044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d30987-d2fe-4bc0-9497-60e3ad919755 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.061480 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d30987-d2fe-4bc0-9497-60e3ad919755 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.062353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d30987-d2fe-4bc0-9497-60e3ad919755 admin admin] PATH_INFO: `/v3/projects/9c6157bd4b424994b519cc99d96b3700/users/69f29acdd72f47f3aa2eec79f42f68e7/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.076381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc619d-61b2-4788-9e01-96c1c8943575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.077949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc619d-61b2-4788-9e01-96c1c8943575 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:00.090181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1003/2020] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:48:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:00.091937 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d30987-d2fe-4bc0-9497-60e3ad919755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6157bd4b424994b519cc99d96b3700, user_id=69f29acdd72f47f3aa2eec79f42f68e7, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.094986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d30987-d2fe-4bc0-9497-60e3ad919755 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:00.112894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1018/2021] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:00 2022] PUT /identity/v3/projects/9c6157bd4b424994b519cc99d96b3700/users/69f29acdd72f47f3aa2eec79f42f68e7/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:00.123294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b293-5b7f-447f-b086-ceaa8af0de15 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.123730 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b293-5b7f-447f-b086-ceaa8af0de15 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.124037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3b293-5b7f-447f-b086-ceaa8af0de15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.132903 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d30987-d2fe-4bc0-9497-60e3ad919755 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:00.144593 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-94d30987-d2fe-4bc0-9497-60e3ad919755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:00.176846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b8f3b293-5b7f-447f-b086-ceaa8af0de15 None None] MFA Rules not processed for user `69f29acdd72f47f3aa2eec79f42f68e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:00.178398 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b8f3b293-5b7f-447f-b086-ceaa8af0de15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:00.264375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d30987-d2fe-4bc0-9497-60e3ad919755 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.270027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd98212-c6d1-4cb2-8086-612ff677827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.271199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd98212-c6d1-4cb2-8086-612ff677827e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.271601 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd98212-c6d1-4cb2-8086-612ff677827e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.271951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd98212-c6d1-4cb2-8086-612ff677827e admin admin] PATH_INFO: `/v3/projects/872371478fd44439aedd51b292a72aee` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.273844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd98212-c6d1-4cb2-8086-612ff677827e admin admin] RBAC: Authorizing `identity:delete_project(project_id=872371478fd44439aedd51b292a72aee)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.275677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd98212-c6d1-4cb2-8086-612ff677827e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:00.319737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1004/2022] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:00.337314 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3b293-5b7f-447f-b086-ceaa8af0de15 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:00.359884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8bd98212-c6d1-4cb2-8086-612ff677827e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872371478fd44439aedd51b292a72aee', 'request_id': 'req-8bd98212-c6d1-4cb2-8086-612ff677827e'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:00.371442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8bd98212-c6d1-4cb2-8086-612ff677827e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872371478fd44439aedd51b292a72aee', 'request_id': 'req-8bd98212-c6d1-4cb2-8086-612ff677827e'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:00.378706 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3b293-5b7f-447f-b086-ceaa8af0de15 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.383113 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8bd98212-c6d1-4cb2-8086-612ff677827e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872371478fd44439aedd51b292a72aee', 'request_id': 'req-8bd98212-c6d1-4cb2-8086-612ff677827e'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:00.408052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8bd98212-c6d1-4cb2-8086-612ff677827e admin admin] The token cache is being invalidate because project 872371478fd44439aedd51b292a72aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:00.409012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8bd98212-c6d1-4cb2-8086-612ff677827e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:00.409816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8bd98212-c6d1-4cb2-8086-612ff677827e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:00.415444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1019/2023] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:00 2022] DELETE /identity/v3/projects/872371478fd44439aedd51b292a72aee => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:00.420517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251c0fa-477f-4767-8bb1-9f45882260ec None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.420955 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251c0fa-477f-4767-8bb1-9f45882260ec None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.421451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251c0fa-477f-4767-8bb1-9f45882260ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.450402 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-0251c0fa-477f-4767-8bb1-9f45882260ec None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:00.455389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0251c0fa-477f-4767-8bb1-9f45882260ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:00.488340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc26d4f-0ebf-4379-bf9d-c9126f498eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.489742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc26d4f-0ebf-4379-bf9d-c9126f498eff admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.490263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc26d4f-0ebf-4379-bf9d-c9126f498eff admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.490776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc26d4f-0ebf-4379-bf9d-c9126f498eff admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.492934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc26d4f-0ebf-4379-bf9d-c9126f498eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.495730 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc26d4f-0ebf-4379-bf9d-c9126f498eff admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:00.535606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1005/2024] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:00 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:00.540268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc26d4f-0ebf-4379-bf9d-c9126f498eff admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:00.542448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-edc26d4f-0ebf-4379-bf9d-c9126f498eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:00.545639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1020/2025] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:00.555580 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9b7c2-5a5f-4e55-9e73-27afe66e1c11 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.555982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9b7c2-5a5f-4e55-9e73-27afe66e1c11 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.556339 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9b7c2-5a5f-4e55-9e73-27afe66e1c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.577344 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d9d9b7c2-5a5f-4e55-9e73-27afe66e1c11 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:00.578529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d9d9b7c2-5a5f-4e55-9e73-27afe66e1c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:00.654474 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc26d4f-0ebf-4379-bf9d-c9126f498eff admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.662423 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d851d5f-7057-439c-aa6b-891063e6fb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.663110 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d851d5f-7057-439c-aa6b-891063e6fb99 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.663429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d851d5f-7057-439c-aa6b-891063e6fb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.663709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d851d5f-7057-439c-aa6b-891063e6fb99 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.664403 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d851d5f-7057-439c-aa6b-891063e6fb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.669195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1021/2026] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:00.669328 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d851d5f-7057-439c-aa6b-891063e6fb99 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:00.672044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9b7c2-5a5f-4e55-9e73-27afe66e1c11 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:00.685644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9b7c2-5a5f-4e55-9e73-27afe66e1c11 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.696168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffacee-ff99-45e8-8556-b10973314677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.696168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffacee-ff99-45e8-8556-b10973314677 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.696168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffacee-ff99-45e8-8556-b10973314677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.696168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffacee-ff99-45e8-8556-b10973314677 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.696761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffacee-ff99-45e8-8556-b10973314677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:00.696761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffacee-ff99-45e8-8556-b10973314677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.697367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffacee-ff99-45e8-8556-b10973314677 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:00.716342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1006/2027] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:00 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:00.716342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d851d5f-7057-439c-aa6b-891063e6fb99 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:00.717420 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8d851d5f-7057-439c-aa6b-891063e6fb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:00.725238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1022/2028] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:00.729549 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffacee-ff99-45e8-8556-b10973314677 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:00.732688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d851d5f-7057-439c-aa6b-891063e6fb99 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.739119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.740049 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.740431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.740745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] PATH_INFO: `/v3/projects/38b1ffd3de524bd9ba04c6477cb588ae` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.743173 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b1ffd3de524bd9ba04c6477cb588ae)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.745510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:00.746823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffacee-ff99-45e8-8556-b10973314677 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.753167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e487f7a-f9de-4954-a50d-24811a69a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.754241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e487f7a-f9de-4954-a50d-24811a69a586 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.754241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e487f7a-f9de-4954-a50d-24811a69a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.757565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e487f7a-f9de-4954-a50d-24811a69a586 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.757565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e487f7a-f9de-4954-a50d-24811a69a586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.764381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e487f7a-f9de-4954-a50d-24811a69a586 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:00.780051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1023/2029] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:00.780899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e487f7a-f9de-4954-a50d-24811a69a586 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:00.791910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e487f7a-f9de-4954-a50d-24811a69a586 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.797546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4edd8f-30c4-4c5e-b451-bfe42b8a47a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.798791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4edd8f-30c4-4c5e-b451-bfe42b8a47a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.799775 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4edd8f-30c4-4c5e-b451-bfe42b8a47a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.800017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4edd8f-30c4-4c5e-b451-bfe42b8a47a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.800768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4edd8f-30c4-4c5e-b451-bfe42b8a47a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.802672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4edd8f-30c4-4c5e-b451-bfe42b8a47a3 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:00.810319 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b1ffd3de524bd9ba04c6477cb588ae', 'request_id': 'req-c65db0e6-3c76-4858-a998-b6a7f9f7d171'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:00.818055 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b1ffd3de524bd9ba04c6477cb588ae', 'request_id': 'req-c65db0e6-3c76-4858-a998-b6a7f9f7d171'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:00.831097 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b1ffd3de524bd9ba04c6477cb588ae', 'request_id': 'req-c65db0e6-3c76-4858-a998-b6a7f9f7d171'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:00.834519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1024/2030] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:00 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:00.835630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4edd8f-30c4-4c5e-b451-bfe42b8a47a3 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:00.847057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] The token cache is being invalidate because project 38b1ffd3de524bd9ba04c6477cb588ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:00.847393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:00.848060 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:00.850067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1007/2031] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:00 2022] DELETE /identity/v3/projects/38b1ffd3de524bd9ba04c6477cb588ae => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:00.850949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:00.852856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:00.915934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4edd8f-30c4-4c5e-b451-bfe42b8a47a3 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.921167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcb937-1eda-4199-8665-dee87d0de93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.921859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcb937-1eda-4199-8665-dee87d0de93d admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.922166 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcb937-1eda-4199-8665-dee87d0de93d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.922395 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcb937-1eda-4199-8665-dee87d0de93d admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.923345 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcb937-1eda-4199-8665-dee87d0de93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.924999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcb937-1eda-4199-8665-dee87d0de93d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:00.930527 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65db0e6-3c76-4858-a998-b6a7f9f7d171 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.936118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc8caf-2b51-4ed9-836e-ce61dfdf52db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.936822 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc8caf-2b51-4ed9-836e-ce61dfdf52db admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.937089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc8caf-2b51-4ed9-836e-ce61dfdf52db admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.937363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc8caf-2b51-4ed9-836e-ce61dfdf52db admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.938059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc8caf-2b51-4ed9-836e-ce61dfdf52db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.940049 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc8caf-2b51-4ed9-836e-ce61dfdf52db admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:00.951422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1025/2032] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:00.952582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcb937-1eda-4199-8665-dee87d0de93d admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:00.954905 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-bedcb937-1eda-4199-8665-dee87d0de93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:00.964261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1008/2033] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:00 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:00.965193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc8caf-2b51-4ed9-836e-ce61dfdf52db admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:00.966902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-41dc8caf-2b51-4ed9-836e-ce61dfdf52db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:00.981431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc8caf-2b51-4ed9-836e-ce61dfdf52db admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.990124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afe35-6316-4355-a50a-3ad12bd4c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.990124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afe35-6316-4355-a50a-3ad12bd4c9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.990124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afe35-6316-4355-a50a-3ad12bd4c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.990124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afe35-6316-4355-a50a-3ad12bd4c9bb admin admin] PATH_INFO: `/v3/projects/1b1a3a10c376413a81b57902682b4b31/users/201984a6fda04b4e909baebfc8a3304e/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.990432 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcb937-1eda-4199-8665-dee87d0de93d admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:00.994883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1c901-7c42-4143-9b7f-95d1b790bca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:00.995802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1c901-7c42-4143-9b7f-95d1b790bca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:00.996069 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1c901-7c42-4143-9b7f-95d1b790bca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:00.996352 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1c901-7c42-4143-9b7f-95d1b790bca3 admin admin] PATH_INFO: `/v3/users/6cc331c22dda4e9bbbdf08a5e7437d8c` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:00.997575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1c901-7c42-4143-9b7f-95d1b790bca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc331c22dda4e9bbbdf08a5e7437d8c)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:00.999730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1c901-7c42-4143-9b7f-95d1b790bca3 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:01.009684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997afe35-6316-4355-a50a-3ad12bd4c9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1a3a10c376413a81b57902682b4b31, user_id=201984a6fda04b4e909baebfc8a3304e, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:01.012860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997afe35-6316-4355-a50a-3ad12bd4c9bb admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:01.031261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1009/2034] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:00 2022] PUT /identity/v3/projects/1b1a3a10c376413a81b57902682b4b31/users/201984a6fda04b4e909baebfc8a3304e/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:01.031261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afe35-6316-4355-a50a-3ad12bd4c9bb admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:01.074945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-15c1c901-7c42-4143-9b7f-95d1b790bca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc331c22dda4e9bbbdf08a5e7437d8c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:01.095048 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-15c1c901-7c42-4143-9b7f-95d1b790bca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc331c22dda4e9bbbdf08a5e7437d8c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:01.097891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-15c1c901-7c42-4143-9b7f-95d1b790bca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc331c22dda4e9bbbdf08a5e7437d8c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:01.115536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-15c1c901-7c42-4143-9b7f-95d1b790bca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc331c22dda4e9bbbdf08a5e7437d8c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:01.124090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-15c1c901-7c42-4143-9b7f-95d1b790bca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc331c22dda4e9bbbdf08a5e7437d8c'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:01.131420 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1026/2035] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:00 2022] DELETE /identity/v3/users/6cc331c22dda4e9bbbdf08a5e7437d8c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:01.132908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd411f4-77a1-45b4-b81c-2193ce9a4b12 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:01.133027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd411f4-77a1-45b4-b81c-2193ce9a4b12 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:01.133238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd411f4-77a1-45b4-b81c-2193ce9a4b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:01.169161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afe35-6316-4355-a50a-3ad12bd4c9bb admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:01.188722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-edd411f4-77a1-45b4-b81c-2193ce9a4b12 None None] MFA Rules not processed for user `201984a6fda04b4e909baebfc8a3304e`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:01.191806 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-edd411f4-77a1-45b4-b81c-2193ce9a4b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:01.302341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe9529-7de9-4b8b-980d-f18eca578fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:01.304618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe9529-7de9-4b8b-980d-f18eca578fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:01.304904 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe9529-7de9-4b8b-980d-f18eca578fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:01.305182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe9529-7de9-4b8b-980d-f18eca578fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:01.306145 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe9529-7de9-4b8b-980d-f18eca578fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:01.307660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe9529-7de9-4b8b-980d-f18eca578fc7 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:01.335970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1027/2036] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:01.340551 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd411f4-77a1-45b4-b81c-2193ce9a4b12 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:01.343051 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-edd411f4-77a1-45b4-b81c-2193ce9a4b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:01.346529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1010/2037] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:01.349574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe9529-7de9-4b8b-980d-f18eca578fc7 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:01.352004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bcfe9529-7de9-4b8b-980d-f18eca578fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:01.389101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe9529-7de9-4b8b-980d-f18eca578fc7 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:01.395499 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb26a6d-5ef6-490e-b656-687836efed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:01.396932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb26a6d-5ef6-490e-b656-687836efed18 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:01.397372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb26a6d-5ef6-490e-b656-687836efed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:01.397663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb26a6d-5ef6-490e-b656-687836efed18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:01.398674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb26a6d-5ef6-490e-b656-687836efed18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:01.400470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd411f4-77a1-45b4-b81c-2193ce9a4b12 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:01.401025 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb26a6d-5ef6-490e-b656-687836efed18 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:01.413449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601d84a-8377-4023-b7a7-72e31f48f00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:01.414156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601d84a-8377-4023-b7a7-72e31f48f00f admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:01.414452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601d84a-8377-4023-b7a7-72e31f48f00f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:01.414690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601d84a-8377-4023-b7a7-72e31f48f00f admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:01.415450 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601d84a-8377-4023-b7a7-72e31f48f00f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:01.417539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601d84a-8377-4023-b7a7-72e31f48f00f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:01.425668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1011/2038] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:01.432197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb26a6d-5ef6-490e-b656-687836efed18 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:01.443312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb26a6d-5ef6-490e-b656-687836efed18 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:01.448451 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b2809-ca8c-4005-a854-dd7115c28756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:01.449366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b2809-ca8c-4005-a854-dd7115c28756 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:01.449712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b2809-ca8c-4005-a854-dd7115c28756 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:01.449926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b2809-ca8c-4005-a854-dd7115c28756 admin admin] PATH_INFO: `/v3/projects/1309fafd0ab84b8f993c8cecdf4ac2d0/users/3230ae74e3ca4075955158ef9ae382c7/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:01.453714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1028/2039] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:01 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:01.458012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601d84a-8377-4023-b7a7-72e31f48f00f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:01.480236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b2809-ca8c-4005-a854-dd7115c28756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1309fafd0ab84b8f993c8cecdf4ac2d0, user_id=3230ae74e3ca4075955158ef9ae382c7, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:01.483866 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b2809-ca8c-4005-a854-dd7115c28756 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:01.508266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1012/2040] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:01 2022] PUT /identity/v3/projects/1309fafd0ab84b8f993c8cecdf4ac2d0/users/3230ae74e3ca4075955158ef9ae382c7/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:01.519888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87316d-c6fd-4460-be39-a6453d9df952 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:01.520466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87316d-c6fd-4460-be39-a6453d9df952 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:01.520909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87316d-c6fd-4460-be39-a6453d9df952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:01.570157 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601d84a-8377-4023-b7a7-72e31f48f00f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:01.583088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-9d87316d-c6fd-4460-be39-a6453d9df952 None None] MFA Rules not processed for user `3230ae74e3ca4075955158ef9ae382c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:01.586823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9d87316d-c6fd-4460-be39-a6453d9df952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:01.701439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1013/2041] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:01.702808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87316d-c6fd-4460-be39-a6453d9df952 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:01.704005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae31a2-fcfc-42dc-b3df-a1cede8c2c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:01.704811 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae31a2-fcfc-42dc-b3df-a1cede8c2c2e admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:01.704949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9d87316d-c6fd-4460-be39-a6453d9df952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:01.705112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae31a2-fcfc-42dc-b3df-a1cede8c2c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:01.706169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae31a2-fcfc-42dc-b3df-a1cede8c2c2e admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:01.707410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae31a2-fcfc-42dc-b3df-a1cede8c2c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:01.709699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae31a2-fcfc-42dc-b3df-a1cede8c2c2e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:01.726358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87316d-c6fd-4460-be39-a6453d9df952 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:01.733616 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:01.735733 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:01.736184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:01.736652 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] PATH_INFO: `/v3/projects/95303cdcec0e41bd80e7c8dda2fa72bd` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:01.738019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=95303cdcec0e41bd80e7c8dda2fa72bd)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:01.740151 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1029/2042] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:01 2022] POST /identity/v3/users => generated 296 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:01.740486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:01.741101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae31a2-fcfc-42dc-b3df-a1cede8c2c2e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:01.742698 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-02ae31a2-fcfc-42dc-b3df-a1cede8c2c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:01.793169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95303cdcec0e41bd80e7c8dda2fa72bd', 'request_id': 'req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:01.801806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95303cdcec0e41bd80e7c8dda2fa72bd', 'request_id': 'req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:01.811975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95303cdcec0e41bd80e7c8dda2fa72bd', 'request_id': 'req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:01.814026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae31a2-fcfc-42dc-b3df-a1cede8c2c2e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:01.823568 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] The token cache is being invalidate because project 95303cdcec0e41bd80e7c8dda2fa72bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:01.823859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:01.824529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:01.826172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1014/2043] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:01 2022] DELETE /identity/v3/projects/95303cdcec0e41bd80e7c8dda2fa72bd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:01.826948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:01.828287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:01.868884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7268ba2-dfa0-49e2-9fd6-dc626cfb774e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:01.869715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7268ba2-dfa0-49e2-9fd6-dc626cfb774e service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:01.870092 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7268ba2-dfa0-49e2-9fd6-dc626cfb774e service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:01.870441 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7268ba2-dfa0-49e2-9fd6-dc626cfb774e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:01.873491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f7268ba2-dfa0-49e2-9fd6-dc626cfb774e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:01.901792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e4e6-0397-4d1c-8528-9e1af59dd90f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:01.918771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c91a2-4efd-489c-ba30-d6eb4e8c78cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:01.918771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c91a2-4efd-489c-ba30-d6eb4e8c78cc admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:01.918771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c91a2-4efd-489c-ba30-d6eb4e8c78cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:01.918771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c91a2-4efd-489c-ba30-d6eb4e8c78cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:01.919086 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c91a2-4efd-489c-ba30-d6eb4e8c78cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:01.919086 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c91a2-4efd-489c-ba30-d6eb4e8c78cc admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:01.933796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1015/2044] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:01.935654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a03aa0-8f44-4171-ad28-29231da880c1 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:01.935969 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a03aa0-8f44-4171-ad28-29231da880c1 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:01.936352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a03aa0-8f44-4171-ad28-29231da880c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:01.953450 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7268ba2-dfa0-49e2-9fd6-dc626cfb774e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:01.956082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7268ba2-dfa0-49e2-9fd6-dc626cfb774e service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:01.969067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1030/2045] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:01.969896 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7268ba2-dfa0-49e2-9fd6-dc626cfb774e service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:01.976809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-06a03aa0-8f44-4171-ad28-29231da880c1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:01.981458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-06a03aa0-8f44-4171-ad28-29231da880c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:01.990574 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7268ba2-dfa0-49e2-9fd6-dc626cfb774e service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:01.995488 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1016/2046] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:01.996246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6970-edfb-431d-b6ea-89b624f6d5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:01.997076 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6970-edfb-431d-b6ea-89b624f6d5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:01.997356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6970-edfb-431d-b6ea-89b624f6d5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:01.997631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6970-edfb-431d-b6ea-89b624f6d5d2 admin admin] PATH_INFO: `/v3/projects/de121bc71b39496bb37341ac27a0f072/users/976bcfd4d6ff46cc8c4655e8a55837af/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.005443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724705c-93db-48df-9efe-7a7fb404a3ee None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.005743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724705c-93db-48df-9efe-7a7fb404a3ee None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.006052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724705c-93db-48df-9efe-7a7fb404a3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.031710 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db6970-edfb-431d-b6ea-89b624f6d5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de121bc71b39496bb37341ac27a0f072, user_id=976bcfd4d6ff46cc8c4655e8a55837af, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:02.034387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-4724705c-93db-48df-9efe-7a7fb404a3ee None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:02.035870 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4724705c-93db-48df-9efe-7a7fb404a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:02.048583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1017/2047] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:02.049558 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724705c-93db-48df-9efe-7a7fb404a3ee None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:02.050985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4724705c-93db-48df-9efe-7a7fb404a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:02.051307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db6970-edfb-431d-b6ea-89b624f6d5d2 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:02.066017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724705c-93db-48df-9efe-7a7fb404a3ee None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:02.069819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1031/2048] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:01 2022] PUT /identity/v3/projects/de121bc71b39496bb37341ac27a0f072/users/976bcfd4d6ff46cc8c4655e8a55837af/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:02.073419 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6970-edfb-431d-b6ea-89b624f6d5d2 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:02.129831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:02.130703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.130986 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.131298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] PATH_INFO: `/v3/users/3230ae74e3ca4075955158ef9ae382c7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.138007 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3230ae74e3ca4075955158ef9ae382c7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:02.140379 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6970-edfb-431d-b6ea-89b624f6d5d2 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:02.140528 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:02.148493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade46c8-94af-485c-86d1-c8bb1e936f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:02.149145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade46c8-94af-485c-86d1-c8bb1e936f41 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.149605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade46c8-94af-485c-86d1-c8bb1e936f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.149913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade46c8-94af-485c-86d1-c8bb1e936f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.150671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade46c8-94af-485c-86d1-c8bb1e936f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:02.150975 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade46c8-94af-485c-86d1-c8bb1e936f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:02.152919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade46c8-94af-485c-86d1-c8bb1e936f41 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:02.168785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1032/2049] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:02.168785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade46c8-94af-485c-86d1-c8bb1e936f41 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:02.179006 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade46c8-94af-485c-86d1-c8bb1e936f41 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:02.184267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7951f6-0732-4ae3-bee3-053e0c9717ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:02.184926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7951f6-0732-4ae3-bee3-053e0c9717ee admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.185214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7951f6-0732-4ae3-bee3-053e0c9717ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.185492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7951f6-0732-4ae3-bee3-053e0c9717ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.186224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7951f6-0732-4ae3-bee3-053e0c9717ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:02.187860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7951f6-0732-4ae3-bee3-053e0c9717ee admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:02.197935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3230ae74e3ca4075955158ef9ae382c7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:02.198745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1033/2050] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:02.198745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7951f6-0732-4ae3-bee3-053e0c9717ee admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:02.206097 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3230ae74e3ca4075955158ef9ae382c7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:02.210442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7951f6-0732-4ae3-bee3-053e0c9717ee admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:02.213970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3230ae74e3ca4075955158ef9ae382c7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:02.214746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3230ae74e3ca4075955158ef9ae382c7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:02.215452 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3230ae74e3ca4075955158ef9ae382c7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:02.216454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba63d5-6fab-414f-9542-f0e6043ca665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:02.217118 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba63d5-6fab-414f-9542-f0e6043ca665 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.217731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba63d5-6fab-414f-9542-f0e6043ca665 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.217731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba63d5-6fab-414f-9542-f0e6043ca665 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.218346 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba63d5-6fab-414f-9542-f0e6043ca665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:02.220292 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba63d5-6fab-414f-9542-f0e6043ca665 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:02.235388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1018/2051] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:02 2022] DELETE /identity/v3/users/3230ae74e3ca4075955158ef9ae382c7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:02.235388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:02.237284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:02.252191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1034/2052] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:02 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:02.254550 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab5d5f-d124-4087-9276-0aa33333636b None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.254932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab5d5f-d124-4087-9276-0aa33333636b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.255240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab5d5f-d124-4087-9276-0aa33333636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.277577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d7ab5d5f-d124-4087-9276-0aa33333636b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:02.278967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d7ab5d5f-d124-4087-9276-0aa33333636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:02.325253 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a294ffe-4747-4246-92c7-a6e4757dcffb admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:02.356317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1035/2053] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:02.360069 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab5d5f-d124-4087-9276-0aa33333636b None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:02.361376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d7ab5d5f-d124-4087-9276-0aa33333636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:02.374100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab5d5f-d124-4087-9276-0aa33333636b None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:02.380695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b5450-1778-4f17-946a-58cb7046fa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:02.381389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b5450-1778-4f17-946a-58cb7046fa8c admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.381671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b5450-1778-4f17-946a-58cb7046fa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.381957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b5450-1778-4f17-946a-58cb7046fa8c admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.382669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b5450-1778-4f17-946a-58cb7046fa8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:02.384820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b5450-1778-4f17-946a-58cb7046fa8c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:02.393639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e429c2-5d06-4cb8-83b6-8bd0dbd3f9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:02.394535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e429c2-5d06-4cb8-83b6-8bd0dbd3f9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.395026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e429c2-5d06-4cb8-83b6-8bd0dbd3f9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.395143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e429c2-5d06-4cb8-83b6-8bd0dbd3f9eb admin admin] PATH_INFO: `/v3/projects/de121bc71b39496bb37341ac27a0f072/users/976bcfd4d6ff46cc8c4655e8a55837af/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.397284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e429c2-5d06-4cb8-83b6-8bd0dbd3f9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=de121bc71b39496bb37341ac27a0f072, user_id=976bcfd4d6ff46cc8c4655e8a55837af, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:02.399978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e429c2-5d06-4cb8-83b6-8bd0dbd3f9eb admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:02.410804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1019/2054] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:02 2022] PUT /identity/v3/projects/de121bc71b39496bb37341ac27a0f072/users/976bcfd4d6ff46cc8c4655e8a55837af/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:02.413876 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1036/2055] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:02 2022] POST /identity/v3/users => generated 300 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:02.414742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b5450-1778-4f17-946a-58cb7046fa8c admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:02.419831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e429c2-5d06-4cb8-83b6-8bd0dbd3f9eb admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:02.423260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-08e429c2-5d06-4cb8-83b6-8bd0dbd3f9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:02.425708 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b5450-1778-4f17-946a-58cb7046fa8c admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:02.500607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e429c2-5d06-4cb8-83b6-8bd0dbd3f9eb admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:02.505678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db689f-87b0-41bf-88c4-e03e36bc2db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:02.506390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db689f-87b0-41bf-88c4-e03e36bc2db2 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.506663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db689f-87b0-41bf-88c4-e03e36bc2db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.506943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db689f-87b0-41bf-88c4-e03e36bc2db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.507719 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db689f-87b0-41bf-88c4-e03e36bc2db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:02.509237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5fb8e-644c-4acb-ae61-541667a74b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:02.509748 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db689f-87b0-41bf-88c4-e03e36bc2db2 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:02.509993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5fb8e-644c-4acb-ae61-541667a74b67 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.514637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5fb8e-644c-4acb-ae61-541667a74b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.514932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5fb8e-644c-4acb-ae61-541667a74b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.535006 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1037/2056] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:02.535006 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdeb5f-6e1b-4e48-97bf-bb07cd827b28 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.535428 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdeb5f-6e1b-4e48-97bf-bb07cd827b28 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.535656 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdeb5f-6e1b-4e48-97bf-bb07cd827b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.546880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5fb8e-644c-4acb-ae61-541667a74b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:02.546880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5fb8e-644c-4acb-ae61-541667a74b67 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:02.561638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1020/2057] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:02.562798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5fb8e-644c-4acb-ae61-541667a74b67 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:02.568565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-f0cdeb5f-6e1b-4e48-97bf-bb07cd827b28 None None] MFA Rules not processed for user `976bcfd4d6ff46cc8c4655e8a55837af`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:02.569997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f0cdeb5f-6e1b-4e48-97bf-bb07cd827b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:02.576191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5fb8e-644c-4acb-ae61-541667a74b67 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:02.584863 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d778959-f066-4c06-9096-ab1fb6f7d250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:02.585840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778959-f066-4c06-9096-ab1fb6f7d250 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.586324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778959-f066-4c06-9096-ab1fb6f7d250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.586949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778959-f066-4c06-9096-ab1fb6f7d250 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.587994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d778959-f066-4c06-9096-ab1fb6f7d250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:02.590876 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d778959-f066-4c06-9096-ab1fb6f7d250 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:02.609143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1021/2058] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:02.613487 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d778959-f066-4c06-9096-ab1fb6f7d250 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:02.637652 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d778959-f066-4c06-9096-ab1fb6f7d250 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:02.649180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a45e08-8804-4456-9bf5-e9e2f079ed82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:02.650074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45e08-8804-4456-9bf5-e9e2f079ed82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.650359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45e08-8804-4456-9bf5-e9e2f079ed82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.650633 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45e08-8804-4456-9bf5-e9e2f079ed82 admin admin] PATH_INFO: `/v3/projects/deb3ede7ed904a979cfe5d5824aebf43/users/67df6aef28de4dd89a3987c03ef80555/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.677682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a45e08-8804-4456-9bf5-e9e2f079ed82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb3ede7ed904a979cfe5d5824aebf43, user_id=67df6aef28de4dd89a3987c03ef80555, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:02.680550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a45e08-8804-4456-9bf5-e9e2f079ed82 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:02.685392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1038/2059] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:02.698894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdeb5f-6e1b-4e48-97bf-bb07cd827b28 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:02.701897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f0cdeb5f-6e1b-4e48-97bf-bb07cd827b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:02.709563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1022/2060] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:02 2022] PUT /identity/v3/projects/deb3ede7ed904a979cfe5d5824aebf43/users/67df6aef28de4dd89a3987c03ef80555/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:02.720808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1876f-5404-41cd-8265-078b55c4bcdb None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.721249 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1876f-5404-41cd-8265-078b55c4bcdb None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.721629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1876f-5404-41cd-8265-078b55c4bcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:02.758563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-69f1876f-5404-41cd-8265-078b55c4bcdb None None] MFA Rules not processed for user `67df6aef28de4dd89a3987c03ef80555`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:02.762204 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-69f1876f-5404-41cd-8265-078b55c4bcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:02.862757 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdeb5f-6e1b-4e48-97bf-bb07cd827b28 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:02.927403 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1023/2061] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:02.931425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1876f-5404-41cd-8265-078b55c4bcdb None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:02.940657 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef75f1-7167-44f2-9d04-2b297fcb18e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:02.941137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef75f1-7167-44f2-9d04-2b297fcb18e8 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:02.941474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef75f1-7167-44f2-9d04-2b297fcb18e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:02.941749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef75f1-7167-44f2-9d04-2b297fcb18e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:03.020189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef75f1-7167-44f2-9d04-2b297fcb18e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:03.021717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef75f1-7167-44f2-9d04-2b297fcb18e8 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:03.028134 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1876f-5404-41cd-8265-078b55c4bcdb None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:03.033046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1039/2062] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:03.037712 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef75f1-7167-44f2-9d04-2b297fcb18e8 service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:03.040832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ddef75f1-7167-44f2-9d04-2b297fcb18e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:03.052378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3bc2d-7ba2-4c4b-969f-13fa0394113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:03.053148 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3bc2d-7ba2-4c4b-969f-13fa0394113d admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:03.056958 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3bc2d-7ba2-4c4b-969f-13fa0394113d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:03.057316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3bc2d-7ba2-4c4b-969f-13fa0394113d admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:03.058462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3bc2d-7ba2-4c4b-969f-13fa0394113d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:03.073034 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef75f1-7167-44f2-9d04-2b297fcb18e8 service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:03.080771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3bc2d-7ba2-4c4b-969f-13fa0394113d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:03.080916 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:03.082472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:03.082815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:03.083102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] PATH_INFO: `/v3/projects/1309fafd0ab84b8f993c8cecdf4ac2d0` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:03.084549 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1309fafd0ab84b8f993c8cecdf4ac2d0)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:03.087693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:03.163792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1024/2063] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:02 2022] POST /identity/v3/projects => generated 401 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:03.165730 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3bc2d-7ba2-4c4b-969f-13fa0394113d admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:03.187917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1309fafd0ab84b8f993c8cecdf4ac2d0', 'request_id': 'req-6397ce08-82a2-4810-8bc8-6cd59754563a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:03.197335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1309fafd0ab84b8f993c8cecdf4ac2d0', 'request_id': 'req-6397ce08-82a2-4810-8bc8-6cd59754563a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:03.209623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1309fafd0ab84b8f993c8cecdf4ac2d0', 'request_id': 'req-6397ce08-82a2-4810-8bc8-6cd59754563a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:03.239886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] The token cache is being invalidate because project 1309fafd0ab84b8f993c8cecdf4ac2d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:03.240168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:03.240838 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:03.251278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1040/2064] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:03 2022] DELETE /identity/v3/projects/1309fafd0ab84b8f993c8cecdf4ac2d0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:03.251278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:03.261127 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:03.279536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3bc2d-7ba2-4c4b-969f-13fa0394113d admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:03.386397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e48d07-f8ab-497d-9a70-b4c128e459df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:03.387182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e48d07-f8ab-497d-9a70-b4c128e459df service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:03.387975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e48d07-f8ab-497d-9a70-b4c128e459df service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:03.388258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e48d07-f8ab-497d-9a70-b4c128e459df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:03.393132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-95e48d07-f8ab-497d-9a70-b4c128e459df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:03.463961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397ce08-82a2-4810-8bc8-6cd59754563a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:03.472301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136399f-0132-4290-b128-f5b2b125e135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:03.475362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136399f-0132-4290-b128-f5b2b125e135 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:03.475701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136399f-0132-4290-b128-f5b2b125e135 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:03.475971 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136399f-0132-4290-b128-f5b2b125e135 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:03.478677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136399f-0132-4290-b128-f5b2b125e135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:03.486286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136399f-0132-4290-b128-f5b2b125e135 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:03.507505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e48d07-f8ab-497d-9a70-b4c128e459df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:03.509801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e48d07-f8ab-497d-9a70-b4c128e459df service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:03.528460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1025/2065] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:03.537464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1041/2066] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:03 2022] POST /identity/v3/users => generated 307 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:03.537626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e48d07-f8ab-497d-9a70-b4c128e459df service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:03.550047 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e48d07-f8ab-497d-9a70-b4c128e459df service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:03.558040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933189a-6ed0-475a-84ba-7d95f76d903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:03.558806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933189a-6ed0-475a-84ba-7d95f76d903a admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:03.559163 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933189a-6ed0-475a-84ba-7d95f76d903a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:03.559531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933189a-6ed0-475a-84ba-7d95f76d903a admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:03.560440 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933189a-6ed0-475a-84ba-7d95f76d903a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:03.566692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933189a-6ed0-475a-84ba-7d95f76d903a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:03.578293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1026/2067] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:03.582476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136399f-0132-4290-b128-f5b2b125e135 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:03.596584 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136399f-0132-4290-b128-f5b2b125e135 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:03.608821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc92cfa-af32-4dd4-9aad-2cba976808fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:03.609958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc92cfa-af32-4dd4-9aad-2cba976808fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:03.610439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc92cfa-af32-4dd4-9aad-2cba976808fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:03.611005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc92cfa-af32-4dd4-9aad-2cba976808fb admin admin] PATH_INFO: `/v3/projects/b1d93cc868f34e119e061a0e31f8485b/users/88896fc899074a3da814eb8803133e9f/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:03.651129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc92cfa-af32-4dd4-9aad-2cba976808fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d93cc868f34e119e061a0e31f8485b, user_id=88896fc899074a3da814eb8803133e9f, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:03.654801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc92cfa-af32-4dd4-9aad-2cba976808fb admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:03.695869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1042/2068] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:03 2022] PUT /identity/v3/projects/b1d93cc868f34e119e061a0e31f8485b/users/88896fc899074a3da814eb8803133e9f/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:03.699996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933189a-6ed0-475a-84ba-7d95f76d903a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:03.715135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933189a-6ed0-475a-84ba-7d95f76d903a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:03.800131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bfd25-f16b-4250-8c9c-3ba79d5468ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:03.800797 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bfd25-f16b-4250-8c9c-3ba79d5468ff admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:03.801073 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bfd25-f16b-4250-8c9c-3ba79d5468ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:03.801373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bfd25-f16b-4250-8c9c-3ba79d5468ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:03.802073 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bfd25-f16b-4250-8c9c-3ba79d5468ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:03.803717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bfd25-f16b-4250-8c9c-3ba79d5468ff admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:03.819065 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1027/2069] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:03.820514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc92cfa-af32-4dd4-9aad-2cba976808fb admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:03.847952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc92cfa-af32-4dd4-9aad-2cba976808fb admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:03.853538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e60de-e126-4047-ad80-5f17af1f4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:03.854497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e60de-e126-4047-ad80-5f17af1f4666 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:03.854783 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e60de-e126-4047-ad80-5f17af1f4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:03.855052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e60de-e126-4047-ad80-5f17af1f4666 admin admin] PATH_INFO: `/v3/projects/b1d93cc868f34e119e061a0e31f8485b/users/88896fc899074a3da814eb8803133e9f/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:03.857153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e60de-e126-4047-ad80-5f17af1f4666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d93cc868f34e119e061a0e31f8485b, user_id=88896fc899074a3da814eb8803133e9f, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:03.860090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e60de-e126-4047-ad80-5f17af1f4666 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:03.879070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1043/2070] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:03 2022] PUT /identity/v3/projects/b1d93cc868f34e119e061a0e31f8485b/users/88896fc899074a3da814eb8803133e9f/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:03.892054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3402a-6076-4c36-92c1-3917b92af995 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:03.892500 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3402a-6076-4c36-92c1-3917b92af995 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:03.893056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3402a-6076-4c36-92c1-3917b92af995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:03.952752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-d9b3402a-6076-4c36-92c1-3917b92af995 None None] MFA Rules not processed for user `88896fc899074a3da814eb8803133e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:03.952752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d9b3402a-6076-4c36-92c1-3917b92af995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:04.148291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1028/2071] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:04.185829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e60de-e126-4047-ad80-5f17af1f4666 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:04.190002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-204e60de-e126-4047-ad80-5f17af1f4666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:04.267326 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e60de-e126-4047-ad80-5f17af1f4666 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:04.273970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552137e-c43d-4a0d-9419-629cc7be093d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:04.274659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552137e-c43d-4a0d-9419-629cc7be093d service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:04.274947 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552137e-c43d-4a0d-9419-629cc7be093d service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:04.275255 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552137e-c43d-4a0d-9419-629cc7be093d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:04.286260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552137e-c43d-4a0d-9419-629cc7be093d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:04.287762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552137e-c43d-4a0d-9419-629cc7be093d service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:04.298785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1044/2072] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:04 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:04.428388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3402a-6076-4c36-92c1-3917b92af995 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:04.438084 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3402a-6076-4c36-92c1-3917b92af995 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:04.441952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3706ec0-ac55-49cd-bf4d-27413fa2bb2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:04.442592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3706ec0-ac55-49cd-bf4d-27413fa2bb2b service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:04.442873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3706ec0-ac55-49cd-bf4d-27413fa2bb2b service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:04.443147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3706ec0-ac55-49cd-bf4d-27413fa2bb2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:04.445345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f3706ec0-ac55-49cd-bf4d-27413fa2bb2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:04.514250 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3706ec0-ac55-49cd-bf4d-27413fa2bb2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:04.515778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3706ec0-ac55-49cd-bf4d-27413fa2bb2b service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:04.525890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1029/2073] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:05.292919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552137e-c43d-4a0d-9419-629cc7be093d service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:05.296430 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c552137e-c43d-4a0d-9419-629cc7be093d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:05.390375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552137e-c43d-4a0d-9419-629cc7be093d service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:05.397226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:05.398377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:05.399089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:05.399612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] PATH_INFO: `/v3/users/f212d979070649f5b28d54d6b4fdfff2` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:05.401109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f212d979070649f5b28d54d6b4fdfff2)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:05.403705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:05.495465 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f212d979070649f5b28d54d6b4fdfff2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:05.512067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f212d979070649f5b28d54d6b4fdfff2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:05.512892 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f212d979070649f5b28d54d6b4fdfff2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:05.524062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f212d979070649f5b28d54d6b4fdfff2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:05.541623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f212d979070649f5b28d54d6b4fdfff2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:05.556835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1045/2074] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:05 2022] DELETE /identity/v3/users/f212d979070649f5b28d54d6b4fdfff2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:05.852569 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3706ec0-ac55-49cd-bf4d-27413fa2bb2b service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:05.864553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3706ec0-ac55-49cd-bf4d-27413fa2bb2b service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:05.943804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:05.962956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:05.963313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:05.963541 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] PATH_INFO: `/v3/projects/62a7e03a10cc4e4d84ff86529cee5972` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:05.964925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a7e03a10cc4e4d84ff86529cee5972)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:05.966854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:06.020383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a7e03a10cc4e4d84ff86529cee5972', 'request_id': 'req-028c623b-9fcb-4e7d-b91e-20b40a546757'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.026877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a7e03a10cc4e4d84ff86529cee5972', 'request_id': 'req-028c623b-9fcb-4e7d-b91e-20b40a546757'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.035459 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a7e03a10cc4e4d84ff86529cee5972', 'request_id': 'req-028c623b-9fcb-4e7d-b91e-20b40a546757'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.047356 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] The token cache is being invalidate because project 62a7e03a10cc4e4d84ff86529cee5972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:06.047895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.048650 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.050896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1030/2075] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:05 2022] DELETE /identity/v3/projects/62a7e03a10cc4e4d84ff86529cee5972 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:06.054926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:06.056467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:06.073822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e1567-5cd4-43c3-ae1f-40fedc1297fc admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:06.143486 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9e7a5-7555-4a80-ac31-444d739ba30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:06.144782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e7a5-7555-4a80-ac31-444d739ba30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:06.145141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e7a5-7555-4a80-ac31-444d739ba30a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:06.145648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9e7a5-7555-4a80-ac31-444d739ba30a admin admin] PATH_INFO: `/v3/users/cf8e5c20616a4bf490dc10a3d2be51d6` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:06.147078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9e7a5-7555-4a80-ac31-444d739ba30a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8e5c20616a4bf490dc10a3d2be51d6)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:06.149154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9e7a5-7555-4a80-ac31-444d739ba30a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:06.209133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-90f9e7a5-7555-4a80-ac31-444d739ba30a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8e5c20616a4bf490dc10a3d2be51d6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.221433 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-90f9e7a5-7555-4a80-ac31-444d739ba30a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8e5c20616a4bf490dc10a3d2be51d6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.222221 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-90f9e7a5-7555-4a80-ac31-444d739ba30a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8e5c20616a4bf490dc10a3d2be51d6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.231321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-90f9e7a5-7555-4a80-ac31-444d739ba30a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8e5c20616a4bf490dc10a3d2be51d6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.255179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-90f9e7a5-7555-4a80-ac31-444d739ba30a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8e5c20616a4bf490dc10a3d2be51d6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.261570 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1046/2076] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:06 2022] DELETE /identity/v3/users/cf8e5c20616a4bf490dc10a3d2be51d6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:06.442371 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:06.443841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:06.456259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c623b-9fcb-4e7d-b91e-20b40a546757 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:06.521910 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca685e9-3b08-4032-889f-4209734ce5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:06.522808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca685e9-3b08-4032-889f-4209734ce5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:06.523091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca685e9-3b08-4032-889f-4209734ce5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:06.523448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca685e9-3b08-4032-889f-4209734ce5e7 admin admin] PATH_INFO: `/v3/projects/882b30ebd4c84048a5f56870249eb35b` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:06.524933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca685e9-3b08-4032-889f-4209734ce5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882b30ebd4c84048a5f56870249eb35b)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:06.526918 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca685e9-3b08-4032-889f-4209734ce5e7 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:06.571727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8ca685e9-3b08-4032-889f-4209734ce5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882b30ebd4c84048a5f56870249eb35b', 'request_id': 'req-8ca685e9-3b08-4032-889f-4209734ce5e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.577553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8ca685e9-3b08-4032-889f-4209734ce5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882b30ebd4c84048a5f56870249eb35b', 'request_id': 'req-8ca685e9-3b08-4032-889f-4209734ce5e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.584577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8ca685e9-3b08-4032-889f-4209734ce5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882b30ebd4c84048a5f56870249eb35b', 'request_id': 'req-8ca685e9-3b08-4032-889f-4209734ce5e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.594189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8ca685e9-3b08-4032-889f-4209734ce5e7 admin admin] The token cache is being invalidate because project 882b30ebd4c84048a5f56870249eb35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:06.594469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8ca685e9-3b08-4032-889f-4209734ce5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.595078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8ca685e9-3b08-4032-889f-4209734ce5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:06.597163 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1031/2077] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:06 2022] DELETE /identity/v3/projects/882b30ebd4c84048a5f56870249eb35b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:06.602114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1681b70-e3d4-445a-8450-841763a8e501 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:06.602625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1681b70-e3d4-445a-8450-841763a8e501 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:06.602808 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1681b70-e3d4-445a-8450-841763a8e501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:06.622530 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-c1681b70-e3d4-445a-8450-841763a8e501 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:06.623740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c1681b70-e3d4-445a-8450-841763a8e501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:06.678937 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1047/2078] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:06.686631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcdb4f-6740-426f-9c7f-00c96bb5b293 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:06.686916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcdb4f-6740-426f-9c7f-00c96bb5b293 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:06.687190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcdb4f-6740-426f-9c7f-00c96bb5b293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:06.704921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-5ddcdb4f-6740-426f-9c7f-00c96bb5b293 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:06.706616 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-5ddcdb4f-6740-426f-9c7f-00c96bb5b293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:06.714261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1032/2079] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:06.718173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1681b70-e3d4-445a-8450-841763a8e501 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:06.728401 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1681b70-e3d4-445a-8450-841763a8e501 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:06.732932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33618fc-b3b1-49ea-99bf-bfddf034ec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:06.733579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33618fc-b3b1-49ea-99bf-bfddf034ec2e admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:06.733859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33618fc-b3b1-49ea-99bf-bfddf034ec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:06.734133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33618fc-b3b1-49ea-99bf-bfddf034ec2e admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:06.734856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33618fc-b3b1-49ea-99bf-bfddf034ec2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:06.735156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33618fc-b3b1-49ea-99bf-bfddf034ec2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:06.736775 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33618fc-b3b1-49ea-99bf-bfddf034ec2e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:06.748060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1048/2080] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:06.752148 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcdb4f-6740-426f-9c7f-00c96bb5b293 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:06.761107 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcdb4f-6740-426f-9c7f-00c96bb5b293 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:06.765753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4816ee-65e8-4bda-8c5b-c47aa3fc4343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:06.766384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4816ee-65e8-4bda-8c5b-c47aa3fc4343 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:06.766661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4816ee-65e8-4bda-8c5b-c47aa3fc4343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:06.766933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4816ee-65e8-4bda-8c5b-c47aa3fc4343 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:06.767661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4816ee-65e8-4bda-8c5b-c47aa3fc4343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:06.770150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4816ee-65e8-4bda-8c5b-c47aa3fc4343 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:06.796121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1033/2081] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:06 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:06.800159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33618fc-b3b1-49ea-99bf-bfddf034ec2e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:06.810713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33618fc-b3b1-49ea-99bf-bfddf034ec2e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:06.865539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baebbcb-6a0b-4bae-9ce4-3ef7c1ecf1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:06.866205 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baebbcb-6a0b-4bae-9ce4-3ef7c1ecf1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:06.866482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baebbcb-6a0b-4bae-9ce4-3ef7c1ecf1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:06.866749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baebbcb-6a0b-4bae-9ce4-3ef7c1ecf1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:06.867472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baebbcb-6a0b-4bae-9ce4-3ef7c1ecf1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:06.869356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baebbcb-6a0b-4bae-9ce4-3ef7c1ecf1c0 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:06.889850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1049/2082] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:06 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:06.893522 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4816ee-65e8-4bda-8c5b-c47aa3fc4343 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:06.904037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4816ee-65e8-4bda-8c5b-c47aa3fc4343 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:06.909228 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a7f57-e531-48b4-bcf8-67e4f8366bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:06.909886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a7f57-e531-48b4-bcf8-67e4f8366bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:06.910170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a7f57-e531-48b4-bcf8-67e4f8366bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:06.910449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a7f57-e531-48b4-bcf8-67e4f8366bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:06.911175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a7f57-e531-48b4-bcf8-67e4f8366bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:06.912789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a7f57-e531-48b4-bcf8-67e4f8366bf0 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:06.924658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1034/2083] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:06.932919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baebbcb-6a0b-4bae-9ce4-3ef7c1ecf1c0 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:06.942992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baebbcb-6a0b-4bae-9ce4-3ef7c1ecf1c0 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:06.947502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169d744-39af-473d-ac38-5c8378bfb99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:06.948146 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169d744-39af-473d-ac38-5c8378bfb99a admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:06.948428 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169d744-39af-473d-ac38-5c8378bfb99a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:06.948707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169d744-39af-473d-ac38-5c8378bfb99a admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:06.949429 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169d744-39af-473d-ac38-5c8378bfb99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:06.950988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169d744-39af-473d-ac38-5c8378bfb99a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:06.961248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1050/2084] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:06.967260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a7f57-e531-48b4-bcf8-67e4f8366bf0 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:06.979479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a7f57-e531-48b4-bcf8-67e4f8366bf0 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:06.984123 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd4b62-d506-4084-b82d-31042559c9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:06.984986 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd4b62-d506-4084-b82d-31042559c9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:06.985261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd4b62-d506-4084-b82d-31042559c9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:06.985531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd4b62-d506-4084-b82d-31042559c9d8 admin admin] PATH_INFO: `/v3/projects/5d3ac77d31f14504a1b07bf332188891/users/fdbf30feb6c047ba84f8eb58c2cd7ca4/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:06.999886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd4b62-d506-4084-b82d-31042559c9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3ac77d31f14504a1b07bf332188891, user_id=fdbf30feb6c047ba84f8eb58c2cd7ca4, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:07.002435 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd4b62-d506-4084-b82d-31042559c9d8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:07.014911 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1035/2085] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:06 2022] PUT /identity/v3/projects/5d3ac77d31f14504a1b07bf332188891/users/fdbf30feb6c047ba84f8eb58c2cd7ca4/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:07.026376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcf392-1e36-4334-a86c-6843ddf4e0cc None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:07.026668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcf392-1e36-4334-a86c-6843ddf4e0cc None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:07.026941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcf392-1e36-4334-a86c-6843ddf4e0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:07.052762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-89fcf392-1e36-4334-a86c-6843ddf4e0cc None None] MFA Rules not processed for user `fdbf30feb6c047ba84f8eb58c2cd7ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:07.053979 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-89fcf392-1e36-4334-a86c-6843ddf4e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:07.120165 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1051/2086] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:07.132434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd4b62-d506-4084-b82d-31042559c9d8 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:07.134167 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e7bd4b62-d506-4084-b82d-31042559c9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:07.199869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd4b62-d506-4084-b82d-31042559c9d8 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:07.204322 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddfc4c-c144-4a46-92c3-b24f9efac450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:07.204996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddfc4c-c144-4a46-92c3-b24f9efac450 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:07.205354 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddfc4c-c144-4a46-92c3-b24f9efac450 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:07.206132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddfc4c-c144-4a46-92c3-b24f9efac450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:07.214877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddfc4c-c144-4a46-92c3-b24f9efac450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:07.216329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddfc4c-c144-4a46-92c3-b24f9efac450 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:07.224911 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1036/2087] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:12.918309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcf392-1e36-4334-a86c-6843ddf4e0cc None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:12.979831 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcf392-1e36-4334-a86c-6843ddf4e0cc None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:12.984398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:12.985291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:12.985572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:12.985853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] PATH_INFO: `/v3/users/fdbf30feb6c047ba84f8eb58c2cd7ca4` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:12.987067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbf30feb6c047ba84f8eb58c2cd7ca4)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:12.989007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:13.035369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbf30feb6c047ba84f8eb58c2cd7ca4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.044518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbf30feb6c047ba84f8eb58c2cd7ca4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.045143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbf30feb6c047ba84f8eb58c2cd7ca4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.052951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbf30feb6c047ba84f8eb58c2cd7ca4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.064871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbf30feb6c047ba84f8eb58c2cd7ca4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.071843 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1052/2088] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:12 2022] DELETE /identity/v3/users/fdbf30feb6c047ba84f8eb58c2cd7ca4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:13.076245 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269032-b51b-4e1a-bb85-425d06fddf41 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:13.076703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269032-b51b-4e1a-bb85-425d06fddf41 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:13.076818 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269032-b51b-4e1a-bb85-425d06fddf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:13.094253 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-95269032-b51b-4e1a-bb85-425d06fddf41 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:13.095476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-95269032-b51b-4e1a-bb85-425d06fddf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:13.156862 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1037/2089] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:13.168041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:13.169885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:13.242085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94a53c-f17d-4f5e-aacd-e612bd64f98f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:13.246432 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e9e5d-6100-43ed-bf62-a00c7ea24dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:13.247117 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e9e5d-6100-43ed-bf62-a00c7ea24dea service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:13.247427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e9e5d-6100-43ed-bf62-a00c7ea24dea service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:13.247699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e9e5d-6100-43ed-bf62-a00c7ea24dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:13.263652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e9e5d-6100-43ed-bf62-a00c7ea24dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:13.265147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e9e5d-6100-43ed-bf62-a00c7ea24dea service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:13.285017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269032-b51b-4e1a-bb85-425d06fddf41 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:13.287378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-95269032-b51b-4e1a-bb85-425d06fddf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:13.298806 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1053/2090] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:13.302971 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269032-b51b-4e1a-bb85-425d06fddf41 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:13.308855 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:13.310400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:13.311105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:13.311645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] PATH_INFO: `/v3/users/69f29acdd72f47f3aa2eec79f42f68e7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:13.313346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f29acdd72f47f3aa2eec79f42f68e7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:13.317017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:13.405690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f29acdd72f47f3aa2eec79f42f68e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.415618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f29acdd72f47f3aa2eec79f42f68e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.428934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f29acdd72f47f3aa2eec79f42f68e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.429880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f29acdd72f47f3aa2eec79f42f68e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.431181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f29acdd72f47f3aa2eec79f42f68e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.460844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1038/2091] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:13 2022] DELETE /identity/v3/users/69f29acdd72f47f3aa2eec79f42f68e7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:13.466192 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25988d9d-9681-4c8a-91da-27ce74ad66dc None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:13.466525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25988d9d-9681-4c8a-91da-27ce74ad66dc None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:13.466823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25988d9d-9681-4c8a-91da-27ce74ad66dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:13.488173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-25988d9d-9681-4c8a-91da-27ce74ad66dc None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:13.489838 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-25988d9d-9681-4c8a-91da-27ce74ad66dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:13.553216 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1054/2092] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:13.562930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:13.564374 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:13.628931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2d751-a433-446d-8f86-9104a5920bac admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:13.633254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e83cba-5478-4f6d-83e3-47b521817fce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:13.634032 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83cba-5478-4f6d-83e3-47b521817fce service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:13.634440 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83cba-5478-4f6d-83e3-47b521817fce service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:13.634750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83cba-5478-4f6d-83e3-47b521817fce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:13.644595 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e83cba-5478-4f6d-83e3-47b521817fce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:13.646084 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e83cba-5478-4f6d-83e3-47b521817fce service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:13.656957 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1039/2093] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:13.676195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25988d9d-9681-4c8a-91da-27ce74ad66dc None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:13.677694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-25988d9d-9681-4c8a-91da-27ce74ad66dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:13.691249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25988d9d-9681-4c8a-91da-27ce74ad66dc None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:13.696575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb459f4-0a08-43d5-8954-0c6cde8449a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:13.697538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb459f4-0a08-43d5-8954-0c6cde8449a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:13.697905 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb459f4-0a08-43d5-8954-0c6cde8449a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:13.698219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb459f4-0a08-43d5-8954-0c6cde8449a9 admin admin] PATH_INFO: `/v3/projects/5d3ac77d31f14504a1b07bf332188891` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:13.699521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb459f4-0a08-43d5-8954-0c6cde8449a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3ac77d31f14504a1b07bf332188891)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:13.701493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb459f4-0a08-43d5-8954-0c6cde8449a9 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:13.761672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9cb459f4-0a08-43d5-8954-0c6cde8449a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3ac77d31f14504a1b07bf332188891', 'request_id': 'req-9cb459f4-0a08-43d5-8954-0c6cde8449a9'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.768155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9cb459f4-0a08-43d5-8954-0c6cde8449a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3ac77d31f14504a1b07bf332188891', 'request_id': 'req-9cb459f4-0a08-43d5-8954-0c6cde8449a9'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.778131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9cb459f4-0a08-43d5-8954-0c6cde8449a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3ac77d31f14504a1b07bf332188891', 'request_id': 'req-9cb459f4-0a08-43d5-8954-0c6cde8449a9'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.791647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9cb459f4-0a08-43d5-8954-0c6cde8449a9 admin admin] The token cache is being invalidate because project 5d3ac77d31f14504a1b07bf332188891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:13.791958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9cb459f4-0a08-43d5-8954-0c6cde8449a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.792589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9cb459f4-0a08-43d5-8954-0c6cde8449a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:13.795130 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1055/2094] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:13 2022] DELETE /identity/v3/projects/5d3ac77d31f14504a1b07bf332188891 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:13.800795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598ee3-7e39-48d2-9b31-12f66bc7d42b None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:13.801099 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598ee3-7e39-48d2-9b31-12f66bc7d42b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:13.801361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598ee3-7e39-48d2-9b31-12f66bc7d42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:13.821170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f4598ee3-7e39-48d2-9b31-12f66bc7d42b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:13.822437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f4598ee3-7e39-48d2-9b31-12f66bc7d42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:13.921835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1040/2095] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:13.930028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0ec1-b784-49aa-9dd7-3f2a6b77fd8c None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:13.930537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0ec1-b784-49aa-9dd7-3f2a6b77fd8c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:13.930646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0ec1-b784-49aa-9dd7-3f2a6b77fd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:13.955990 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-fa4b0ec1-b784-49aa-9dd7-3f2a6b77fd8c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:13.957218 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fa4b0ec1-b784-49aa-9dd7-3f2a6b77fd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:13.972341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1056/2096] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:13.976543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4598ee3-7e39-48d2-9b31-12f66bc7d42b None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:13.985224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b0ec1-b784-49aa-9dd7-3f2a6b77fd8c None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:13.992814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4598ee3-7e39-48d2-9b31-12f66bc7d42b None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:13.997359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fa4b0ec1-b784-49aa-9dd7-3f2a6b77fd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:14.012008 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c734f-f463-48ea-b491-ca95a3003d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:14.012802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c734f-f463-48ea-b491-ca95a3003d0a admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.013152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c734f-f463-48ea-b491-ca95a3003d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.013502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c734f-f463-48ea-b491-ca95a3003d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.014562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c734f-f463-48ea-b491-ca95a3003d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:14.015885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c734f-f463-48ea-b491-ca95a3003d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:14.021813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b0ec1-b784-49aa-9dd7-3f2a6b77fd8c None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:14.027573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c734f-f463-48ea-b491-ca95a3003d0a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:14.028822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:14.031839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.031839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.032165 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] PATH_INFO: `/v3/projects/9c6157bd4b424994b519cc99d96b3700` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.039374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6157bd4b424994b519cc99d96b3700)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:14.043383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:14.061744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1041/2097] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:14.061744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c734f-f463-48ea-b491-ca95a3003d0a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:14.063860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-628c734f-f463-48ea-b491-ca95a3003d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:14.083662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c734f-f463-48ea-b491-ca95a3003d0a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:14.088297 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:14.089181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.089487 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.089736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] PATH_INFO: `/v3/users/67df6aef28de4dd89a3987c03ef80555` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.091072 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=67df6aef28de4dd89a3987c03ef80555)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:14.093073 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:14.116423 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6157bd4b424994b519cc99d96b3700', 'request_id': 'req-93653d90-e563-46e5-86d5-9bf677e3f361'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.123522 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6157bd4b424994b519cc99d96b3700', 'request_id': 'req-93653d90-e563-46e5-86d5-9bf677e3f361'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.131611 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6157bd4b424994b519cc99d96b3700', 'request_id': 'req-93653d90-e563-46e5-86d5-9bf677e3f361'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.142568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] The token cache is being invalidate because project 9c6157bd4b424994b519cc99d96b3700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:14.142878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.143572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.145113 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1057/2098] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:13 2022] DELETE /identity/v3/projects/9c6157bd4b424994b519cc99d96b3700 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:14.145859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:14.146234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67df6aef28de4dd89a3987c03ef80555'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.147273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:14.155437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67df6aef28de4dd89a3987c03ef80555'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.164669 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67df6aef28de4dd89a3987c03ef80555'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.166078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67df6aef28de4dd89a3987c03ef80555'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.166923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67df6aef28de4dd89a3987c03ef80555'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.185770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1042/2099] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:14 2022] DELETE /identity/v3/users/67df6aef28de4dd89a3987c03ef80555 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:14.186604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:14.187978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:14.229330 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93653d90-e563-46e5-86d5-9bf677e3f361 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:14.258060 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85daa3dd-ceb1-4653-8edb-3b9688bb7d1a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:14.262746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:14.263653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.263932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.264203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] PATH_INFO: `/v3/users/201984a6fda04b4e909baebfc8a3304e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.265770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] RBAC: Authorizing `identity:delete_user(user_id=201984a6fda04b4e909baebfc8a3304e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:14.267745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:14.290680 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3839a04-b234-419d-bde6-153aa035a0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:14.291400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3839a04-b234-419d-bde6-153aa035a0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.291747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3839a04-b234-419d-bde6-153aa035a0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.292021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3839a04-b234-419d-bde6-153aa035a0b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.292687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3839a04-b234-419d-bde6-153aa035a0b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:14.296195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3839a04-b234-419d-bde6-153aa035a0b3 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:14.319722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201984a6fda04b4e909baebfc8a3304e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.327669 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201984a6fda04b4e909baebfc8a3304e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.336268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201984a6fda04b4e909baebfc8a3304e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.337012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201984a6fda04b4e909baebfc8a3304e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.337123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1058/2100] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:14 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:14.338000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201984a6fda04b4e909baebfc8a3304e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:14.341474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18b58d-ca5f-4619-b768-163aed5f22e5 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.341757 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18b58d-ca5f-4619-b768-163aed5f22e5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.342026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18b58d-ca5f-4619-b768-163aed5f22e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.358738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1043/2101] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:14 2022] DELETE /identity/v3/users/201984a6fda04b4e909baebfc8a3304e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:14.358738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:14.360090 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:14.366935 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-7b18b58d-ca5f-4619-b768-163aed5f22e5 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:14.368564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7b18b58d-ca5f-4619-b768-163aed5f22e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:14.447795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1059/2102] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:14.467743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18b58d-ca5f-4619-b768-163aed5f22e5 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:14.470038 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7b18b58d-ca5f-4619-b768-163aed5f22e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:14.490914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432c7cc-f0ba-4adf-8316-3414aa40674b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:14.504717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d57021-1ec1-4d96-ac8e-8ec85c11057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:14.505617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d57021-1ec1-4d96-ac8e-8ec85c11057d admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.507250 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d57021-1ec1-4d96-ac8e-8ec85c11057d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.508841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d57021-1ec1-4d96-ac8e-8ec85c11057d admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.510316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d57021-1ec1-4d96-ac8e-8ec85c11057d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:14.513770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d57021-1ec1-4d96-ac8e-8ec85c11057d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:14.589928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18b58d-ca5f-4619-b768-163aed5f22e5 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:14.600632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1044/2103] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:14 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:14.603677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1049345-17a6-4823-abd3-4fbffd85ad0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:14.604454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1049345-17a6-4823-abd3-4fbffd85ad0a service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.605557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d57021-1ec1-4d96-ac8e-8ec85c11057d admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:14.605901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1049345-17a6-4823-abd3-4fbffd85ad0a service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.606239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1049345-17a6-4823-abd3-4fbffd85ad0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.618678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d57021-1ec1-4d96-ac8e-8ec85c11057d admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:14.623896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9999356-5276-4ab2-bea2-5f8ee3b9b832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:14.624640 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999356-5276-4ab2-bea2-5f8ee3b9b832 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.624929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999356-5276-4ab2-bea2-5f8ee3b9b832 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.625537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999356-5276-4ab2-bea2-5f8ee3b9b832 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.626338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9999356-5276-4ab2-bea2-5f8ee3b9b832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:14.628618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9999356-5276-4ab2-bea2-5f8ee3b9b832 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:14.632091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1049345-17a6-4823-abd3-4fbffd85ad0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:14.636567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1049345-17a6-4823-abd3-4fbffd85ad0a service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:14.641838 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1045/2104] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:14.646518 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9999356-5276-4ab2-bea2-5f8ee3b9b832 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:14.664348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9999356-5276-4ab2-bea2-5f8ee3b9b832 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:14.665852 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1060/2105] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:14.670377 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbb9d1-6dfb-47d3-b4fa-eb5ffb9d620f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:14.671118 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbb9d1-6dfb-47d3-b4fa-eb5ffb9d620f admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.671542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbb9d1-6dfb-47d3-b4fa-eb5ffb9d620f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.671709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbb9d1-6dfb-47d3-b4fa-eb5ffb9d620f admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.672691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbb9d1-6dfb-47d3-b4fa-eb5ffb9d620f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:14.674339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbb9d1-6dfb-47d3-b4fa-eb5ffb9d620f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:14.689242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1046/2106] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:14.691369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1049345-17a6-4823-abd3-4fbffd85ad0a service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:14.709501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1049345-17a6-4823-abd3-4fbffd85ad0a service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:14.720596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa77a8b-34bf-4c22-9995-346517b172b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:14.721585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa77a8b-34bf-4c22-9995-346517b172b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.721843 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa77a8b-34bf-4c22-9995-346517b172b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.724230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa77a8b-34bf-4c22-9995-346517b172b9 admin admin] PATH_INFO: `/v3/projects/1311bbc69c83422998b5c0e5b92cd82c/users/2fd4f84237cd4959a00bf507bba06e78/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.761130 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa77a8b-34bf-4c22-9995-346517b172b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1311bbc69c83422998b5c0e5b92cd82c, user_id=2fd4f84237cd4959a00bf507bba06e78, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:14.761263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbb9d1-6dfb-47d3-b4fa-eb5ffb9d620f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:14.763496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d4cbb9d1-6dfb-47d3-b4fa-eb5ffb9d620f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:14.764282 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa77a8b-34bf-4c22-9995-346517b172b9 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:14.791512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbb9d1-6dfb-47d3-b4fa-eb5ffb9d620f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:14.800249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1061/2107] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:14 2022] PUT /identity/v3/projects/1311bbc69c83422998b5c0e5b92cd82c/users/2fd4f84237cd4959a00bf507bba06e78/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:14.812343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8847505-eaf7-4bab-99d1-7d30e2cc44ad None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.812995 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8847505-eaf7-4bab-99d1-7d30e2cc44ad None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.813453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8847505-eaf7-4bab-99d1-7d30e2cc44ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.891192 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b8847505-eaf7-4bab-99d1-7d30e2cc44ad None None] MFA Rules not processed for user `2fd4f84237cd4959a00bf507bba06e78`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:14.892868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b8847505-eaf7-4bab-99d1-7d30e2cc44ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:14.926687 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:14.927616 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:14.927892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:14.928213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] PATH_INFO: `/v3/projects/1b1a3a10c376413a81b57902682b4b31` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:14.937331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1a3a10c376413a81b57902682b4b31)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:14.940744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:14.993112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1062/2108] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:15.006619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8847505-eaf7-4bab-99d1-7d30e2cc44ad None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:15.008228 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b8847505-eaf7-4bab-99d1-7d30e2cc44ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:15.064078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1a3a10c376413a81b57902682b4b31', 'request_id': 'req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.071601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1a3a10c376413a81b57902682b4b31', 'request_id': 'req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.093713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1a3a10c376413a81b57902682b4b31', 'request_id': 'req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.098829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8847505-eaf7-4bab-99d1-7d30e2cc44ad None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:15.107413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] The token cache is being invalidate because project 1b1a3a10c376413a81b57902682b4b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:15.107708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.108372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.111611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1047/2109] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:14 2022] DELETE /identity/v3/projects/1b1a3a10c376413a81b57902682b4b31 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:15.114350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:15.117302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:15.167056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b90332-a22f-4b98-b676-b249395cfe03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:15.167853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90332-a22f-4b98-b676-b249395cfe03 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:15.168138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90332-a22f-4b98-b676-b249395cfe03 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:15.168447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b90332-a22f-4b98-b676-b249395cfe03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:15.170251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-47b90332-a22f-4b98-b676-b249395cfe03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:15.213108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95ce8a-d8b8-4fb2-a409-ddb688ab01b4 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:15.219239 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:15.220311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:15.220605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:15.221029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] PATH_INFO: `/v3/users/976bcfd4d6ff46cc8c4655e8a55837af` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:15.223165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] RBAC: Authorizing `identity:delete_user(user_id=976bcfd4d6ff46cc8c4655e8a55837af)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:15.225895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:15.237817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b90332-a22f-4b98-b676-b249395cfe03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:15.239384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b90332-a22f-4b98-b676-b249395cfe03 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:15.259356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1063/2110] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:15.261049 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b90332-a22f-4b98-b676-b249395cfe03 service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:15.263573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-47b90332-a22f-4b98-b676-b249395cfe03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:15.278040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b90332-a22f-4b98-b676-b249395cfe03 service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:15.283145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:15.284609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:15.284891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:15.285168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] PATH_INFO: `/v3/projects/deb3ede7ed904a979cfe5d5824aebf43` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:15.286430 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb3ede7ed904a979cfe5d5824aebf43)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:15.288626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:15.304585 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976bcfd4d6ff46cc8c4655e8a55837af'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.315261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976bcfd4d6ff46cc8c4655e8a55837af'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.326297 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976bcfd4d6ff46cc8c4655e8a55837af'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.327083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976bcfd4d6ff46cc8c4655e8a55837af'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.327681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976bcfd4d6ff46cc8c4655e8a55837af'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.345247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb3ede7ed904a979cfe5d5824aebf43', 'request_id': 'req-be7c3f4b-2549-4c43-8f69-43efc888453a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.347454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1048/2111] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:15 2022] DELETE /identity/v3/users/976bcfd4d6ff46cc8c4655e8a55837af => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:15.352270 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb3ede7ed904a979cfe5d5824aebf43', 'request_id': 'req-be7c3f4b-2549-4c43-8f69-43efc888453a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.360953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb3ede7ed904a979cfe5d5824aebf43', 'request_id': 'req-be7c3f4b-2549-4c43-8f69-43efc888453a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.375388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] The token cache is being invalidate because project deb3ede7ed904a979cfe5d5824aebf43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:15.375740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.376462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.378651 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1064/2112] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:15 2022] DELETE /identity/v3/projects/deb3ede7ed904a979cfe5d5824aebf43 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:15.382526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:15.383988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:15.461435 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350eb458-d691-47df-a5fd-d6bcf581896a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:15.466212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5352a2-63e5-4443-8540-5963d566c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:15.467134 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5352a2-63e5-4443-8540-5963d566c30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:15.467449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5352a2-63e5-4443-8540-5963d566c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:15.467724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5352a2-63e5-4443-8540-5963d566c30d admin admin] PATH_INFO: `/v3/users/88896fc899074a3da814eb8803133e9f` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:15.468944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5352a2-63e5-4443-8540-5963d566c30d admin admin] RBAC: Authorizing `identity:delete_user(user_id=88896fc899074a3da814eb8803133e9f)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:15.470867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5352a2-63e5-4443-8540-5963d566c30d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:15.536621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b5352a2-63e5-4443-8540-5963d566c30d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88896fc899074a3da814eb8803133e9f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.546179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b5352a2-63e5-4443-8540-5963d566c30d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88896fc899074a3da814eb8803133e9f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.556592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b5352a2-63e5-4443-8540-5963d566c30d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88896fc899074a3da814eb8803133e9f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.556891 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b5352a2-63e5-4443-8540-5963d566c30d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88896fc899074a3da814eb8803133e9f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.557541 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b5352a2-63e5-4443-8540-5963d566c30d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88896fc899074a3da814eb8803133e9f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.577714 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1049/2113] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:15 2022] DELETE /identity/v3/users/88896fc899074a3da814eb8803133e9f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:15.703153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:15.704720 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:15.793242 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c3f4b-2549-4c43-8f69-43efc888453a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:15.860430 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:15.862679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:15.862798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:15.863050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] PATH_INFO: `/v3/projects/de121bc71b39496bb37341ac27a0f072` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:15.864396 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de121bc71b39496bb37341ac27a0f072)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:15.866351 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:15.913496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de121bc71b39496bb37341ac27a0f072', 'request_id': 'req-87a05f98-08e6-405e-96a5-dff311916a68'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.919552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de121bc71b39496bb37341ac27a0f072', 'request_id': 'req-87a05f98-08e6-405e-96a5-dff311916a68'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.927800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de121bc71b39496bb37341ac27a0f072', 'request_id': 'req-87a05f98-08e6-405e-96a5-dff311916a68'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.938956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] The token cache is being invalidate because project de121bc71b39496bb37341ac27a0f072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:15.939293 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.939920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:15.942151 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1065/2114] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:15 2022] DELETE /identity/v3/projects/de121bc71b39496bb37341ac27a0f072 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:15.949580 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc494d-2142-4a4b-a418-696b0032190f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:15.949940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc494d-2142-4a4b-a418-696b0032190f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:15.950229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc494d-2142-4a4b-a418-696b0032190f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:15.953197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:15.954579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:15.979716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-18fc494d-2142-4a4b-a418-696b0032190f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:15.980863 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-18fc494d-2142-4a4b-a418-696b0032190f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:16.018919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a05f98-08e6-405e-96a5-dff311916a68 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.023707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a28da7-512e-4e2a-b690-72550fadb23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.024612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a28da7-512e-4e2a-b690-72550fadb23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.024952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a28da7-512e-4e2a-b690-72550fadb23d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.025408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a28da7-512e-4e2a-b690-72550fadb23d admin admin] PATH_INFO: `/v3/projects/b1d93cc868f34e119e061a0e31f8485b` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.026634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a28da7-512e-4e2a-b690-72550fadb23d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1d93cc868f34e119e061a0e31f8485b)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.028617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a28da7-512e-4e2a-b690-72550fadb23d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.045157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1050/2115] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:16.053714 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6103a4-cb1c-48ac-91b9-a798a62c72ac None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.054033 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6103a4-cb1c-48ac-91b9-a798a62c72ac None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.054287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6103a4-cb1c-48ac-91b9-a798a62c72ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.073897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-ae6103a4-cb1c-48ac-91b9-a798a62c72ac None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:16.075070 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ae6103a4-cb1c-48ac-91b9-a798a62c72ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:16.083590 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d3a28da7-512e-4e2a-b690-72550fadb23d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1d93cc868f34e119e061a0e31f8485b', 'request_id': 'req-d3a28da7-512e-4e2a-b690-72550fadb23d'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:16.089982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d3a28da7-512e-4e2a-b690-72550fadb23d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1d93cc868f34e119e061a0e31f8485b', 'request_id': 'req-d3a28da7-512e-4e2a-b690-72550fadb23d'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:16.098465 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d3a28da7-512e-4e2a-b690-72550fadb23d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1d93cc868f34e119e061a0e31f8485b', 'request_id': 'req-d3a28da7-512e-4e2a-b690-72550fadb23d'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:16.113407 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d3a28da7-512e-4e2a-b690-72550fadb23d admin admin] The token cache is being invalidate because project b1d93cc868f34e119e061a0e31f8485b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:16.113684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d3a28da7-512e-4e2a-b690-72550fadb23d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:16.114346 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d3a28da7-512e-4e2a-b690-72550fadb23d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:16.116087 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1066/2116] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:15 2022] DELETE /identity/v3/projects/b1d93cc868f34e119e061a0e31f8485b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:16.120844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec4f9-34ff-491b-ade9-ba64a4143cc7 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.121285 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec4f9-34ff-491b-ade9-ba64a4143cc7 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.121573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dec4f9-34ff-491b-ade9-ba64a4143cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.139793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a2dec4f9-34ff-491b-ade9-ba64a4143cc7 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:16.141118 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a2dec4f9-34ff-491b-ade9-ba64a4143cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:16.147145 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1051/2117] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:16.149660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6103a4-cb1c-48ac-91b9-a798a62c72ac None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.157628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1067/2118] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:16.173249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7e8a-2980-45b5-bbe3-13906157af61 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.173545 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7e8a-2980-45b5-bbe3-13906157af61 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.173852 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf7e8a-2980-45b5-bbe3-13906157af61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.173962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6103a4-cb1c-48ac-91b9-a798a62c72ac None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.183150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d931-f782-4616-b69f-7958eaeb1e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.183989 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d931-f782-4616-b69f-7958eaeb1e3f admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.184407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d931-f782-4616-b69f-7958eaeb1e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.184772 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09d931-f782-4616-b69f-7958eaeb1e3f admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.187836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09d931-f782-4616-b69f-7958eaeb1e3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:16.194845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09d931-f782-4616-b69f-7958eaeb1e3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.194845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09d931-f782-4616-b69f-7958eaeb1e3f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.208078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1052/2119] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:16.216533 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d931-f782-4616-b69f-7958eaeb1e3f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.217444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-37bf7e8a-2980-45b5-bbe3-13906157af61 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:16.218941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-37bf7e8a-2980-45b5-bbe3-13906157af61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:16.228411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09d931-f782-4616-b69f-7958eaeb1e3f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.235412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1068/2120] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:16.236803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0620f39-57b7-4033-8087-2738b1df917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.238246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0620f39-57b7-4033-8087-2738b1df917f admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.238666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0620f39-57b7-4033-8087-2738b1df917f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.238995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0620f39-57b7-4033-8087-2738b1df917f admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.239110 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf7e8a-2980-45b5-bbe3-13906157af61 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.241604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0620f39-57b7-4033-8087-2738b1df917f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.244002 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0620f39-57b7-4033-8087-2738b1df917f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.248934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf7e8a-2980-45b5-bbe3-13906157af61 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.255385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4bbe-9ee5-4ee7-8cac-942e32545f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.256108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4bbe-9ee5-4ee7-8cac-942e32545f71 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.256527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4bbe-9ee5-4ee7-8cac-942e32545f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.256807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4bbe-9ee5-4ee7-8cac-942e32545f71 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.258248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b4bbe-9ee5-4ee7-8cac-942e32545f71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:16.258591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b4bbe-9ee5-4ee7-8cac-942e32545f71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.260489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b4bbe-9ee5-4ee7-8cac-942e32545f71 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.282188 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1069/2121] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:49:16.285039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1053/2122] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:16 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:16.289273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4bbe-9ee5-4ee7-8cac-942e32545f71 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.290664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0620f39-57b7-4033-8087-2738b1df917f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.303825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4bbe-9ee5-4ee7-8cac-942e32545f71 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.382870 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0620f39-57b7-4033-8087-2738b1df917f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.383068 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292dd3-85f7-448e-996b-c1d776ff1b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.383671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292dd3-85f7-448e-996b-c1d776ff1b8a admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.383982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292dd3-85f7-448e-996b-c1d776ff1b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.384257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7292dd3-85f7-448e-996b-c1d776ff1b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.385267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7292dd3-85f7-448e-996b-c1d776ff1b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.387605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7292dd3-85f7-448e-996b-c1d776ff1b8a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.390172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ae98-300d-4222-a947-3dae889eb7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.391074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ae98-300d-4222-a947-3dae889eb7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.391644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ae98-300d-4222-a947-3dae889eb7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.392403 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2ae98-300d-4222-a947-3dae889eb7d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.393367 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2ae98-300d-4222-a947-3dae889eb7d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.395927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2ae98-300d-4222-a947-3dae889eb7d5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.425013 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1070/2123] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:16 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:16.427234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292dd3-85f7-448e-996b-c1d776ff1b8a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.434083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1054/2124] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:16 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:16.443881 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ae98-300d-4222-a947-3dae889eb7d5 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.465642 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2ae98-300d-4222-a947-3dae889eb7d5 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.522486 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7292dd3-85f7-448e-996b-c1d776ff1b8a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.527156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18d171-9811-421c-a9a6-75f524c9dd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.527856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18d171-9811-421c-a9a6-75f524c9dd80 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.528138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18d171-9811-421c-a9a6-75f524c9dd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.528416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18d171-9811-421c-a9a6-75f524c9dd80 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.529106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18d171-9811-421c-a9a6-75f524c9dd80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.531020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18d171-9811-421c-a9a6-75f524c9dd80 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.534974 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67130ca1-0909-4aac-946f-8bce21c12cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.535796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67130ca1-0909-4aac-946f-8bce21c12cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.536084 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67130ca1-0909-4aac-946f-8bce21c12cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.536358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67130ca1-0909-4aac-946f-8bce21c12cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.537076 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67130ca1-0909-4aac-946f-8bce21c12cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.538676 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67130ca1-0909-4aac-946f-8bce21c12cd5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.549985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1055/2125] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:16.551785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1071/2126] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:16 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:16.553509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67130ca1-0909-4aac-946f-8bce21c12cd5 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.555462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18d171-9811-421c-a9a6-75f524c9dd80 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.562904 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67130ca1-0909-4aac-946f-8bce21c12cd5 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.564882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18d171-9811-421c-a9a6-75f524c9dd80 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.567783 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77007e-f607-4de2-9619-6ac480dd4c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.568413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77007e-f607-4de2-9619-6ac480dd4c0e admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.568692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77007e-f607-4de2-9619-6ac480dd4c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.568965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77007e-f607-4de2-9619-6ac480dd4c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.569724 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77007e-f607-4de2-9619-6ac480dd4c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.569826 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758edeb-51bb-4761-9767-e38c8daad7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.570301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758edeb-51bb-4761-9767-e38c8daad7ac admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.570584 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758edeb-51bb-4761-9767-e38c8daad7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.570859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758edeb-51bb-4761-9767-e38c8daad7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.571274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77007e-f607-4de2-9619-6ac480dd4c0e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.571605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758edeb-51bb-4761-9767-e38c8daad7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.573155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758edeb-51bb-4761-9767-e38c8daad7ac admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.583521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1056/2127] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:16.586639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1072/2128] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:16.587515 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758edeb-51bb-4761-9767-e38c8daad7ac admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.588316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77007e-f607-4de2-9619-6ac480dd4c0e admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.597532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758edeb-51bb-4761-9767-e38c8daad7ac admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.598252 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77007e-f607-4de2-9619-6ac480dd4c0e admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.602073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a54f-4bb3-43a0-b1d2-cf794f04ee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.602888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb7252-1ec7-424b-9b16-ef434eda5899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.603008 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a54f-4bb3-43a0-b1d2-cf794f04ee5f admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.603197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a54f-4bb3-43a0-b1d2-cf794f04ee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.603489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a54f-4bb3-43a0-b1d2-cf794f04ee5f admin admin] PATH_INFO: `/v3/projects/a53c7e42df124428bf6332fc93021908/users/2b7a924cfaf244bab1acc93ec6ce02b3/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.603760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb7252-1ec7-424b-9b16-ef434eda5899 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.604042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb7252-1ec7-424b-9b16-ef434eda5899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.604309 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb7252-1ec7-424b-9b16-ef434eda5899 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.605025 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb7252-1ec7-424b-9b16-ef434eda5899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.606643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb7252-1ec7-424b-9b16-ef434eda5899 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.616299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1057/2129] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:16.618133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6a54f-4bb3-43a0-b1d2-cf794f04ee5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53c7e42df124428bf6332fc93021908, user_id=2b7a924cfaf244bab1acc93ec6ce02b3, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.620305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb7252-1ec7-424b-9b16-ef434eda5899 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.620782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6a54f-4bb3-43a0-b1d2-cf794f04ee5f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.630296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb7252-1ec7-424b-9b16-ef434eda5899 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.633268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1073/2130] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:16 2022] PUT /identity/v3/projects/a53c7e42df124428bf6332fc93021908/users/2b7a924cfaf244bab1acc93ec6ce02b3/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:16.645723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3dfbd-9463-46c9-8684-e50e89193db3 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.646062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3dfbd-9463-46c9-8684-e50e89193db3 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.646348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3dfbd-9463-46c9-8684-e50e89193db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.674505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b0d3dfbd-9463-46c9-8684-e50e89193db3 None None] MFA Rules not processed for user `2b7a924cfaf244bab1acc93ec6ce02b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:16.675741 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b0d3dfbd-9463-46c9-8684-e50e89193db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:16.686067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b9de7-8c84-4f28-ab5a-12f63ab0793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.686948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b9de7-8c84-4f28-ab5a-12f63ab0793a admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.687244 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b9de7-8c84-4f28-ab5a-12f63ab0793a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.687525 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b9de7-8c84-4f28-ab5a-12f63ab0793a admin admin] PATH_INFO: `/v3/projects/7843a8e31e3845da9e3deb12d6182feb/users/f6bed17f936141edae4c9e8327ec5773/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.702519 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b9de7-8c84-4f28-ab5a-12f63ab0793a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7843a8e31e3845da9e3deb12d6182feb, user_id=f6bed17f936141edae4c9e8327ec5773, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.705272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b9de7-8c84-4f28-ab5a-12f63ab0793a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.724487 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1058/2131] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:16 2022] PUT /identity/v3/projects/7843a8e31e3845da9e3deb12d6182feb/users/f6bed17f936141edae4c9e8327ec5773/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:16.735690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a74b93-cdd3-409a-bb19-0a7b2f1f8716 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.735984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a74b93-cdd3-409a-bb19-0a7b2f1f8716 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.736261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a74b93-cdd3-409a-bb19-0a7b2f1f8716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.764189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-02a74b93-cdd3-409a-bb19-0a7b2f1f8716 None None] MFA Rules not processed for user `f6bed17f936141edae4c9e8327ec5773`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:16.765485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-02a74b93-cdd3-409a-bb19-0a7b2f1f8716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:16.791279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1074/2132] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:16.801067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3dfbd-9463-46c9-8684-e50e89193db3 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.802466 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b0d3dfbd-9463-46c9-8684-e50e89193db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:16.853526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1059/2133] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:16.858129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a74b93-cdd3-409a-bb19-0a7b2f1f8716 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.871497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3dfbd-9463-46c9-8684-e50e89193db3 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.922749 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a74b93-cdd3-409a-bb19-0a7b2f1f8716 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:16.923503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51284f4-f5c2-4f6b-80c0-04a502cbea28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.924390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51284f4-f5c2-4f6b-80c0-04a502cbea28 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.924677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51284f4-f5c2-4f6b-80c0-04a502cbea28 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.924949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51284f4-f5c2-4f6b-80c0-04a502cbea28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.927688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da5b96-60b9-4ce4-b41f-36c2ef8b207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:16.928327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da5b96-60b9-4ce4-b41f-36c2ef8b207a admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:16.928606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da5b96-60b9-4ce4-b41f-36c2ef8b207a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:16.928991 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da5b96-60b9-4ce4-b41f-36c2ef8b207a admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:16.929688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da5b96-60b9-4ce4-b41f-36c2ef8b207a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.931659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da5b96-60b9-4ce4-b41f-36c2ef8b207a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:16.960754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1060/2134] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:16 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:16.964972 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da5b96-60b9-4ce4-b41f-36c2ef8b207a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:16.994532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51284f4-f5c2-4f6b-80c0-04a502cbea28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:16.996009 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51284f4-f5c2-4f6b-80c0-04a502cbea28 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:17.007055 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1075/2135] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:17.034003 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da5b96-60b9-4ce4-b41f-36c2ef8b207a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:17.038888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caf9a0-6eb3-45f6-96fd-a0850efd2e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:17.039787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caf9a0-6eb3-45f6-96fd-a0850efd2e64 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:17.040002 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caf9a0-6eb3-45f6-96fd-a0850efd2e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:17.040281 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caf9a0-6eb3-45f6-96fd-a0850efd2e64 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:17.040991 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caf9a0-6eb3-45f6-96fd-a0850efd2e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:17.042902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caf9a0-6eb3-45f6-96fd-a0850efd2e64 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:17.073362 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1061/2136] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:16 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:17.073837 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51284f4-f5c2-4f6b-80c0-04a502cbea28 service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:17.094799 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51284f4-f5c2-4f6b-80c0-04a502cbea28 service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:17.099778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd9313-218f-472a-9f2f-c77fc3c33958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:17.100664 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd9313-218f-472a-9f2f-c77fc3c33958 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:17.101202 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd9313-218f-472a-9f2f-c77fc3c33958 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:17.101476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd9313-218f-472a-9f2f-c77fc3c33958 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:17.102244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd9313-218f-472a-9f2f-c77fc3c33958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:17.103876 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd9313-218f-472a-9f2f-c77fc3c33958 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:17.115247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1076/2137] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:17.120023 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caf9a0-6eb3-45f6-96fd-a0850efd2e64 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:17.132712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caf9a0-6eb3-45f6-96fd-a0850efd2e64 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:17.137917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12c92e-1c21-4308-bb75-f5f7096e2483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:17.138922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12c92e-1c21-4308-bb75-f5f7096e2483 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:17.139371 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12c92e-1c21-4308-bb75-f5f7096e2483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:17.139749 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12c92e-1c21-4308-bb75-f5f7096e2483 admin admin] PATH_INFO: `/v3/projects/1e99de6ee14843468ef037ec307a815f/users/b83bf06871af41c4997662c9c35f1e67/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:17.156571 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12c92e-1c21-4308-bb75-f5f7096e2483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e99de6ee14843468ef037ec307a815f, user_id=b83bf06871af41c4997662c9c35f1e67, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:17.159751 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12c92e-1c21-4308-bb75-f5f7096e2483 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:17.176129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1062/2138] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:17 2022] PUT /identity/v3/projects/1e99de6ee14843468ef037ec307a815f/users/b83bf06871af41c4997662c9c35f1e67/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:17.180581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd9313-218f-472a-9f2f-c77fc3c33958 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:17.191548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd9313-218f-472a-9f2f-c77fc3c33958 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:17.268678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e704544-d0f7-45bd-9af8-1047269bff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:17.269596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e704544-d0f7-45bd-9af8-1047269bff93 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:17.270027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e704544-d0f7-45bd-9af8-1047269bff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:17.270439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e704544-d0f7-45bd-9af8-1047269bff93 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:17.271604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e704544-d0f7-45bd-9af8-1047269bff93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:17.273642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e704544-d0f7-45bd-9af8-1047269bff93 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:17.298327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12c92e-1c21-4308-bb75-f5f7096e2483 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:17.305048 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1077/2139] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:17.310386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12c92e-1c21-4308-bb75-f5f7096e2483 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:17.316050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05342b4-659f-467b-b2cb-762b9289eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:17.316944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05342b4-659f-467b-b2cb-762b9289eefc admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:17.317222 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05342b4-659f-467b-b2cb-762b9289eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:17.317748 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05342b4-659f-467b-b2cb-762b9289eefc admin admin] PATH_INFO: `/v3/projects/1e99de6ee14843468ef037ec307a815f/users/b83bf06871af41c4997662c9c35f1e67/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:17.319786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05342b4-659f-467b-b2cb-762b9289eefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e99de6ee14843468ef037ec307a815f, user_id=b83bf06871af41c4997662c9c35f1e67, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:17.322417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05342b4-659f-467b-b2cb-762b9289eefc admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:17.334393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1063/2140] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:17 2022] PUT /identity/v3/projects/1e99de6ee14843468ef037ec307a815f/users/b83bf06871af41c4997662c9c35f1e67/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:17.344792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641445-4758-44d3-9888-a85105766a9d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:17.345087 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641445-4758-44d3-9888-a85105766a9d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:17.345361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb641445-4758-44d3-9888-a85105766a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:17.376253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-fb641445-4758-44d3-9888-a85105766a9d None None] MFA Rules not processed for user `b83bf06871af41c4997662c9c35f1e67`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:17.378077 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fb641445-4758-44d3-9888-a85105766a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:17.446629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1078/2141] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:17.457834 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05342b4-659f-467b-b2cb-762b9289eefc admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:17.518432 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05342b4-659f-467b-b2cb-762b9289eefc admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:17.526424 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e63c9-e44c-4f96-9468-5e472cb52f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:17.527064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e63c9-e44c-4f96-9468-5e472cb52f88 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:17.529447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e63c9-e44c-4f96-9468-5e472cb52f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:17.529740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e63c9-e44c-4f96-9468-5e472cb52f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:17.543235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e63c9-e44c-4f96-9468-5e472cb52f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:17.543860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e63c9-e44c-4f96-9468-5e472cb52f88 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:17.559417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1064/2142] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:17.679709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb641445-4758-44d3-9888-a85105766a9d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:17.692277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb641445-4758-44d3-9888-a85105766a9d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:17.704064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c4017-12e8-4a8d-b890-d5e7811cb3a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:17.704940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c4017-12e8-4a8d-b890-d5e7811cb3a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:17.705228 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c4017-12e8-4a8d-b890-d5e7811cb3a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:17.705566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c4017-12e8-4a8d-b890-d5e7811cb3a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:17.772259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c4017-12e8-4a8d-b890-d5e7811cb3a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:17.774079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c4017-12e8-4a8d-b890-d5e7811cb3a9 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:17.786085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1079/2143] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:28.192745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e63c9-e44c-4f96-9468-5e472cb52f88 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:28.194611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-fe0e63c9-e44c-4f96-9468-5e472cb52f88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:28.272229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e63c9-e44c-4f96-9468-5e472cb52f88 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:28.276959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:28.277896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:28.278185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:28.278560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] PATH_INFO: `/v3/users/43853c8fc63d4fa7ac4b9c6e7c2f723b` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:28.279810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43853c8fc63d4fa7ac4b9c6e7c2f723b)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:28.282096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:28.328598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43853c8fc63d4fa7ac4b9c6e7c2f723b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:28.336043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43853c8fc63d4fa7ac4b9c6e7c2f723b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:28.342851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43853c8fc63d4fa7ac4b9c6e7c2f723b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:28.343556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43853c8fc63d4fa7ac4b9c6e7c2f723b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:28.344445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43853c8fc63d4fa7ac4b9c6e7c2f723b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:28.363050 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1065/2144] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:28 2022] DELETE /identity/v3/users/43853c8fc63d4fa7ac4b9c6e7c2f723b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:28.368041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501238e-0bdc-411b-8c3e-0e0ca6cf80d1 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:28.368534 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501238e-0bdc-411b-8c3e-0e0ca6cf80d1 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:28.368777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501238e-0bdc-411b-8c3e-0e0ca6cf80d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:28.385463 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b501238e-0bdc-411b-8c3e-0e0ca6cf80d1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:28.386784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b501238e-0bdc-411b-8c3e-0e0ca6cf80d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:28.462275 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1080/2145] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:28.473816 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:28.475419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:28.539776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2e390-cbe8-48bb-b2d7-50ddec047660 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:28.544029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b744f-b3cd-4014-9924-133fe7518b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:28.544686 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b744f-b3cd-4014-9924-133fe7518b57 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:28.544997 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b744f-b3cd-4014-9924-133fe7518b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:28.545288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b744f-b3cd-4014-9924-133fe7518b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:28.555699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b744f-b3cd-4014-9924-133fe7518b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:28.556392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b744f-b3cd-4014-9924-133fe7518b57 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:28.567137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1066/2146] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:28.792738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501238e-0bdc-411b-8c3e-0e0ca6cf80d1 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:28.794517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b501238e-0bdc-411b-8c3e-0e0ca6cf80d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:28.810811 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501238e-0bdc-411b-8c3e-0e0ca6cf80d1 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:28.818532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9277207-222a-4832-9ff2-ab31b6ebe707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:28.819647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9277207-222a-4832-9ff2-ab31b6ebe707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:28.820109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9277207-222a-4832-9ff2-ab31b6ebe707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:28.820310 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9277207-222a-4832-9ff2-ab31b6ebe707 admin admin] PATH_INFO: `/v3/users/f6bed17f936141edae4c9e8327ec5773` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:28.821700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9277207-222a-4832-9ff2-ab31b6ebe707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6bed17f936141edae4c9e8327ec5773)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:28.823948 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9277207-222a-4832-9ff2-ab31b6ebe707 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:28.905127 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f9277207-222a-4832-9ff2-ab31b6ebe707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6bed17f936141edae4c9e8327ec5773'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:28.931241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f9277207-222a-4832-9ff2-ab31b6ebe707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6bed17f936141edae4c9e8327ec5773'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:28.932131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f9277207-222a-4832-9ff2-ab31b6ebe707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6bed17f936141edae4c9e8327ec5773'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:28.938866 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b744f-b3cd-4014-9924-133fe7518b57 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:28.939847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f9277207-222a-4832-9ff2-ab31b6ebe707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6bed17f936141edae4c9e8327ec5773'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:28.940922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-192b744f-b3cd-4014-9924-133fe7518b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:28.952367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f9277207-222a-4832-9ff2-ab31b6ebe707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6bed17f936141edae4c9e8327ec5773'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:28.959260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1081/2147] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:28 2022] DELETE /identity/v3/users/f6bed17f936141edae4c9e8327ec5773 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:28.963540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c4533-9ef8-46e1-8db3-3d3a754599aa None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:28.963992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c4533-9ef8-46e1-8db3-3d3a754599aa None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:28.964459 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c4533-9ef8-46e1-8db3-3d3a754599aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:28.972744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b744f-b3cd-4014-9924-133fe7518b57 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:28.986027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-2f8c4533-9ef8-46e1-8db3-3d3a754599aa None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:28.988121 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2f8c4533-9ef8-46e1-8db3-3d3a754599aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:29.042721 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefba777-235b-4097-bfc5-91b90ff41c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:29.043771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefba777-235b-4097-bfc5-91b90ff41c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.044191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefba777-235b-4097-bfc5-91b90ff41c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.044471 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefba777-235b-4097-bfc5-91b90ff41c49 admin admin] PATH_INFO: `/v3/projects/ca7aec3a284b477a97ad2a9027d25261` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.046047 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefba777-235b-4097-bfc5-91b90ff41c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca7aec3a284b477a97ad2a9027d25261)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:29.050168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefba777-235b-4097-bfc5-91b90ff41c49 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:29.061989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1082/2148] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:29.071815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c4533-9ef8-46e1-8db3-3d3a754599aa None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:29.073174 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2f8c4533-9ef8-46e1-8db3-3d3a754599aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:29.118999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-aefba777-235b-4097-bfc5-91b90ff41c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca7aec3a284b477a97ad2a9027d25261', 'request_id': 'req-aefba777-235b-4097-bfc5-91b90ff41c49'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.125961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-aefba777-235b-4097-bfc5-91b90ff41c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca7aec3a284b477a97ad2a9027d25261', 'request_id': 'req-aefba777-235b-4097-bfc5-91b90ff41c49'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.134655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-aefba777-235b-4097-bfc5-91b90ff41c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca7aec3a284b477a97ad2a9027d25261', 'request_id': 'req-aefba777-235b-4097-bfc5-91b90ff41c49'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.142855 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c4533-9ef8-46e1-8db3-3d3a754599aa None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:29.146771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-aefba777-235b-4097-bfc5-91b90ff41c49 admin admin] The token cache is being invalidate because project ca7aec3a284b477a97ad2a9027d25261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:29.147058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-aefba777-235b-4097-bfc5-91b90ff41c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.148052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-aefba777-235b-4097-bfc5-91b90ff41c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.154371 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1067/2149] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:28 2022] DELETE /identity/v3/projects/ca7aec3a284b477a97ad2a9027d25261 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:29.155828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6d557-d6ab-45f2-9018-050d6a3cf755 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.156132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6d557-d6ab-45f2-9018-050d6a3cf755 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.156400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6d557-d6ab-45f2-9018-050d6a3cf755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.178324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6cd6d557-d6ab-45f2-9018-050d6a3cf755 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:29.179963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6cd6d557-d6ab-45f2-9018-050d6a3cf755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:29.197311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04d14f-7c2e-4da6-8c36-58521510ea25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:29.197960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04d14f-7c2e-4da6-8c36-58521510ea25 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.198248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04d14f-7c2e-4da6-8c36-58521510ea25 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.198522 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04d14f-7c2e-4da6-8c36-58521510ea25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.200553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-df04d14f-7c2e-4da6-8c36-58521510ea25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:29.259006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1068/2150] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:29.266737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6d557-d6ab-45f2-9018-050d6a3cf755 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:29.266737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6cd6d557-d6ab-45f2-9018-050d6a3cf755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:29.274423 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6d557-d6ab-45f2-9018-050d6a3cf755 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:29.279042 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04d14f-7c2e-4da6-8c36-58521510ea25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:29.279766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:29.280649 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.280789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04d14f-7c2e-4da6-8c36-58521510ea25 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:29.281000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.281197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] PATH_INFO: `/v3/users/9d47939de5324f14a451effd4691ce93` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.282981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d47939de5324f14a451effd4691ce93)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:29.285713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:29.298983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1083/2151] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:29.301372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab6c89-d0d4-4a99-809b-3fe8e65efc71 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.302018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab6c89-d0d4-4a99-809b-3fe8e65efc71 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.302442 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab6c89-d0d4-4a99-809b-3fe8e65efc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.329066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-3bab6c89-d0d4-4a99-809b-3fe8e65efc71 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:29.330319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3bab6c89-d0d4-4a99-809b-3fe8e65efc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:29.342923 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1084/2152] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:29.353359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab6c89-d0d4-4a99-809b-3fe8e65efc71 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:29.365789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab6c89-d0d4-4a99-809b-3fe8e65efc71 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:29.372242 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009770-14f9-45e9-9682-3ad2f5686ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:29.373061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009770-14f9-45e9-9682-3ad2f5686ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.373389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009770-14f9-45e9-9682-3ad2f5686ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.373663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009770-14f9-45e9-9682-3ad2f5686ac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.375105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee009770-14f9-45e9-9682-3ad2f5686ac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:29.375461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee009770-14f9-45e9-9682-3ad2f5686ac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:29.377054 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee009770-14f9-45e9-9682-3ad2f5686ac8 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:29.380871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d47939de5324f14a451effd4691ce93'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.392342 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1085/2153] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:49:29.396273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d47939de5324f14a451effd4691ce93'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.397383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009770-14f9-45e9-9682-3ad2f5686ac8 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:29.408599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d47939de5324f14a451effd4691ce93'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.410238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d47939de5324f14a451effd4691ce93'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.411421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d47939de5324f14a451effd4691ce93'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.411829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009770-14f9-45e9-9682-3ad2f5686ac8 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:29.417908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ab266-bf2e-4d71-9443-1168c1873bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:29.418661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ab266-bf2e-4d71-9443-1168c1873bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.420688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ab266-bf2e-4d71-9443-1168c1873bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.423575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ab266-bf2e-4d71-9443-1168c1873bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.424628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ab266-bf2e-4d71-9443-1168c1873bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:29.426548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ab266-bf2e-4d71-9443-1168c1873bc5 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:29.436251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1069/2154] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:29 2022] DELETE /identity/v3/users/9d47939de5324f14a451effd4691ce93 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:29.471041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1086/2155] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:29 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:29.473663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:29.475640 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:29.555535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871018a-50fc-4044-aa95-3f6d55a88656 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:29.640808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cba02-1b54-4542-8bfe-24356eec34bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:29.641300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cba02-1b54-4542-8bfe-24356eec34bf admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.641670 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cba02-1b54-4542-8bfe-24356eec34bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.641852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cba02-1b54-4542-8bfe-24356eec34bf admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.642998 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cba02-1b54-4542-8bfe-24356eec34bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:29.648295 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cba02-1b54-4542-8bfe-24356eec34bf admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:29.698693 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1070/2156] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:29 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:29.703620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ab266-bf2e-4d71-9443-1168c1873bc5 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:29.722664 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ab266-bf2e-4d71-9443-1168c1873bc5 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:29.729518 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cba02-1b54-4542-8bfe-24356eec34bf admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:29.731253 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-846cba02-1b54-4542-8bfe-24356eec34bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:29.735705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8e0d1-63fb-4bd0-943e-6ab397e267d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:29.741200 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8e0d1-63fb-4bd0-943e-6ab397e267d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.741499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8e0d1-63fb-4bd0-943e-6ab397e267d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.741781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8e0d1-63fb-4bd0-943e-6ab397e267d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.745557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8e0d1-63fb-4bd0-943e-6ab397e267d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:29.747177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8e0d1-63fb-4bd0-943e-6ab397e267d0 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:29.750045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cba02-1b54-4542-8bfe-24356eec34bf admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:29.755539 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:29.756410 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.762815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.763241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] PATH_INFO: `/v3/projects/7843a8e31e3845da9e3deb12d6182feb` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.764525 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7843a8e31e3845da9e3deb12d6182feb)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:29.766912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:29.771373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1087/2157] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:29.773334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8e0d1-63fb-4bd0-943e-6ab397e267d0 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:29.779128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-01b8e0d1-63fb-4bd0-943e-6ab397e267d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:29.804713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8e0d1-63fb-4bd0-943e-6ab397e267d0 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:29.810555 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:29.811521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.811798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.812071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] PATH_INFO: `/v3/projects/cf08d79c8f5b457c93189f884ed3f626` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.813483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf08d79c8f5b457c93189f884ed3f626)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:29.816391 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:29.830105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7843a8e31e3845da9e3deb12d6182feb', 'request_id': 'req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.837778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7843a8e31e3845da9e3deb12d6182feb', 'request_id': 'req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.845964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7843a8e31e3845da9e3deb12d6182feb', 'request_id': 'req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.857058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] The token cache is being invalidate because project 7843a8e31e3845da9e3deb12d6182feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:29.857275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.857945 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.859562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1071/2158] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:29 2022] DELETE /identity/v3/projects/7843a8e31e3845da9e3deb12d6182feb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:29.860343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:29.861615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:29.870474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf08d79c8f5b457c93189f884ed3f626', 'request_id': 'req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.876591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf08d79c8f5b457c93189f884ed3f626', 'request_id': 'req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.884774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf08d79c8f5b457c93189f884ed3f626', 'request_id': 'req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.895525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] The token cache is being invalidate because project cf08d79c8f5b457c93189f884ed3f626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:29.895810 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.896470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:29.898021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1088/2159] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:29 2022] DELETE /identity/v3/projects/cf08d79c8f5b457c93189f884ed3f626 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:29.899318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:29.900919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:29.929190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbd88f-bc86-4b60-bbb4-7f058be41a0b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:29.968977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbf7c0-b1a6-43f1-86e0-61f4637533d4 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:29.973719 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092296c5-0dcf-4fc7-862d-a8d63701e346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:29.974586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092296c5-0dcf-4fc7-862d-a8d63701e346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.974862 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092296c5-0dcf-4fc7-862d-a8d63701e346 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.975134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092296c5-0dcf-4fc7-862d-a8d63701e346 admin admin] PATH_INFO: `/v3/users/b83bf06871af41c4997662c9c35f1e67` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.976351 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092296c5-0dcf-4fc7-862d-a8d63701e346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83bf06871af41c4997662c9c35f1e67)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:29.978300 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092296c5-0dcf-4fc7-862d-a8d63701e346 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:29.988950 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84027a57-19c2-4636-a9ac-88b891700229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:29.989628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027a57-19c2-4636-a9ac-88b891700229 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:29.989909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027a57-19c2-4636-a9ac-88b891700229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:29.990185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027a57-19c2-4636-a9ac-88b891700229 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:29.990919 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84027a57-19c2-4636-a9ac-88b891700229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:29.992582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84027a57-19c2-4636-a9ac-88b891700229 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:30.003728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1072/2160] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:30.005673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9db0e-39ec-4757-b286-d4e668c1fe89 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.006049 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9db0e-39ec-4757-b286-d4e668c1fe89 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.006358 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9db0e-39ec-4757-b286-d4e668c1fe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.025300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-48e9db0e-39ec-4757-b286-d4e668c1fe89 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:30.026509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-48e9db0e-39ec-4757-b286-d4e668c1fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.027064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-092296c5-0dcf-4fc7-862d-a8d63701e346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83bf06871af41c4997662c9c35f1e67'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.034457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-092296c5-0dcf-4fc7-862d-a8d63701e346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83bf06871af41c4997662c9c35f1e67'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.040899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1073/2161] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:30.041041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-092296c5-0dcf-4fc7-862d-a8d63701e346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83bf06871af41c4997662c9c35f1e67'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.041145 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9db0e-39ec-4757-b286-d4e668c1fe89 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:30.042674 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-092296c5-0dcf-4fc7-862d-a8d63701e346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83bf06871af41c4997662c9c35f1e67'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.042841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-48e9db0e-39ec-4757-b286-d4e668c1fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.056294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9db0e-39ec-4757-b286-d4e668c1fe89 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:30.056460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-092296c5-0dcf-4fc7-862d-a8d63701e346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83bf06871af41c4997662c9c35f1e67'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.061096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60894ce8-ac5d-4beb-9745-c7dd9fc70cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:30.062510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60894ce8-ac5d-4beb-9745-c7dd9fc70cff admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.062510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60894ce8-ac5d-4beb-9745-c7dd9fc70cff admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.062697 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1089/2162] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:29 2022] DELETE /identity/v3/users/b83bf06871af41c4997662c9c35f1e67 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:30.062778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60894ce8-ac5d-4beb-9745-c7dd9fc70cff admin admin] PATH_INFO: `/v3/projects/b89aab6be90c4a8aae0dde8ae28ab2d8/users/b21bcb3cc791407a89541d11fc883294/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.063632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c50b-d2d1-4f6c-8dd1-7fb233de279d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.063921 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c50b-d2d1-4f6c-8dd1-7fb233de279d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.066418 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c50b-d2d1-4f6c-8dd1-7fb233de279d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.081904 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60894ce8-ac5d-4beb-9745-c7dd9fc70cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89aab6be90c4a8aae0dde8ae28ab2d8, user_id=b21bcb3cc791407a89541d11fc883294, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:30.084506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60894ce8-ac5d-4beb-9745-c7dd9fc70cff admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:30.089479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-5d48c50b-d2d1-4f6c-8dd1-7fb233de279d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:30.090673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5d48c50b-d2d1-4f6c-8dd1-7fb233de279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.099520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1074/2163] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:30 2022] PUT /identity/v3/projects/b89aab6be90c4a8aae0dde8ae28ab2d8/users/b21bcb3cc791407a89541d11fc883294/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:30.110958 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b9df7-f4e4-4c71-a361-af6082fbfabb None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.111276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b9df7-f4e4-4c71-a361-af6082fbfabb None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.111719 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b9df7-f4e4-4c71-a361-af6082fbfabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.141172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b23b9df7-f4e4-4c71-a361-af6082fbfabb None None] MFA Rules not processed for user `b21bcb3cc791407a89541d11fc883294`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:30.142392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b23b9df7-f4e4-4c71-a361-af6082fbfabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.164537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1090/2164] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:30.171372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48c50b-d2d1-4f6c-8dd1-7fb233de279d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:30.179568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48c50b-d2d1-4f6c-8dd1-7fb233de279d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:30.227626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1075/2165] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:30.246706 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b9df7-f4e4-4c71-a361-af6082fbfabb None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:30.247447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc77b3e-4871-41f1-8957-59eb2cd11403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:30.248120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc77b3e-4871-41f1-8957-59eb2cd11403 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.248407 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc77b3e-4871-41f1-8957-59eb2cd11403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.249204 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc77b3e-4871-41f1-8957-59eb2cd11403 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.250357 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc77b3e-4871-41f1-8957-59eb2cd11403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:30.250471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc77b3e-4871-41f1-8957-59eb2cd11403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:30.250949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b23b9df7-f4e4-4c71-a361-af6082fbfabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.252318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc77b3e-4871-41f1-8957-59eb2cd11403 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:30.266986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1091/2166] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:30.271722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc77b3e-4871-41f1-8957-59eb2cd11403 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:30.282024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc77b3e-4871-41f1-8957-59eb2cd11403 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:30.288224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cff59-946d-4f44-b794-d07b22b98819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:30.289213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cff59-946d-4f44-b794-d07b22b98819 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.289498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cff59-946d-4f44-b794-d07b22b98819 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.289911 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cff59-946d-4f44-b794-d07b22b98819 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.290612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cff59-946d-4f44-b794-d07b22b98819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:30.292811 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cff59-946d-4f44-b794-d07b22b98819 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:30.336080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1092/2167] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:30 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:30.341687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cff59-946d-4f44-b794-d07b22b98819 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:30.354857 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b9df7-f4e4-4c71-a361-af6082fbfabb None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:30.416360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e74d5-4548-4d21-af3a-765602e10789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:30.417011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e74d5-4548-4d21-af3a-765602e10789 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.417290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e74d5-4548-4d21-af3a-765602e10789 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.417564 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e74d5-4548-4d21-af3a-765602e10789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.434752 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cff59-946d-4f44-b794-d07b22b98819 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:30.442291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c7fbd-44aa-4d02-8f3f-4b8b3244ab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:30.443013 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c7fbd-44aa-4d02-8f3f-4b8b3244ab20 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.443338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c7fbd-44aa-4d02-8f3f-4b8b3244ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.443611 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c7fbd-44aa-4d02-8f3f-4b8b3244ab20 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.444408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c7fbd-44aa-4d02-8f3f-4b8b3244ab20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:30.448485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c7fbd-44aa-4d02-8f3f-4b8b3244ab20 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:30.474718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1093/2168] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:30 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:30.475888 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c7fbd-44aa-4d02-8f3f-4b8b3244ab20 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:30.477880 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a27c7fbd-44aa-4d02-8f3f-4b8b3244ab20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.483448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e74d5-4548-4d21-af3a-765602e10789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:30.483744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e74d5-4548-4d21-af3a-765602e10789 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:30.490444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c7fbd-44aa-4d02-8f3f-4b8b3244ab20 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:30.495524 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:30.495962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1076/2169] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:30.496307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.496589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.496859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] PATH_INFO: `/v3/projects/1e99de6ee14843468ef037ec307a815f` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.497695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e74d5-4548-4d21-af3a-765602e10789 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:30.498046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e99de6ee14843468ef037ec307a815f)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:30.499960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:30.512412 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e74d5-4548-4d21-af3a-765602e10789 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:30.518370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704efb47-c937-444d-b63f-4bad8b38ccc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:30.519198 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704efb47-c937-444d-b63f-4bad8b38ccc8 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.519544 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704efb47-c937-444d-b63f-4bad8b38ccc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.520119 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704efb47-c937-444d-b63f-4bad8b38ccc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.520904 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704efb47-c937-444d-b63f-4bad8b38ccc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:30.522494 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704efb47-c937-444d-b63f-4bad8b38ccc8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:30.536634 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1077/2170] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:30.540643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704efb47-c937-444d-b63f-4bad8b38ccc8 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:30.553381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704efb47-c937-444d-b63f-4bad8b38ccc8 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:30.560394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e99de6ee14843468ef037ec307a815f', 'request_id': 'req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.568520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e99de6ee14843468ef037ec307a815f', 'request_id': 'req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.579904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e99de6ee14843468ef037ec307a815f', 'request_id': 'req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.591711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] The token cache is being invalidate because project 1e99de6ee14843468ef037ec307a815f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:30.591996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.592666 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.594222 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1094/2171] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:30 2022] DELETE /identity/v3/projects/1e99de6ee14843468ef037ec307a815f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:30.597977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:30.597977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.630783 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0368320-cf1c-454a-a652-fa4415b753f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:30.631484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368320-cf1c-454a-a652-fa4415b753f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.631875 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368320-cf1c-454a-a652-fa4415b753f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.632162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368320-cf1c-454a-a652-fa4415b753f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.632870 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0368320-cf1c-454a-a652-fa4415b753f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:30.634465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0368320-cf1c-454a-a652-fa4415b753f9 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:30.647304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1078/2172] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:30.649598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c492d77-139c-45ca-a837-6c09ad0bcb43 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.649897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c492d77-139c-45ca-a837-6c09ad0bcb43 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.650580 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c492d77-139c-45ca-a837-6c09ad0bcb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.669879 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-2c492d77-139c-45ca-a837-6c09ad0bcb43 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:30.671127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2c492d77-139c-45ca-a837-6c09ad0bcb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.673784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b1e1c-aae6-4fa6-87dd-04ad8ec7f936 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:30.679505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47148b73-8ae6-4c3f-a0cd-c20b5972bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:30.680602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1079/2173] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:30.680744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47148b73-8ae6-4c3f-a0cd-c20b5972bdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.680861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47148b73-8ae6-4c3f-a0cd-c20b5972bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.681103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47148b73-8ae6-4c3f-a0cd-c20b5972bdd1 admin admin] PATH_INFO: `/v3/users/dd2ac4030b0b4bd69901e079f0d02efd` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.681303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c492d77-139c-45ca-a837-6c09ad0bcb43 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:30.682476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2c492d77-139c-45ca-a837-6c09ad0bcb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.682579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47148b73-8ae6-4c3f-a0cd-c20b5972bdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2ac4030b0b4bd69901e079f0d02efd)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:30.684485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47148b73-8ae6-4c3f-a0cd-c20b5972bdd1 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:30.694631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c492d77-139c-45ca-a837-6c09ad0bcb43 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:30.700230 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c95846-f5bb-4954-bf86-0bcb6a886205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:30.701143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c95846-f5bb-4954-bf86-0bcb6a886205 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.701425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c95846-f5bb-4954-bf86-0bcb6a886205 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.701728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c95846-f5bb-4954-bf86-0bcb6a886205 admin admin] PATH_INFO: `/v3/projects/9c15593c7d8143d08f5f72fb3689266a/users/a867bf12e73e40c0af1181241d659320/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.718566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c95846-f5bb-4954-bf86-0bcb6a886205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c15593c7d8143d08f5f72fb3689266a, user_id=a867bf12e73e40c0af1181241d659320, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:30.721337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c95846-f5bb-4954-bf86-0bcb6a886205 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:30.738751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-47148b73-8ae6-4c3f-a0cd-c20b5972bdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2ac4030b0b4bd69901e079f0d02efd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.743273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1080/2174] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:30 2022] PUT /identity/v3/projects/9c15593c7d8143d08f5f72fb3689266a/users/a867bf12e73e40c0af1181241d659320/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:30.743273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19477a-486b-4c24-a6be-941156148c6c None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.743509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19477a-486b-4c24-a6be-941156148c6c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.743886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19477a-486b-4c24-a6be-941156148c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.747047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-47148b73-8ae6-4c3f-a0cd-c20b5972bdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2ac4030b0b4bd69901e079f0d02efd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.747710 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-47148b73-8ae6-4c3f-a0cd-c20b5972bdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2ac4030b0b4bd69901e079f0d02efd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.756363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-47148b73-8ae6-4c3f-a0cd-c20b5972bdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2ac4030b0b4bd69901e079f0d02efd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.766188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-bf19477a-486b-4c24-a6be-941156148c6c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:30.767431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bf19477a-486b-4c24-a6be-941156148c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.803410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-47148b73-8ae6-4c3f-a0cd-c20b5972bdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2ac4030b0b4bd69901e079f0d02efd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:30.817104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1095/2175] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:30 2022] DELETE /identity/v3/users/dd2ac4030b0b4bd69901e079f0d02efd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:30.824623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90e34-3509-4e18-9761-b6ac8b2ec6cc None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.824963 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90e34-3509-4e18-9761-b6ac8b2ec6cc None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.825251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc90e34-3509-4e18-9761-b6ac8b2ec6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.853278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-9fc90e34-3509-4e18-9761-b6ac8b2ec6cc None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:30.854645 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-9fc90e34-3509-4e18-9761-b6ac8b2ec6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.857176 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1081/2176] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:30.858205 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19477a-486b-4c24-a6be-941156148c6c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:30.859984 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bf19477a-486b-4c24-a6be-941156148c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.878253 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19477a-486b-4c24-a6be-941156148c6c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:30.928234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1096/2177] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:30.929528 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109522f3-3fbb-455f-9dc5-7f18fe391e97 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.929813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109522f3-3fbb-455f-9dc5-7f18fe391e97 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.930086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109522f3-3fbb-455f-9dc5-7f18fe391e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.951636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-109522f3-3fbb-455f-9dc5-7f18fe391e97 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:30.952959 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-109522f3-3fbb-455f-9dc5-7f18fe391e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:30.962537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1097/2178] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:30.963162 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109522f3-3fbb-455f-9dc5-7f18fe391e97 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:30.965974 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:30.967564 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.967806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.968180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] PATH_INFO: `/v3/users/2fd4f84237cd4959a00bf507bba06e78` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.976022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd4f84237cd4959a00bf507bba06e78)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:30.977393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109522f3-3fbb-455f-9dc5-7f18fe391e97 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:30.980577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:30.982874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7c49c-bd08-4648-bead-b069df958414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:30.983585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c49c-bd08-4648-bead-b069df958414 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:30.983854 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c49c-bd08-4648-bead-b069df958414 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:30.984121 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c49c-bd08-4648-bead-b069df958414 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:30.985499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7c49c-bd08-4648-bead-b069df958414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:30.985790 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7c49c-bd08-4648-bead-b069df958414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:30.987652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7c49c-bd08-4648-bead-b069df958414 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:31.007082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1098/2179] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:31.009312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7c49c-bd08-4648-bead-b069df958414 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:31.011439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-bcc7c49c-bd08-4648-bead-b069df958414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:31.038871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd4f84237cd4959a00bf507bba06e78'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:31.046568 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd4f84237cd4959a00bf507bba06e78'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:31.054079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd4f84237cd4959a00bf507bba06e78'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:31.054751 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd4f84237cd4959a00bf507bba06e78'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:31.055410 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd4f84237cd4959a00bf507bba06e78'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:31.072783 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1082/2180] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:30 2022] DELETE /identity/v3/users/2fd4f84237cd4959a00bf507bba06e78 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:31.073600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:31.075265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7c49c-bd08-4648-bead-b069df958414 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:31.076877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:31.122175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4457b4-cc29-4efe-9b58-279f2584b16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:31.122792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4457b4-cc29-4efe-9b58-279f2584b16e service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:31.123084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4457b4-cc29-4efe-9b58-279f2584b16e service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:31.123414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4457b4-cc29-4efe-9b58-279f2584b16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:31.125190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1d4457b4-cc29-4efe-9b58-279f2584b16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:31.133502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762ce84-8386-4d75-9282-722c9cfe188c admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:31.137256 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a0515-2c27-4860-a55d-b6216dec0a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:31.137886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a0515-2c27-4860-a55d-b6216dec0a71 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:31.138164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a0515-2c27-4860-a55d-b6216dec0a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:31.138449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a0515-2c27-4860-a55d-b6216dec0a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:31.140679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-400a0515-2c27-4860-a55d-b6216dec0a71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:31.186973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4457b4-cc29-4efe-9b58-279f2584b16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:31.188444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4457b4-cc29-4efe-9b58-279f2584b16e service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:31.198569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1099/2181] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:31.199381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4457b4-cc29-4efe-9b58-279f2584b16e service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:31.200789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1d4457b4-cc29-4efe-9b58-279f2584b16e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:31.203494 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a0515-2c27-4860-a55d-b6216dec0a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:31.204933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a0515-2c27-4860-a55d-b6216dec0a71 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:31.214363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4457b4-cc29-4efe-9b58-279f2584b16e service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:31.215261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1083/2182] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:31.216653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de4351-0c31-4b28-841d-e3f815c3b73d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:31.216952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de4351-0c31-4b28-841d-e3f815c3b73d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:31.217241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de4351-0c31-4b28-841d-e3f815c3b73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:31.220188 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073828f6-55c8-4f39-a740-515f07dc07af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:31.220932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073828f6-55c8-4f39-a740-515f07dc07af admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:31.221220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073828f6-55c8-4f39-a740-515f07dc07af admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:31.221525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073828f6-55c8-4f39-a740-515f07dc07af admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:31.222211 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073828f6-55c8-4f39-a740-515f07dc07af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:31.224922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073828f6-55c8-4f39-a740-515f07dc07af admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:31.235293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-01de4351-0c31-4b28-841d-e3f815c3b73d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:31.236620 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-01de4351-0c31-4b28-841d-e3f815c3b73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:31.246377 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1084/2183] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:31.258939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1100/2184] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:31 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:31.263884 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de4351-0c31-4b28-841d-e3f815c3b73d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:31.269246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073828f6-55c8-4f39-a740-515f07dc07af admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:31.280345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de4351-0c31-4b28-841d-e3f815c3b73d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:31.372870 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c3754-6281-4d8e-baca-974d340d92f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:31.373515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c3754-6281-4d8e-baca-974d340d92f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:31.373653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c3754-6281-4d8e-baca-974d340d92f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:31.373932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c3754-6281-4d8e-baca-974d340d92f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:31.375687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073828f6-55c8-4f39-a740-515f07dc07af admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:31.382808 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ce1d0-668a-441f-9395-248659ed0d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:31.384297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ce1d0-668a-441f-9395-248659ed0d59 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:31.385192 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ce1d0-668a-441f-9395-248659ed0d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:31.385742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c3754-6281-4d8e-baca-974d340d92f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:31.385860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ce1d0-668a-441f-9395-248659ed0d59 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:31.387240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ce1d0-668a-441f-9395-248659ed0d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:31.387520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c3754-6281-4d8e-baca-974d340d92f4 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:31.391536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ce1d0-668a-441f-9395-248659ed0d59 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:31.401598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1085/2185] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:31.418746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1101/2186] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:31 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:31.423582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c3754-6281-4d8e-baca-974d340d92f4 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:31.436548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c3754-6281-4d8e-baca-974d340d92f4 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:31.444736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeb030-511d-4f72-97d0-67da02b996a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:31.446235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeb030-511d-4f72-97d0-67da02b996a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:31.446592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeb030-511d-4f72-97d0-67da02b996a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:31.448364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdeb030-511d-4f72-97d0-67da02b996a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:31.448364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdeb030-511d-4f72-97d0-67da02b996a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:31.449483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdeb030-511d-4f72-97d0-67da02b996a0 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:31.460269 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1086/2187] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:31.464487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ce1d0-668a-441f-9395-248659ed0d59 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:31.475362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ce1d0-668a-441f-9395-248659ed0d59 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:31.483224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be6ce9-db2b-46a5-b04e-2c5a4136c303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:31.484090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6ce9-db2b-46a5-b04e-2c5a4136c303 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:31.484541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6ce9-db2b-46a5-b04e-2c5a4136c303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:31.484906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6ce9-db2b-46a5-b04e-2c5a4136c303 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:31.485847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be6ce9-db2b-46a5-b04e-2c5a4136c303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:31.488358 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be6ce9-db2b-46a5-b04e-2c5a4136c303 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:31.499757 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1102/2188] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:31.504559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeb030-511d-4f72-97d0-67da02b996a0 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:31.515731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdeb030-511d-4f72-97d0-67da02b996a0 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:31.521373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58971e37-b804-4602-87f7-838697e38584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:31.522557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58971e37-b804-4602-87f7-838697e38584 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:31.522931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58971e37-b804-4602-87f7-838697e38584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:31.523368 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58971e37-b804-4602-87f7-838697e38584 admin admin] PATH_INFO: `/v3/projects/162582ed0f614e74acc662dd183bb53b/users/da85a83db1d14431b84da40016646765/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:31.544411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58971e37-b804-4602-87f7-838697e38584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162582ed0f614e74acc662dd183bb53b, user_id=da85a83db1d14431b84da40016646765, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:31.549322 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58971e37-b804-4602-87f7-838697e38584 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:31.579920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1087/2189] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:31 2022] PUT /identity/v3/projects/162582ed0f614e74acc662dd183bb53b/users/da85a83db1d14431b84da40016646765/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:31.582265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7f1ed-aaa7-4216-8b11-13211fbff297 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:31.582623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7f1ed-aaa7-4216-8b11-13211fbff297 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:31.582977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7f1ed-aaa7-4216-8b11-13211fbff297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:31.615058 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-02d7f1ed-aaa7-4216-8b11-13211fbff297 None None] MFA Rules not processed for user `da85a83db1d14431b84da40016646765`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:31.616744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-02d7f1ed-aaa7-4216-8b11-13211fbff297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:31.713229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1103/2190] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:31.715743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58971e37-b804-4602-87f7-838697e38584 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:31.786095 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7f1ed-aaa7-4216-8b11-13211fbff297 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:31.788474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-02d7f1ed-aaa7-4216-8b11-13211fbff297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:31.796462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58971e37-b804-4602-87f7-838697e38584 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:31.805717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7f1ed-aaa7-4216-8b11-13211fbff297 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:31.810858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:31.811818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:31.812098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:31.812377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] PATH_INFO: `/v3/projects/c40f0d265ae34d4f8d3d5d02b981d6a5` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:31.813661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40f0d265ae34d4f8d3d5d02b981d6a5)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:31.816103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:31.833645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7da90-18ff-4a67-83f4-daa964f73826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:31.834633 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7da90-18ff-4a67-83f4-daa964f73826 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:31.835416 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7da90-18ff-4a67-83f4-daa964f73826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:31.835895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7da90-18ff-4a67-83f4-daa964f73826 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:31.836820 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7da90-18ff-4a67-83f4-daa964f73826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:31.839085 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7da90-18ff-4a67-83f4-daa964f73826 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:31.883373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1088/2191] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:31 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:31.884149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7da90-18ff-4a67-83f4-daa964f73826 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:31.885706 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7bd7da90-18ff-4a67-83f4-daa964f73826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:31.900554 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40f0d265ae34d4f8d3d5d02b981d6a5', 'request_id': 'req-81188f7b-23e0-4db7-9d85-ffb6f5a54774'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:31.916063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40f0d265ae34d4f8d3d5d02b981d6a5', 'request_id': 'req-81188f7b-23e0-4db7-9d85-ffb6f5a54774'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:31.928504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40f0d265ae34d4f8d3d5d02b981d6a5', 'request_id': 'req-81188f7b-23e0-4db7-9d85-ffb6f5a54774'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:31.945079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] The token cache is being invalidate because project c40f0d265ae34d4f8d3d5d02b981d6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:31.945336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:31.946330 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:31.950999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1104/2192] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:31 2022] DELETE /identity/v3/projects/c40f0d265ae34d4f8d3d5d02b981d6a5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:31.951896 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:31.953499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:31.993577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7da90-18ff-4a67-83f4-daa964f73826 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:31.998989 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:32.000335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.000716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.001383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] PATH_INFO: `/v3/projects/1311bbc69c83422998b5c0e5b92cd82c` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.002492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1311bbc69c83422998b5c0e5b92cd82c)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:32.005736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:32.070738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81188f7b-23e0-4db7-9d85-ffb6f5a54774 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:32.105072 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1311bbc69c83422998b5c0e5b92cd82c', 'request_id': 'req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:32.119299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1311bbc69c83422998b5c0e5b92cd82c', 'request_id': 'req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:32.132462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1311bbc69c83422998b5c0e5b92cd82c', 'request_id': 'req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:32.150923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] The token cache is being invalidate because project 1311bbc69c83422998b5c0e5b92cd82c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:32.151495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:32.152301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:32.154040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1089/2193] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:31 2022] DELETE /identity/v3/projects/1311bbc69c83422998b5c0e5b92cd82c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:32.155057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:32.159645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:32.161368 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f28081-c82b-4daa-b4ba-3faad5389f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:32.162164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28081-c82b-4daa-b4ba-3faad5389f3a admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.162512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28081-c82b-4daa-b4ba-3faad5389f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.162872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28081-c82b-4daa-b4ba-3faad5389f3a admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.163695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f28081-c82b-4daa-b4ba-3faad5389f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:32.165827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f28081-c82b-4daa-b4ba-3faad5389f3a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:32.186442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b575fbf-8472-4b99-b5a4-d9e7f75cd75f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:32.199057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:32.203014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.203330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.203611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] PATH_INFO: `/v3/users/8cc715f27ac14fc7a1aa54268693c9e7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.204813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1105/2194] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:31 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:32.205548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc715f27ac14fc7a1aa54268693c9e7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:32.208126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:32.209757 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc0f26-aa9b-4db8-8298-2641861f263e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.210046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc0f26-aa9b-4db8-8298-2641861f263e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.210332 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc0f26-aa9b-4db8-8298-2641861f263e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.249927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-bbdc0f26-aa9b-4db8-8298-2641861f263e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:32.251737 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-bbdc0f26-aa9b-4db8-8298-2641861f263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:32.263824 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1106/2195] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:32.267039 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc0f26-aa9b-4db8-8298-2641861f263e None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:32.269727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-bbdc0f26-aa9b-4db8-8298-2641861f263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:32.288220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc0f26-aa9b-4db8-8298-2641861f263e None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:32.291798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc715f27ac14fc7a1aa54268693c9e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:32.297493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b1fb4-7ee6-4527-b2eb-da08210687bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:32.297493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b1fb4-7ee6-4527-b2eb-da08210687bb admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.297493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b1fb4-7ee6-4527-b2eb-da08210687bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.297493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b1fb4-7ee6-4527-b2eb-da08210687bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.297930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b1fb4-7ee6-4527-b2eb-da08210687bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:32.299431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b1fb4-7ee6-4527-b2eb-da08210687bb admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:32.313908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1107/2196] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:32.315772 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9643235-0a77-4a91-84a4-99563278a72e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.316141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9643235-0a77-4a91-84a4-99563278a72e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.316493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9643235-0a77-4a91-84a4-99563278a72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.321968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc715f27ac14fc7a1aa54268693c9e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:32.332221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc715f27ac14fc7a1aa54268693c9e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:32.332923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc715f27ac14fc7a1aa54268693c9e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:32.333577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc715f27ac14fc7a1aa54268693c9e7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:32.337192 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-f9643235-0a77-4a91-84a4-99563278a72e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:32.338617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f9643235-0a77-4a91-84a4-99563278a72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:32.350467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1108/2197] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:32.351315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9643235-0a77-4a91-84a4-99563278a72e None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:32.354713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f9643235-0a77-4a91-84a4-99563278a72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:32.364225 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1090/2198] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:32 2022] DELETE /identity/v3/users/8cc715f27ac14fc7a1aa54268693c9e7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:32.364225 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:32.368998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9643235-0a77-4a91-84a4-99563278a72e None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:32.453680 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f9922-d311-4d4d-a563-248912204d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:32.454737 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f9922-d311-4d4d-a563-248912204d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.455025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f9922-d311-4d4d-a563-248912204d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.456969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f9922-d311-4d4d-a563-248912204d2b admin admin] PATH_INFO: `/v3/projects/54ec7148c9484278aecd2d12cc12c622/users/9d8a675bd94d426c903f1835b87445a8/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.477808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9099c8-ff27-4a04-a3bd-4c456cc0c222 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:32.487501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f9922-d311-4d4d-a563-248912204d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ec7148c9484278aecd2d12cc12c622, user_id=9d8a675bd94d426c903f1835b87445a8, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:32.489752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fba43e-d048-4ff9-b137-f171ceb049fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:32.490421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fba43e-d048-4ff9-b137-f171ceb049fb admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.490702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fba43e-d048-4ff9-b137-f171ceb049fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.490973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fba43e-d048-4ff9-b137-f171ceb049fb admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.493131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fba43e-d048-4ff9-b137-f171ceb049fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:32.493451 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fba43e-d048-4ff9-b137-f171ceb049fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:32.495130 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f9922-d311-4d4d-a563-248912204d2b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:32.497341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fba43e-d048-4ff9-b137-f171ceb049fb admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:32.520739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1109/2199] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:32 2022] PUT /identity/v3/projects/54ec7148c9484278aecd2d12cc12c622/users/9d8a675bd94d426c903f1835b87445a8/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:32.522332 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1091/2200] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:32.526821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f9922-d311-4d4d-a563-248912204d2b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:32.529535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fba43e-d048-4ff9-b137-f171ceb049fb admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:32.551531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fba43e-d048-4ff9-b137-f171ceb049fb admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:32.654829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f9922-d311-4d4d-a563-248912204d2b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:32.663135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e3774-00af-4047-86fd-e3141660f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:32.664936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e3774-00af-4047-86fd-e3141660f0cc admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.667034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e3774-00af-4047-86fd-e3141660f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.667406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e3774-00af-4047-86fd-e3141660f0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.668940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e0df3-1e3f-4843-804c-288376ebfaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:32.669327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e3774-00af-4047-86fd-e3141660f0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:32.671462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e0df3-1e3f-4843-804c-288376ebfaae admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.671936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e0df3-1e3f-4843-804c-288376ebfaae admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.672372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e0df3-1e3f-4843-804c-288376ebfaae admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.673271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e3774-00af-4047-86fd-e3141660f0cc admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:32.674121 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e0df3-1e3f-4843-804c-288376ebfaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:32.677711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e0df3-1e3f-4843-804c-288376ebfaae admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:32.704693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1110/2201] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:32.706602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e0df3-1e3f-4843-804c-288376ebfaae admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:32.728209 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e0df3-1e3f-4843-804c-288376ebfaae admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:32.731737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1092/2202] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:32 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:32.735959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e3774-00af-4047-86fd-e3141660f0cc admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:32.738563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-fa9e3774-00af-4047-86fd-e3141660f0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:32.747968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f6ee4-6ff3-4def-96bd-767267d4fc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:32.748877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f6ee4-6ff3-4def-96bd-767267d4fc7d admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.749663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f6ee4-6ff3-4def-96bd-767267d4fc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.749663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f6ee4-6ff3-4def-96bd-767267d4fc7d admin admin] PATH_INFO: `/v3/projects/54ec7148c9484278aecd2d12cc12c622/users/9d8a675bd94d426c903f1835b87445a8/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.756047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f6ee4-6ff3-4def-96bd-767267d4fc7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ec7148c9484278aecd2d12cc12c622, user_id=9d8a675bd94d426c903f1835b87445a8, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:32.759583 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f6ee4-6ff3-4def-96bd-767267d4fc7d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:32.790604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1111/2203] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:32 2022] PUT /identity/v3/projects/54ec7148c9484278aecd2d12cc12c622/users/9d8a675bd94d426c903f1835b87445a8/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:32.791405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f6ee4-6ff3-4def-96bd-767267d4fc7d admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:32.834752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e3774-00af-4047-86fd-e3141660f0cc admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:32.889274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f6ee4-6ff3-4def-96bd-767267d4fc7d admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:32.900202 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f606562-46c7-490e-87aa-5f257fe6144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:32.901441 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f606562-46c7-490e-87aa-5f257fe6144c admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.901734 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f606562-46c7-490e-87aa-5f257fe6144c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.902008 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f606562-46c7-490e-87aa-5f257fe6144c admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.903185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f606562-46c7-490e-87aa-5f257fe6144c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:32.906185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f606562-46c7-490e-87aa-5f257fe6144c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:32.912799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:32.913939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.914400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.914851 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] PATH_INFO: `/v3/projects/5b2ffba4a3d44e3cb684d14168a5e712` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.916298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2ffba4a3d44e3cb684d14168a5e712)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:32.918656 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:32.948914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1112/2204] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:32 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:32.948914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace6f63-a64c-44c9-8577-0111e472a374 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:32.948914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace6f63-a64c-44c9-8577-0111e472a374 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:32.948914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace6f63-a64c-44c9-8577-0111e472a374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:32.981785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-aace6f63-a64c-44c9-8577-0111e472a374 None None] MFA Rules not processed for user `9d8a675bd94d426c903f1835b87445a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:32.983092 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-aace6f63-a64c-44c9-8577-0111e472a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:32.992837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2ffba4a3d44e3cb684d14168a5e712', 'request_id': 'req-969d0b79-d22a-46d3-8c66-9fcd47d1544b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:33.001109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2ffba4a3d44e3cb684d14168a5e712', 'request_id': 'req-969d0b79-d22a-46d3-8c66-9fcd47d1544b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:33.011052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2ffba4a3d44e3cb684d14168a5e712', 'request_id': 'req-969d0b79-d22a-46d3-8c66-9fcd47d1544b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:33.028626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] The token cache is being invalidate because project 5b2ffba4a3d44e3cb684d14168a5e712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:33.029002 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:33.031018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:33.032995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1093/2205] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:32 2022] DELETE /identity/v3/projects/5b2ffba4a3d44e3cb684d14168a5e712 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:33.033929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:33.035363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:33.115300 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1113/2206] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:33.118226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6793b-5188-4c24-9326-2d60c3223d8e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.118704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6793b-5188-4c24-9326-2d60c3223d8e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.119227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6793b-5188-4c24-9326-2d60c3223d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.125161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d0b79-d22a-46d3-8c66-9fcd47d1544b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:33.132534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba955168-8cdc-4df2-ab4d-11bef0a31e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:33.133231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba955168-8cdc-4df2-ab4d-11bef0a31e03 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.133514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba955168-8cdc-4df2-ab4d-11bef0a31e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.133790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba955168-8cdc-4df2-ab4d-11bef0a31e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.134594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba955168-8cdc-4df2-ab4d-11bef0a31e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:33.138707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba955168-8cdc-4df2-ab4d-11bef0a31e03 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:33.142091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-4cd6793b-5188-4c24-9326-2d60c3223d8e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:33.143401 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4cd6793b-5188-4c24-9326-2d60c3223d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:33.153320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1114/2207] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:33.154492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6793b-5188-4c24-9326-2d60c3223d8e None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:33.155888 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4cd6793b-5188-4c24-9326-2d60c3223d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:33.181551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1094/2208] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:33.185022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0756-a011-45ac-9049-e0e3adef2b07 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.185022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0756-a011-45ac-9049-e0e3adef2b07 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.185022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0756-a011-45ac-9049-e0e3adef2b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.212251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-673a0756-a011-45ac-9049-e0e3adef2b07 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:33.214299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-673a0756-a011-45ac-9049-e0e3adef2b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:33.228704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1095/2209] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:33.229592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0756-a011-45ac-9049-e0e3adef2b07 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:33.246287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0756-a011-45ac-9049-e0e3adef2b07 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:33.252036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356c02d-db8e-4ccc-915b-0e5ebe2ca888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:33.253359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356c02d-db8e-4ccc-915b-0e5ebe2ca888 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.254532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356c02d-db8e-4ccc-915b-0e5ebe2ca888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.254915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356c02d-db8e-4ccc-915b-0e5ebe2ca888 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.255773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356c02d-db8e-4ccc-915b-0e5ebe2ca888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:33.257952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356c02d-db8e-4ccc-915b-0e5ebe2ca888 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:33.259533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6793b-5188-4c24-9326-2d60c3223d8e None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:33.264886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41df07e-35be-4b44-944a-1b179b49f375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:33.265626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41df07e-35be-4b44-944a-1b179b49f375 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.265975 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41df07e-35be-4b44-944a-1b179b49f375 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.266319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41df07e-35be-4b44-944a-1b179b49f375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.274655 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f41df07e-35be-4b44-944a-1b179b49f375 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:33.277450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1096/2210] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:33.278996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356c02d-db8e-4ccc-915b-0e5ebe2ca888 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:33.291442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356c02d-db8e-4ccc-915b-0e5ebe2ca888 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:33.296626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a6f1c-1342-4bd6-af7b-4abe4190d3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:33.297622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a6f1c-1342-4bd6-af7b-4abe4190d3eb admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.298106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a6f1c-1342-4bd6-af7b-4abe4190d3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.299021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a6f1c-1342-4bd6-af7b-4abe4190d3eb admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.300583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a6f1c-1342-4bd6-af7b-4abe4190d3eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:33.301498 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a6f1c-1342-4bd6-af7b-4abe4190d3eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:33.303732 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a6f1c-1342-4bd6-af7b-4abe4190d3eb admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:33.317838 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1097/2211] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:33.318694 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a6f1c-1342-4bd6-af7b-4abe4190d3eb admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:33.329478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a6f1c-1342-4bd6-af7b-4abe4190d3eb admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:33.334600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b0c42-313a-43ac-bc81-96c06342a888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:33.335606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b0c42-313a-43ac-bc81-96c06342a888 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.335950 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b0c42-313a-43ac-bc81-96c06342a888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.336293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b0c42-313a-43ac-bc81-96c06342a888 admin admin] PATH_INFO: `/v3/projects/4144b8f8d82547e0bda57e65a659d3c8/users/b555d88504ad4580a35d061b938c8d7a/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.356009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b0c42-313a-43ac-bc81-96c06342a888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4144b8f8d82547e0bda57e65a659d3c8, user_id=b555d88504ad4580a35d061b938c8d7a, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:33.359246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b0c42-313a-43ac-bc81-96c06342a888 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:33.378016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1098/2212] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:33 2022] PUT /identity/v3/projects/4144b8f8d82547e0bda57e65a659d3c8/users/b555d88504ad4580a35d061b938c8d7a/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:33.378852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b0c42-313a-43ac-bc81-96c06342a888 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:33.387829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41df07e-35be-4b44-944a-1b179b49f375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:33.389413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41df07e-35be-4b44-944a-1b179b49f375 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:33.399004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1115/2213] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:33.400586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83f107-d20b-404a-b0ea-233e92780e69 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.401089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83f107-d20b-404a-b0ea-233e92780e69 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.401373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83f107-d20b-404a-b0ea-233e92780e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.449132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ca83f107-d20b-404a-b0ea-233e92780e69 None None] MFA Rules not processed for user `b555d88504ad4580a35d061b938c8d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:33.452948 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ca83f107-d20b-404a-b0ea-233e92780e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:33.454379 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b0c42-313a-43ac-bc81-96c06342a888 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:33.461401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad4bc-e647-4c84-8367-2cb743872849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:33.462289 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad4bc-e647-4c84-8367-2cb743872849 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.462641 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad4bc-e647-4c84-8367-2cb743872849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.462980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad4bc-e647-4c84-8367-2cb743872849 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.463837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ad4bc-e647-4c84-8367-2cb743872849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:33.465895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ad4bc-e647-4c84-8367-2cb743872849 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:33.503351 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1099/2214] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:33 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:33.507464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad4bc-e647-4c84-8367-2cb743872849 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:33.564128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1116/2215] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:33.576375 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83f107-d20b-404a-b0ea-233e92780e69 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:33.646709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad4bc-e647-4c84-8367-2cb743872849 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:33.653020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83f107-d20b-404a-b0ea-233e92780e69 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:33.655270 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5be5e1-3aed-44b2-9a8d-0fb69af3ec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:33.655959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5be5e1-3aed-44b2-9a8d-0fb69af3ec28 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.656241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5be5e1-3aed-44b2-9a8d-0fb69af3ec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.658157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5be5e1-3aed-44b2-9a8d-0fb69af3ec28 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.659502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5be5e1-3aed-44b2-9a8d-0fb69af3ec28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:33.662946 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5be5e1-3aed-44b2-9a8d-0fb69af3ec28 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:33.700464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1100/2216] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:33 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:33.705371 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5be5e1-3aed-44b2-9a8d-0fb69af3ec28 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:33.725147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5be5e1-3aed-44b2-9a8d-0fb69af3ec28 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:33.732231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600b6ce-f0de-4e59-9ed5-3e33d12372f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:33.733937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b6ce-f0de-4e59-9ed5-3e33d12372f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.734305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b6ce-f0de-4e59-9ed5-3e33d12372f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.734657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b6ce-f0de-4e59-9ed5-3e33d12372f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.735638 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600b6ce-f0de-4e59-9ed5-3e33d12372f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:33.737554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600b6ce-f0de-4e59-9ed5-3e33d12372f2 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:33.752271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1101/2217] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:33.756924 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600b6ce-f0de-4e59-9ed5-3e33d12372f2 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:33.765902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db59516-eb5e-4098-9cb5-4e1b41768bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:33.767641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db59516-eb5e-4098-9cb5-4e1b41768bae service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.768887 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db59516-eb5e-4098-9cb5-4e1b41768bae service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.770764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db59516-eb5e-4098-9cb5-4e1b41768bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.780142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600b6ce-f0de-4e59-9ed5-3e33d12372f2 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:33.793899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10487e-e23e-4d5b-8839-8ec0e6f7d2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:33.794601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10487e-e23e-4d5b-8839-8ec0e6f7d2db admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.794853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10487e-e23e-4d5b-8839-8ec0e6f7d2db admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.795135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10487e-e23e-4d5b-8839-8ec0e6f7d2db admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.796144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10487e-e23e-4d5b-8839-8ec0e6f7d2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:33.800966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10487e-e23e-4d5b-8839-8ec0e6f7d2db admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:33.833153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1102/2218] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:33.846063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10487e-e23e-4d5b-8839-8ec0e6f7d2db admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:33.863868 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10487e-e23e-4d5b-8839-8ec0e6f7d2db admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:33.878017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a217134-f990-4aa6-9c86-8c109bc37da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:33.879029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a217134-f990-4aa6-9c86-8c109bc37da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.879340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a217134-f990-4aa6-9c86-8c109bc37da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.879625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a217134-f990-4aa6-9c86-8c109bc37da5 admin admin] PATH_INFO: `/v3/projects/63f41c74f19e4ddab23f2ac519ee4968/users/69b78c29b9624656bb82f5ce555b27b0/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:33.911610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db59516-eb5e-4098-9cb5-4e1b41768bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:33.913563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db59516-eb5e-4098-9cb5-4e1b41768bae service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:33.931124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a217134-f990-4aa6-9c86-8c109bc37da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f41c74f19e4ddab23f2ac519ee4968, user_id=69b78c29b9624656bb82f5ce555b27b0, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:33.934415 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a217134-f990-4aa6-9c86-8c109bc37da5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:33.957315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1117/2219] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:33.976832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1103/2220] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:33 2022] PUT /identity/v3/projects/63f41c74f19e4ddab23f2ac519ee4968/users/69b78c29b9624656bb82f5ce555b27b0/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:33.989917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea230f65-92e7-41fc-ac79-94382d8724e8 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:33.990235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea230f65-92e7-41fc-ac79-94382d8724e8 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:33.990481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea230f65-92e7-41fc-ac79-94382d8724e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:34.054131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ea230f65-92e7-41fc-ac79-94382d8724e8 None None] MFA Rules not processed for user `69b78c29b9624656bb82f5ce555b27b0`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:34.057028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ea230f65-92e7-41fc-ac79-94382d8724e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:34.215862 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1118/2221] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:34.220459 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a217134-f990-4aa6-9c86-8c109bc37da5 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:34.335487 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a217134-f990-4aa6-9c86-8c109bc37da5 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:34.341440 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe06eaf-99a8-40bc-8e68-b7955e7014ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:34.342262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe06eaf-99a8-40bc-8e68-b7955e7014ee admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:34.342583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe06eaf-99a8-40bc-8e68-b7955e7014ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:34.342958 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe06eaf-99a8-40bc-8e68-b7955e7014ee admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:34.343703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe06eaf-99a8-40bc-8e68-b7955e7014ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:34.346860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe06eaf-99a8-40bc-8e68-b7955e7014ee admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:34.390687 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1104/2222] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:34 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:34.390960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea230f65-92e7-41fc-ac79-94382d8724e8 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:34.414439 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea230f65-92e7-41fc-ac79-94382d8724e8 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:34.591021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb7f19-27c8-48f1-87b2-a13a134ba0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:34.591652 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb7f19-27c8-48f1-87b2-a13a134ba0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:34.591750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb7f19-27c8-48f1-87b2-a13a134ba0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:34.592023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb7f19-27c8-48f1-87b2-a13a134ba0c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:34.592735 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb7f19-27c8-48f1-87b2-a13a134ba0c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:34.598773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb7f19-27c8-48f1-87b2-a13a134ba0c0 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:34.643569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1119/2223] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:34 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:34.646422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe06eaf-99a8-40bc-8e68-b7955e7014ee admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:34.669402 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe06eaf-99a8-40bc-8e68-b7955e7014ee admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:34.682860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cacf1-3b4d-4ded-a8fe-535d4fdee29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:34.683900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cacf1-3b4d-4ded-a8fe-535d4fdee29a admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:34.684175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cacf1-3b4d-4ded-a8fe-535d4fdee29a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:34.684454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cacf1-3b4d-4ded-a8fe-535d4fdee29a admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:34.685382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cacf1-3b4d-4ded-a8fe-535d4fdee29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:34.686996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cacf1-3b4d-4ded-a8fe-535d4fdee29a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:34.711058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1105/2224] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:34.715344 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb7f19-27c8-48f1-87b2-a13a134ba0c0 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:34.730935 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb7f19-27c8-48f1-87b2-a13a134ba0c0 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:34.742189 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949665d1-30c1-456b-855c-885aadebc4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:34.743096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949665d1-30c1-456b-855c-885aadebc4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:34.743403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949665d1-30c1-456b-855c-885aadebc4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:34.743674 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949665d1-30c1-456b-855c-885aadebc4d3 admin admin] PATH_INFO: `/v3/projects/31f563c0ea9145f08526be252db0a2f3/users/0315da34fc4c412bbb74b7a867d0622f/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:34.774886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949665d1-30c1-456b-855c-885aadebc4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f563c0ea9145f08526be252db0a2f3, user_id=0315da34fc4c412bbb74b7a867d0622f, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:34.777701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949665d1-30c1-456b-855c-885aadebc4d3 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:34.803659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1120/2225] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:34 2022] PUT /identity/v3/projects/31f563c0ea9145f08526be252db0a2f3/users/0315da34fc4c412bbb74b7a867d0622f/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:34.803929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cacf1-3b4d-4ded-a8fe-535d4fdee29a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:34.818003 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cacf1-3b4d-4ded-a8fe-535d4fdee29a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:34.904165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ab478-7548-4e4e-90a6-57e50c8e4b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:34.904835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ab478-7548-4e4e-90a6-57e50c8e4b77 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:34.905114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ab478-7548-4e4e-90a6-57e50c8e4b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:34.905389 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ab478-7548-4e4e-90a6-57e50c8e4b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:34.906173 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ab478-7548-4e4e-90a6-57e50c8e4b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:34.907806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ab478-7548-4e4e-90a6-57e50c8e4b77 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:34.921401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1106/2226] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:34.922778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949665d1-30c1-456b-855c-885aadebc4d3 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:34.933675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949665d1-30c1-456b-855c-885aadebc4d3 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:34.942686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b810f-8cba-4b2f-bac8-2ec5a5922ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:34.943609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b810f-8cba-4b2f-bac8-2ec5a5922ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:34.943899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b810f-8cba-4b2f-bac8-2ec5a5922ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:34.944548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b810f-8cba-4b2f-bac8-2ec5a5922ac1 admin admin] PATH_INFO: `/v3/projects/31f563c0ea9145f08526be252db0a2f3/users/0315da34fc4c412bbb74b7a867d0622f/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:34.946301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b810f-8cba-4b2f-bac8-2ec5a5922ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f563c0ea9145f08526be252db0a2f3, user_id=0315da34fc4c412bbb74b7a867d0622f, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:34.949783 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b810f-8cba-4b2f-bac8-2ec5a5922ac1 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:34.961414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1121/2227] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:34 2022] PUT /identity/v3/projects/31f563c0ea9145f08526be252db0a2f3/users/0315da34fc4c412bbb74b7a867d0622f/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:34.973009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282922-647a-46ef-b941-5b2b89ddf723 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:34.973307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282922-647a-46ef-b941-5b2b89ddf723 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:34.973582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282922-647a-46ef-b941-5b2b89ddf723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:35.001726 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-ca282922-647a-46ef-b941-5b2b89ddf723 None None] MFA Rules not processed for user `0315da34fc4c412bbb74b7a867d0622f`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:35.003663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ca282922-647a-46ef-b941-5b2b89ddf723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:35.101798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1107/2228] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:35.114451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b810f-8cba-4b2f-bac8-2ec5a5922ac1 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:35.169957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b810f-8cba-4b2f-bac8-2ec5a5922ac1 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:35.174086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7e0d1-869e-4ed4-9a2d-4af12bbd7240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:35.174895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7e0d1-869e-4ed4-9a2d-4af12bbd7240 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:35.175182 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7e0d1-869e-4ed4-9a2d-4af12bbd7240 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:35.175485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7e0d1-869e-4ed4-9a2d-4af12bbd7240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:35.185318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7e0d1-869e-4ed4-9a2d-4af12bbd7240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:35.186746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7e0d1-869e-4ed4-9a2d-4af12bbd7240 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:35.196960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1122/2229] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:35.575512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca282922-647a-46ef-b941-5b2b89ddf723 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:35.594194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca282922-647a-46ef-b941-5b2b89ddf723 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:35.606844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186cb29-0194-40c7-b050-4599e9735eb2 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0315da34fc4c412bbb74b7a867d0622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f563c0ea9145f08526be252db0a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:35.607582 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cb29-0194-40c7-b050-4599e9735eb2 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:35.607900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cb29-0194-40c7-b050-4599e9735eb2 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:35.608178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186cb29-0194-40c7-b050-4599e9735eb2 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:35.608915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186cb29-0194-40c7-b050-4599e9735eb2 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:35.609222 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186cb29-0194-40c7-b050-4599e9735eb2 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:35.611304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186cb29-0194-40c7-b050-4599e9735eb2 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:35.653225 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1108/2230] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:35.657329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7e0d1-869e-4ed4-9a2d-4af12bbd7240 service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:35.673699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7e0d1-869e-4ed4-9a2d-4af12bbd7240 service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:35.683024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554e457-b141-4709-afff-47208b681f73 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0315da34fc4c412bbb74b7a867d0622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f563c0ea9145f08526be252db0a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:35.684260 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554e457-b141-4709-afff-47208b681f73 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:35.684620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554e457-b141-4709-afff-47208b681f73 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:35.684974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554e457-b141-4709-afff-47208b681f73 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:35.686379 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554e457-b141-4709-afff-47208b681f73 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:35.688982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554e457-b141-4709-afff-47208b681f73 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:35.739807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1123/2231] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:35 2022] POST /identity/v3/projects => generated 355 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:35.740458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186cb29-0194-40c7-b050-4599e9735eb2 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:35.755057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186cb29-0194-40c7-b050-4599e9735eb2 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:35.836746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4ab01-648a-40a8-8820-f6447c52f496 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0315da34fc4c412bbb74b7a867d0622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f563c0ea9145f08526be252db0a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:35.837429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4ab01-648a-40a8-8820-f6447c52f496 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:35.837713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4ab01-648a-40a8-8820-f6447c52f496 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:35.837994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4ab01-648a-40a8-8820-f6447c52f496 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:35.838747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4ab01-648a-40a8-8820-f6447c52f496 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:35.839058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4ab01-648a-40a8-8820-f6447c52f496 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:35.840700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4ab01-648a-40a8-8820-f6447c52f496 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:35.857937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1109/2232] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:35.895099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554e457-b141-4709-afff-47208b681f73 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:35.905399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554e457-b141-4709-afff-47208b681f73 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:35.909980 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351ef8a-229c-4119-b132-1856ba54a230 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0315da34fc4c412bbb74b7a867d0622f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f563c0ea9145f08526be252db0a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:35.910847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351ef8a-229c-4119-b132-1856ba54a230 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:35.911137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351ef8a-229c-4119-b132-1856ba54a230 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:35.911451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351ef8a-229c-4119-b132-1856ba54a230 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] PATH_INFO: `/v3/projects/5a5d6ae975fe499cad2584084daf4e17` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:35.912639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351ef8a-229c-4119-b132-1856ba54a230 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5a5d6ae975fe499cad2584084daf4e17)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:35.914533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351ef8a-229c-4119-b132-1856ba54a230 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:35.965908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8351ef8a-229c-4119-b132-1856ba54a230 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5d6ae975fe499cad2584084daf4e17', 'request_id': 'req-8351ef8a-229c-4119-b132-1856ba54a230'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:35.972569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8351ef8a-229c-4119-b132-1856ba54a230 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5d6ae975fe499cad2584084daf4e17', 'request_id': 'req-8351ef8a-229c-4119-b132-1856ba54a230'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:35.981147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8351ef8a-229c-4119-b132-1856ba54a230 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5d6ae975fe499cad2584084daf4e17', 'request_id': 'req-8351ef8a-229c-4119-b132-1856ba54a230'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:35.998570 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8351ef8a-229c-4119-b132-1856ba54a230 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] The token cache is being invalidate because project 5a5d6ae975fe499cad2584084daf4e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:35.998947 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8351ef8a-229c-4119-b132-1856ba54a230 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:35.999583 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-8351ef8a-229c-4119-b132-1856ba54a230 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:36.005514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1124/2233] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:35 2022] DELETE /identity/v3/projects/5a5d6ae975fe499cad2584084daf4e17 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:36.237558 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4ab01-648a-40a8-8820-f6447c52f496 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:36.242926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-13d4ab01-648a-40a8-8820-f6447c52f496 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:36.329563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4ab01-648a-40a8-8820-f6447c52f496 tempest-VolumeQuotaClassesTest-955443358 tempest-VolumeQuotaClassesTest-955443358-project-admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:36.393203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:36.394609 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:36.394889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:36.395161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] PATH_INFO: `/v3/users/69b78c29b9624656bb82f5ce555b27b0` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:36.396446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b78c29b9624656bb82f5ce555b27b0)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:36.398473 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:36.450512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b78c29b9624656bb82f5ce555b27b0'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:36.464797 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b78c29b9624656bb82f5ce555b27b0'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:36.472938 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b78c29b9624656bb82f5ce555b27b0'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:36.475046 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b78c29b9624656bb82f5ce555b27b0'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:36.476056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b78c29b9624656bb82f5ce555b27b0'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:36.499718 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1110/2234] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:36 2022] DELETE /identity/v3/users/69b78c29b9624656bb82f5ce555b27b0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:36.501486 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b90b0-193b-4ee5-9c22-842e7ea430ff None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:36.501805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b90b0-193b-4ee5-9c22-842e7ea430ff None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:36.502087 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b90b0-193b-4ee5-9c22-842e7ea430ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:36.523398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b06b90b0-193b-4ee5-9c22-842e7ea430ff None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:36.524768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b06b90b0-193b-4ee5-9c22-842e7ea430ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:36.619727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1125/2235] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:36.636256 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:36.638288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:36.702312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b605873-e11b-4dcf-b6ca-b7e59e5428f2 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:36.707679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f02646-690e-4ec5-a2d9-e83e316cc1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:36.708621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f02646-690e-4ec5-a2d9-e83e316cc1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:36.709009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f02646-690e-4ec5-a2d9-e83e316cc1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:36.709808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f02646-690e-4ec5-a2d9-e83e316cc1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:36.719321 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f02646-690e-4ec5-a2d9-e83e316cc1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:36.720907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f02646-690e-4ec5-a2d9-e83e316cc1c0 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:36.741445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb88b-b277-4236-94cb-1f58975d4382 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:36.741913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb88b-b277-4236-94cb-1f58975d4382 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:36.741998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb88b-b277-4236-94cb-1f58975d4382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:36.742242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1111/2236] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:36.770517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-e8edb88b-b277-4236-94cb-1f58975d4382 None None] MFA Rules not processed for user `a867bf12e73e40c0af1181241d659320`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:36.772432 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e8edb88b-b277-4236-94cb-1f58975d4382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:36.862114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1126/2237] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:36.872332 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91344cef-419c-423f-a858-50d4505454e2 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:36.872883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91344cef-419c-423f-a858-50d4505454e2 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:36.873363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91344cef-419c-423f-a858-50d4505454e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:36.896112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-91344cef-419c-423f-a858-50d4505454e2 None None] MFA Rules not processed for user `a867bf12e73e40c0af1181241d659320`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:36.897496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-91344cef-419c-423f-a858-50d4505454e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:36.906248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1112/2238] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:36.917290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edb88b-b277-4236-94cb-1f58975d4382 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:36.918764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e8edb88b-b277-4236-94cb-1f58975d4382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:37.009505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edb88b-b277-4236-94cb-1f58975d4382 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:37.014949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db716772-d7d2-4a02-bd1d-40ea5a8df35f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:37.015629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db716772-d7d2-4a02-bd1d-40ea5a8df35f service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:37.015907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db716772-d7d2-4a02-bd1d-40ea5a8df35f service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:37.016177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db716772-d7d2-4a02-bd1d-40ea5a8df35f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:37.024069 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db716772-d7d2-4a02-bd1d-40ea5a8df35f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:37.025632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db716772-d7d2-4a02-bd1d-40ea5a8df35f service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:37.035080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1127/2239] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:37.076201 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91344cef-419c-423f-a858-50d4505454e2 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:37.078095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-91344cef-419c-423f-a858-50d4505454e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:37.095839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91344cef-419c-423f-a858-50d4505454e2 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:37.109640 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:37.111441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:37.111441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:37.111441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] PATH_INFO: `/v3/projects/63f41c74f19e4ddab23f2ac519ee4968` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:37.113151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f41c74f19e4ddab23f2ac519ee4968)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:37.115336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:37.165321 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f41c74f19e4ddab23f2ac519ee4968', 'request_id': 'req-87a38b47-012b-401b-840b-d4cffaf4cd24'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:37.175758 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f41c74f19e4ddab23f2ac519ee4968', 'request_id': 'req-87a38b47-012b-401b-840b-d4cffaf4cd24'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:37.184466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f41c74f19e4ddab23f2ac519ee4968', 'request_id': 'req-87a38b47-012b-401b-840b-d4cffaf4cd24'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:37.195394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] The token cache is being invalidate because project 63f41c74f19e4ddab23f2ac519ee4968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:37.195856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:37.197029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:37.199776 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1113/2240] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:37 2022] DELETE /identity/v3/projects/63f41c74f19e4ddab23f2ac519ee4968 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:37.203670 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db716772-d7d2-4a02-bd1d-40ea5a8df35f service nova] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:37.215720 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db716772-d7d2-4a02-bd1d-40ea5a8df35f service nova] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:37.276925 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9d928-f4ff-46bc-89c1-16c4fdf6810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:37.277830 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9d928-f4ff-46bc-89c1-16c4fdf6810d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:37.278114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9d928-f4ff-46bc-89c1-16c4fdf6810d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:37.278390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9d928-f4ff-46bc-89c1-16c4fdf6810d admin admin] PATH_INFO: `/v3/users/0315da34fc4c412bbb74b7a867d0622f` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:37.279625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9d928-f4ff-46bc-89c1-16c4fdf6810d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0315da34fc4c412bbb74b7a867d0622f)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:37.281538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9d928-f4ff-46bc-89c1-16c4fdf6810d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:37.339546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-dba9d928-f4ff-46bc-89c1-16c4fdf6810d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0315da34fc4c412bbb74b7a867d0622f'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:37.347912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-dba9d928-f4ff-46bc-89c1-16c4fdf6810d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0315da34fc4c412bbb74b7a867d0622f'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:37.348620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-dba9d928-f4ff-46bc-89c1-16c4fdf6810d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0315da34fc4c412bbb74b7a867d0622f'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:37.360676 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-dba9d928-f4ff-46bc-89c1-16c4fdf6810d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0315da34fc4c412bbb74b7a867d0622f'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:37.375070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-dba9d928-f4ff-46bc-89c1-16c4fdf6810d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0315da34fc4c412bbb74b7a867d0622f'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:37.384290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1128/2241] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:37 2022] DELETE /identity/v3/users/0315da34fc4c412bbb74b7a867d0622f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:37.838373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:37.842561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:37.876179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a38b47-012b-401b-840b-d4cffaf4cd24 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:37.885749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0a9ab-4dcc-49df-8302-7cd2617261e8 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:37.886760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0a9ab-4dcc-49df-8302-7cd2617261e8 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:37.887350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0a9ab-4dcc-49df-8302-7cd2617261e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:37.936005 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ecf0a9ab-4dcc-49df-8302-7cd2617261e8 None None] MFA Rules not processed for user `a867bf12e73e40c0af1181241d659320`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:37.938431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ecf0a9ab-4dcc-49df-8302-7cd2617261e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:38.062411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6166737-a75a-43b2-8e17-849274a116d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:38.063841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6166737-a75a-43b2-8e17-849274a116d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:38.064267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6166737-a75a-43b2-8e17-849274a116d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:38.064718 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6166737-a75a-43b2-8e17-849274a116d8 admin admin] PATH_INFO: `/v3/projects/31f563c0ea9145f08526be252db0a2f3` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:38.066798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6166737-a75a-43b2-8e17-849274a116d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f563c0ea9145f08526be252db0a2f3)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:38.068137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1129/2242] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:38.069561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6166737-a75a-43b2-8e17-849274a116d8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:38.069784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015417b6-1fc6-4786-9c19-2083fa66ad40 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:38.070172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015417b6-1fc6-4786-9c19-2083fa66ad40 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:38.070790 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015417b6-1fc6-4786-9c19-2083fa66ad40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:38.097143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-015417b6-1fc6-4786-9c19-2083fa66ad40 None None] MFA Rules not processed for user `b555d88504ad4580a35d061b938c8d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:38.098563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-015417b6-1fc6-4786-9c19-2083fa66ad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:38.171082 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a6166737-a75a-43b2-8e17-849274a116d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f563c0ea9145f08526be252db0a2f3', 'request_id': 'req-a6166737-a75a-43b2-8e17-849274a116d8'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:38.178087 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a6166737-a75a-43b2-8e17-849274a116d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f563c0ea9145f08526be252db0a2f3', 'request_id': 'req-a6166737-a75a-43b2-8e17-849274a116d8'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:38.210546 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a6166737-a75a-43b2-8e17-849274a116d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f563c0ea9145f08526be252db0a2f3', 'request_id': 'req-a6166737-a75a-43b2-8e17-849274a116d8'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:38.223156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1130/2243] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:38.240598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a6166737-a75a-43b2-8e17-849274a116d8 admin admin] The token cache is being invalidate because project 31f563c0ea9145f08526be252db0a2f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:38.240944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a6166737-a75a-43b2-8e17-849274a116d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:38.241623 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a6166737-a75a-43b2-8e17-849274a116d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:38.251055 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1114/2244] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:37 2022] DELETE /identity/v3/projects/31f563c0ea9145f08526be252db0a2f3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:38.253333 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b9f0-bdbb-4fd9-9f79-194f10450bc0 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:38.253793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b9f0-bdbb-4fd9-9f79-194f10450bc0 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:38.254088 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48b9f0-bdbb-4fd9-9f79-194f10450bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:38.299856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-0b48b9f0-bdbb-4fd9-9f79-194f10450bc0 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:38.304702 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0b48b9f0-bdbb-4fd9-9f79-194f10450bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:38.445131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1131/2245] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:38.467306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140c263-8a6c-4a8f-97af-792a520d2fdc None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:38.467597 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140c263-8a6c-4a8f-97af-792a520d2fdc None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:38.467888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140c263-8a6c-4a8f-97af-792a520d2fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:38.501431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-0140c263-8a6c-4a8f-97af-792a520d2fdc None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:38.503193 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0140c263-8a6c-4a8f-97af-792a520d2fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:38.523520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48b9f0-bdbb-4fd9-9f79-194f10450bc0 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:38.534902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1115/2246] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:38.536297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48b9f0-bdbb-4fd9-9f79-194f10450bc0 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:38.542353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acdd99-07f1-4129-b613-faf0365277e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:38.543488 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acdd99-07f1-4129-b613-faf0365277e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:38.543784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acdd99-07f1-4129-b613-faf0365277e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:38.544409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acdd99-07f1-4129-b613-faf0365277e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:38.545227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acdd99-07f1-4129-b613-faf0365277e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:38.550028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acdd99-07f1-4129-b613-faf0365277e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:38.553083 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acdd99-07f1-4129-b613-faf0365277e5 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:38.575752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140c263-8a6c-4a8f-97af-792a520d2fdc None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:38.582080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1132/2247] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:38.586996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140c263-8a6c-4a8f-97af-792a520d2fdc None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:38.593494 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0c416-a05c-490c-b478-13e7e04bbde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:38.595367 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0c416-a05c-490c-b478-13e7e04bbde1 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:38.595665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0c416-a05c-490c-b478-13e7e04bbde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:38.595949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0c416-a05c-490c-b478-13e7e04bbde1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:38.597457 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0c416-a05c-490c-b478-13e7e04bbde1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:38.600159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0c416-a05c-490c-b478-13e7e04bbde1 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:38.657525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acdd99-07f1-4129-b613-faf0365277e5 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:38.668494 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1116/2248] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:38 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:38.670131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acdd99-07f1-4129-b613-faf0365277e5 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:38.834175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38e33-3ece-4c74-af0a-44afc9c7972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:38.836790 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38e33-3ece-4c74-af0a-44afc9c7972f admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:38.837332 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38e33-3ece-4c74-af0a-44afc9c7972f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:38.842066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38e33-3ece-4c74-af0a-44afc9c7972f admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:38.843123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f38e33-3ece-4c74-af0a-44afc9c7972f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:38.845327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f38e33-3ece-4c74-af0a-44afc9c7972f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:38.906016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1133/2249] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:38 2022] POST /identity/v3/users => generated 284 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:38.909357 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0c416-a05c-490c-b478-13e7e04bbde1 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:38.925317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0c416-a05c-490c-b478-13e7e04bbde1 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:38.936848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658de68-ea8f-44a3-847b-b603a74aaa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:38.938750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658de68-ea8f-44a3-847b-b603a74aaa4d admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:38.939308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658de68-ea8f-44a3-847b-b603a74aaa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:38.940872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658de68-ea8f-44a3-847b-b603a74aaa4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:38.942080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658de68-ea8f-44a3-847b-b603a74aaa4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:38.945407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658de68-ea8f-44a3-847b-b603a74aaa4d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:38.981780 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1117/2250] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:38.986085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38e33-3ece-4c74-af0a-44afc9c7972f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:39.000924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38e33-3ece-4c74-af0a-44afc9c7972f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:39.009062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3915c-f151-40ba-923c-ae30021f65af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:39.009914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3915c-f151-40ba-923c-ae30021f65af admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:39.010287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3915c-f151-40ba-923c-ae30021f65af admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:39.010761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3915c-f151-40ba-923c-ae30021f65af admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:39.012595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3915c-f151-40ba-923c-ae30021f65af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:39.022295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3915c-f151-40ba-923c-ae30021f65af admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:39.040961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658de68-ea8f-44a3-847b-b603a74aaa4d admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:39.049871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1134/2251] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:39.055478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658de68-ea8f-44a3-847b-b603a74aaa4d admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:39.063388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979c67a-e533-476a-807e-a56f30629dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:39.065813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979c67a-e533-476a-807e-a56f30629dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:39.066407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979c67a-e533-476a-807e-a56f30629dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:39.067537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979c67a-e533-476a-807e-a56f30629dd8 admin admin] PATH_INFO: `/v3/projects/73a324aa966c48aeaa8c83cecf211a09/users/46bf88a9adf0439d8119e235cdb16e83/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:39.094094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979c67a-e533-476a-807e-a56f30629dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a324aa966c48aeaa8c83cecf211a09, user_id=46bf88a9adf0439d8119e235cdb16e83, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:39.097476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979c67a-e533-476a-807e-a56f30629dd8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:39.124491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1118/2252] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:39 2022] PUT /identity/v3/projects/73a324aa966c48aeaa8c83cecf211a09/users/46bf88a9adf0439d8119e235cdb16e83/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:39.136508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffb419-5710-49c8-8b2d-43c7be0f12cb None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:39.136800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffb419-5710-49c8-8b2d-43c7be0f12cb None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:39.143392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffb419-5710-49c8-8b2d-43c7be0f12cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:39.177027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a6ffb419-5710-49c8-8b2d-43c7be0f12cb None None] MFA Rules not processed for user `46bf88a9adf0439d8119e235cdb16e83`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:39.178712 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a6ffb419-5710-49c8-8b2d-43c7be0f12cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:39.274170 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1135/2253] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:39.275732 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979c67a-e533-476a-807e-a56f30629dd8 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:39.442647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979c67a-e533-476a-807e-a56f30629dd8 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:39.462738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c4152-d9b4-4543-aeff-a008ed6dd30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:39.463445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c4152-d9b4-4543-aeff-a008ed6dd30f admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:39.463734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c4152-d9b4-4543-aeff-a008ed6dd30f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:39.464013 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c4152-d9b4-4543-aeff-a008ed6dd30f admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:39.464734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c4152-d9b4-4543-aeff-a008ed6dd30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:39.466658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c4152-d9b4-4543-aeff-a008ed6dd30f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:39.546935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1119/2254] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:39 2022] POST /identity/v3/projects => generated 365 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:39.551489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffb419-5710-49c8-8b2d-43c7be0f12cb None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:39.582103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffb419-5710-49c8-8b2d-43c7be0f12cb None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:39.876226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dd236-c98b-4a4a-9277-969b6cd1158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:39.876964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dd236-c98b-4a4a-9277-969b6cd1158a admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:39.877237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dd236-c98b-4a4a-9277-969b6cd1158a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:39.877533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dd236-c98b-4a4a-9277-969b6cd1158a admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:39.878610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dd236-c98b-4a4a-9277-969b6cd1158a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:39.880643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dd236-c98b-4a4a-9277-969b6cd1158a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:39.920920 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1136/2255] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:39 2022] POST /identity/v3/users => generated 289 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:39.924829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c4152-d9b4-4543-aeff-a008ed6dd30f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:39.937177 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c4152-d9b4-4543-aeff-a008ed6dd30f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:39.951504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b31db-1181-4bca-b526-81a90a73c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:39.953322 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b31db-1181-4bca-b526-81a90a73c94c admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:39.954151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b31db-1181-4bca-b526-81a90a73c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:39.954651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b31db-1181-4bca-b526-81a90a73c94c admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:39.956335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b31db-1181-4bca-b526-81a90a73c94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:39.958747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b31db-1181-4bca-b526-81a90a73c94c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:39.982780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dd236-c98b-4a4a-9277-969b6cd1158a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:39.988033 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1120/2256] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:39.999291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dd236-c98b-4a4a-9277-969b6cd1158a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:40.006612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32979d-5646-45c0-8238-c4fdbb935197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:40.009466 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32979d-5646-45c0-8238-c4fdbb935197 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:40.010059 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32979d-5646-45c0-8238-c4fdbb935197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:40.011052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32979d-5646-45c0-8238-c4fdbb935197 admin admin] PATH_INFO: `/v3/projects/58dba535d54c4930913fd1d5885ae151/users/7c30994b33ea4103a0127dd49f6281b4/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:40.037220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32979d-5646-45c0-8238-c4fdbb935197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58dba535d54c4930913fd1d5885ae151, user_id=7c30994b33ea4103a0127dd49f6281b4, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:40.042714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32979d-5646-45c0-8238-c4fdbb935197 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:40.093483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1137/2257] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:39 2022] PUT /identity/v3/projects/58dba535d54c4930913fd1d5885ae151/users/7c30994b33ea4103a0127dd49f6281b4/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:40.097051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b31db-1181-4bca-b526-81a90a73c94c admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:40.114883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b31db-1181-4bca-b526-81a90a73c94c admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:40.220961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4af9-f1f2-4128-afe4-265573ae3764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:40.234284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4af9-f1f2-4128-afe4-265573ae3764 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:40.237224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4af9-f1f2-4128-afe4-265573ae3764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:40.238417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4af9-f1f2-4128-afe4-265573ae3764 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:40.241090 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c4af9-f1f2-4128-afe4-265573ae3764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:40.244900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c4af9-f1f2-4128-afe4-265573ae3764 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:40.269418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1121/2258] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:40.271178 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32979d-5646-45c0-8238-c4fdbb935197 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:40.308095 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32979d-5646-45c0-8238-c4fdbb935197 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:40.335544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dce3f9-a34a-46bd-b63d-b20c00c3a6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:40.336758 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dce3f9-a34a-46bd-b63d-b20c00c3a6de admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:40.337362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dce3f9-a34a-46bd-b63d-b20c00c3a6de admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:40.338055 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dce3f9-a34a-46bd-b63d-b20c00c3a6de admin admin] PATH_INFO: `/v3/projects/58dba535d54c4930913fd1d5885ae151/users/7c30994b33ea4103a0127dd49f6281b4/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:40.349245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dce3f9-a34a-46bd-b63d-b20c00c3a6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=58dba535d54c4930913fd1d5885ae151, user_id=7c30994b33ea4103a0127dd49f6281b4, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:40.353743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dce3f9-a34a-46bd-b63d-b20c00c3a6de admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:40.389888 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1138/2259] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:40 2022] PUT /identity/v3/projects/58dba535d54c4930913fd1d5885ae151/users/7c30994b33ea4103a0127dd49f6281b4/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:40.395161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66534d78-4a6a-4ec0-b7c2-93d6e4ae473c None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:40.396294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66534d78-4a6a-4ec0-b7c2-93d6e4ae473c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:40.396945 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66534d78-4a6a-4ec0-b7c2-93d6e4ae473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:40.482790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-66534d78-4a6a-4ec0-b7c2-93d6e4ae473c None None] MFA Rules not processed for user `7c30994b33ea4103a0127dd49f6281b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:40.486098 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-66534d78-4a6a-4ec0-b7c2-93d6e4ae473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:40.691872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1122/2260] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:40.713058 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dce3f9-a34a-46bd-b63d-b20c00c3a6de admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:40.714883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-98dce3f9-a34a-46bd-b63d-b20c00c3a6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:40.988071 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dce3f9-a34a-46bd-b63d-b20c00c3a6de admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:40.998512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e8106-3ef7-4581-839e-5317705674b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:41.000649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e8106-3ef7-4581-839e-5317705674b4 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:41.000940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e8106-3ef7-4581-839e-5317705674b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:41.001268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e8106-3ef7-4581-839e-5317705674b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:41.028322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e8106-3ef7-4581-839e-5317705674b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:41.029807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e8106-3ef7-4581-839e-5317705674b4 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:41.056025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1139/2261] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:41.243291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66534d78-4a6a-4ec0-b7c2-93d6e4ae473c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:41.254812 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66534d78-4a6a-4ec0-b7c2-93d6e4ae473c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:41.259939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46dd6b-4f84-433a-8fbf-9432dfca68f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:41.260700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46dd6b-4f84-433a-8fbf-9432dfca68f9 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:41.261046 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46dd6b-4f84-433a-8fbf-9432dfca68f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:41.261275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46dd6b-4f84-433a-8fbf-9432dfca68f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:41.266611 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e8106-3ef7-4581-839e-5317705674b4 service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:41.269214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b21e8106-3ef7-4581-839e-5317705674b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:41.375617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46dd6b-4f84-433a-8fbf-9432dfca68f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:41.377047 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46dd6b-4f84-433a-8fbf-9432dfca68f9 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:41.384545 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e8106-3ef7-4581-839e-5317705674b4 service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:41.390599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65676f8d-45be-4e8b-901c-be1fe0b667ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:41.392458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65676f8d-45be-4e8b-901c-be1fe0b667ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:41.392671 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1123/2262] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:41.393679 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65676f8d-45be-4e8b-901c-be1fe0b667ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:41.394115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65676f8d-45be-4e8b-901c-be1fe0b667ac admin admin] PATH_INFO: `/v3/users/2b7a924cfaf244bab1acc93ec6ce02b3` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:41.394667 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46dd6b-4f84-433a-8fbf-9432dfca68f9 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:41.396114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65676f8d-45be-4e8b-901c-be1fe0b667ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7a924cfaf244bab1acc93ec6ce02b3)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:41.396227 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ff46dd6b-4f84-433a-8fbf-9432dfca68f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:41.399137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65676f8d-45be-4e8b-901c-be1fe0b667ac admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:41.429069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46dd6b-4f84-433a-8fbf-9432dfca68f9 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:41.443703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9c2e3-ea9b-4ba7-b720-50a83ab880fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:41.446140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9c2e3-ea9b-4ba7-b720-50a83ab880fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:41.449426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9c2e3-ea9b-4ba7-b720-50a83ab880fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:41.449821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9c2e3-ea9b-4ba7-b720-50a83ab880fe admin admin] PATH_INFO: `/v3/users/b21bcb3cc791407a89541d11fc883294` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:41.454383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9c2e3-ea9b-4ba7-b720-50a83ab880fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21bcb3cc791407a89541d11fc883294)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:41.465201 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9c2e3-ea9b-4ba7-b720-50a83ab880fe admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:41.529991 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-65676f8d-45be-4e8b-901c-be1fe0b667ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7a924cfaf244bab1acc93ec6ce02b3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:41.546508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-65676f8d-45be-4e8b-901c-be1fe0b667ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7a924cfaf244bab1acc93ec6ce02b3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:41.549616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-65676f8d-45be-4e8b-901c-be1fe0b667ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7a924cfaf244bab1acc93ec6ce02b3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:41.572287 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-65676f8d-45be-4e8b-901c-be1fe0b667ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7a924cfaf244bab1acc93ec6ce02b3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:41.589755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-65676f8d-45be-4e8b-901c-be1fe0b667ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7a924cfaf244bab1acc93ec6ce02b3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:41.606191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1140/2263] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:41 2022] DELETE /identity/v3/users/2b7a924cfaf244bab1acc93ec6ce02b3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:41.622132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-89a9c2e3-ea9b-4ba7-b720-50a83ab880fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21bcb3cc791407a89541d11fc883294'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:41.632975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-89a9c2e3-ea9b-4ba7-b720-50a83ab880fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21bcb3cc791407a89541d11fc883294'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:41.635968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14898da7-f9eb-4e43-9fb6-8e77bff4f32d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:41.642210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14898da7-f9eb-4e43-9fb6-8e77bff4f32d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:41.642504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14898da7-f9eb-4e43-9fb6-8e77bff4f32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:41.644200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-89a9c2e3-ea9b-4ba7-b720-50a83ab880fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21bcb3cc791407a89541d11fc883294'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:41.644965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-89a9c2e3-ea9b-4ba7-b720-50a83ab880fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21bcb3cc791407a89541d11fc883294'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:41.645637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-89a9c2e3-ea9b-4ba7-b720-50a83ab880fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21bcb3cc791407a89541d11fc883294'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:41.682074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1124/2264] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:41 2022] DELETE /identity/v3/users/b21bcb3cc791407a89541d11fc883294 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:41.687089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6652f2-b2d2-4c1c-ad24-7564f51db01a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:41.687401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6652f2-b2d2-4c1c-ad24-7564f51db01a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:41.687729 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6652f2-b2d2-4c1c-ad24-7564f51db01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:41.691074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-14898da7-f9eb-4e43-9fb6-8e77bff4f32d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:41.698018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-14898da7-f9eb-4e43-9fb6-8e77bff4f32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:41.732781 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-eb6652f2-b2d2-4c1c-ad24-7564f51db01a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:41.736944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-eb6652f2-b2d2-4c1c-ad24-7564f51db01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:41.870330 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1141/2265] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:41.912960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14898da7-f9eb-4e43-9fb6-8e77bff4f32d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:41.914487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-14898da7-f9eb-4e43-9fb6-8e77bff4f32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:41.921436 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1125/2266] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:41.996012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14898da7-f9eb-4e43-9fb6-8e77bff4f32d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:42.001246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225a121-15ca-4f5f-b9b6-fbf08df89714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:42.002063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225a121-15ca-4f5f-b9b6-fbf08df89714 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:42.002286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225a121-15ca-4f5f-b9b6-fbf08df89714 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:42.004039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6652f2-b2d2-4c1c-ad24-7564f51db01a None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:42.006103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-eb6652f2-b2d2-4c1c-ad24-7564f51db01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:42.010538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225a121-15ca-4f5f-b9b6-fbf08df89714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:42.055613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6652f2-b2d2-4c1c-ad24-7564f51db01a None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:42.077573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff0175-f995-453e-909c-92fbcc8a21fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:42.078429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0175-f995-453e-909c-92fbcc8a21fd service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:42.078542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0175-f995-453e-909c-92fbcc8a21fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:42.078810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0175-f995-453e-909c-92fbcc8a21fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:42.083951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225a121-15ca-4f5f-b9b6-fbf08df89714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:42.085736 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225a121-15ca-4f5f-b9b6-fbf08df89714 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:42.121453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff0175-f995-453e-909c-92fbcc8a21fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:42.123053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff0175-f995-453e-909c-92fbcc8a21fd service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:42.123865 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1142/2267] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:42.135844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1126/2268] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:42.262540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225a121-15ca-4f5f-b9b6-fbf08df89714 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:42.265338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c225a121-15ca-4f5f-b9b6-fbf08df89714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:42.393458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225a121-15ca-4f5f-b9b6-fbf08df89714 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:42.399786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c3921-2262-4593-bdd6-c2e5b48b043d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:42.400472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3921-2262-4593-bdd6-c2e5b48b043d service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:42.400901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3921-2262-4593-bdd6-c2e5b48b043d service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:42.401185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3921-2262-4593-bdd6-c2e5b48b043d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:42.404250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-585c3921-2262-4593-bdd6-c2e5b48b043d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:42.527062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c3921-2262-4593-bdd6-c2e5b48b043d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:42.528569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c3921-2262-4593-bdd6-c2e5b48b043d service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:42.539769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1143/2269] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:43.060513 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff0175-f995-453e-909c-92fbcc8a21fd service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:43.062109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-aeff0175-f995-453e-909c-92fbcc8a21fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:43.080259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff0175-f995-453e-909c-92fbcc8a21fd service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:43.089013 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:43.090470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:43.090754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:43.091078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece admin admin] PATH_INFO: `/v3/projects/a53c7e42df124428bf6332fc93021908` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:43.092535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53c7e42df124428bf6332fc93021908)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:43.094770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:43.180567 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53c7e42df124428bf6332fc93021908', 'request_id': 'req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:43.188943 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53c7e42df124428bf6332fc93021908', 'request_id': 'req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:43.203892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53c7e42df124428bf6332fc93021908', 'request_id': 'req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:43.220288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece admin admin] The token cache is being invalidate because project a53c7e42df124428bf6332fc93021908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:43.220625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:43.221322 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-c7af9be3-6dbf-4753-8f1a-c7dd1b1acece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:43.229135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1127/2270] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:43 2022] DELETE /identity/v3/projects/a53c7e42df124428bf6332fc93021908 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:43.229323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29bbee-36d9-4cad-94b1-31f903be8c0c None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:43.229770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29bbee-36d9-4cad-94b1-31f903be8c0c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:43.229770 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29bbee-36d9-4cad-94b1-31f903be8c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:43.263297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-dc29bbee-36d9-4cad-94b1-31f903be8c0c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:43.266907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-dc29bbee-36d9-4cad-94b1-31f903be8c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:43.394027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1144/2271] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:43.399404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc968b27-8966-45a6-a2d8-bc22e663872b None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:43.399695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc968b27-8966-45a6-a2d8-bc22e663872b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:43.399975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc968b27-8966-45a6-a2d8-bc22e663872b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:43.460627 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-fc968b27-8966-45a6-a2d8-bc22e663872b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:43.461881 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-fc968b27-8966-45a6-a2d8-bc22e663872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:43.520424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29bbee-36d9-4cad-94b1-31f903be8c0c None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:43.534755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29bbee-36d9-4cad-94b1-31f903be8c0c None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:43.535523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1128/2272] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:43.548016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fe948-28e4-4cac-b311-38d72f612b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:43.550591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fe948-28e4-4cac-b311-38d72f612b8b admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:43.560728 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fe948-28e4-4cac-b311-38d72f612b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:43.563199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fe948-28e4-4cac-b311-38d72f612b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:43.567099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fe948-28e4-4cac-b311-38d72f612b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:43.568531 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fe948-28e4-4cac-b311-38d72f612b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:43.579981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fe948-28e4-4cac-b311-38d72f612b8b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:43.616220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1145/2273] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:43.620434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc968b27-8966-45a6-a2d8-bc22e663872b None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:43.650607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc968b27-8966-45a6-a2d8-bc22e663872b None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:43.661939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1947a64-6eee-46f8-8d1a-472a4a69042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:43.662618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1947a64-6eee-46f8-8d1a-472a4a69042a admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:43.662907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1947a64-6eee-46f8-8d1a-472a4a69042a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:43.663172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1947a64-6eee-46f8-8d1a-472a4a69042a admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:43.663916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1947a64-6eee-46f8-8d1a-472a4a69042a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:43.666477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1947a64-6eee-46f8-8d1a-472a4a69042a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:43.690699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fe948-28e4-4cac-b311-38d72f612b8b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:43.692468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-946fe948-28e4-4cac-b311-38d72f612b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:43.710413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fe948-28e4-4cac-b311-38d72f612b8b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:43.716321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:43.717210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:43.717610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:43.718055 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7 admin admin] PATH_INFO: `/v3/projects/b89aab6be90c4a8aae0dde8ae28ab2d8` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:43.719295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89aab6be90c4a8aae0dde8ae28ab2d8)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:43.726121 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:43.731704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1129/2274] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:43 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:43.735405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1947a64-6eee-46f8-8d1a-472a4a69042a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:43.834016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89aab6be90c4a8aae0dde8ae28ab2d8', 'request_id': 'req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:43.844764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89aab6be90c4a8aae0dde8ae28ab2d8', 'request_id': 'req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:43.862961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89aab6be90c4a8aae0dde8ae28ab2d8', 'request_id': 'req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:43.872602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1947a64-6eee-46f8-8d1a-472a4a69042a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:43.885220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7 admin admin] The token cache is being invalidate because project b89aab6be90c4a8aae0dde8ae28ab2d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:43.885589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:43.887526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9f999e1e-7562-4ab9-b8f2-30d1e728c8e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:43.894196 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1146/2275] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:43 2022] DELETE /identity/v3/projects/b89aab6be90c4a8aae0dde8ae28ab2d8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:43.898185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f646a-cddb-4d84-b8c3-2c5ed15bfb05 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:43.898587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f646a-cddb-4d84-b8c3-2c5ed15bfb05 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:43.898965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f646a-cddb-4d84-b8c3-2c5ed15bfb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:43.925377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d43f646a-cddb-4d84-b8c3-2c5ed15bfb05 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:43.937193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d43f646a-cddb-4d84-b8c3-2c5ed15bfb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:44.005387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0aef6-40ac-4026-9103-fdbf91b86a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:44.006658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0aef6-40ac-4026-9103-fdbf91b86a9c admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.008038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0aef6-40ac-4026-9103-fdbf91b86a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.008827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0aef6-40ac-4026-9103-fdbf91b86a9c admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.010500 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0aef6-40ac-4026-9103-fdbf91b86a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:44.013428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0aef6-40ac-4026-9103-fdbf91b86a9c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:44.058695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1130/2276] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:43 2022] POST /identity/v3/users => generated 293 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:44.062575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0aef6-40ac-4026-9103-fdbf91b86a9c admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:44.066373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-38c0aef6-40ac-4026-9103-fdbf91b86a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:44.076424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1147/2277] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:44.079393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0aef6-40ac-4026-9103-fdbf91b86a9c admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:44.084834 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb2057-98a2-4709-b956-ef925e7b2534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:44.085453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83f2f-7691-48bd-a448-e83d1abd56c6 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.085890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb2057-98a2-4709-b956-ef925e7b2534 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.086322 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb2057-98a2-4709-b956-ef925e7b2534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.086438 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83f2f-7691-48bd-a448-e83d1abd56c6 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.086699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83f2f-7691-48bd-a448-e83d1abd56c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.087015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb2057-98a2-4709-b956-ef925e7b2534 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.087937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb2057-98a2-4709-b956-ef925e7b2534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:44.089711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb2057-98a2-4709-b956-ef925e7b2534 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:44.106066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1131/2278] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:44.107278 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb2057-98a2-4709-b956-ef925e7b2534 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:44.128320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-fcb83f2f-7691-48bd-a448-e83d1abd56c6 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:44.129819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fcb83f2f-7691-48bd-a448-e83d1abd56c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:44.133051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb2057-98a2-4709-b956-ef925e7b2534 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:44.149423 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c97603-9ec4-4506-b6e5-f24f79cbe545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:44.151890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97603-9ec4-4506-b6e5-f24f79cbe545 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.152478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97603-9ec4-4506-b6e5-f24f79cbe545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.160403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1148/2279] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:44.164336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb83f2f-7691-48bd-a448-e83d1abd56c6 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:44.167496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97603-9ec4-4506-b6e5-f24f79cbe545 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.168386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c97603-9ec4-4506-b6e5-f24f79cbe545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:44.170031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c97603-9ec4-4506-b6e5-f24f79cbe545 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:44.176723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb83f2f-7691-48bd-a448-e83d1abd56c6 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:44.182025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce988099-b4bf-473d-af8b-b3bf8192492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:44.182821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce988099-b4bf-473d-af8b-b3bf8192492c admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.183220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce988099-b4bf-473d-af8b-b3bf8192492c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.183610 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce988099-b4bf-473d-af8b-b3bf8192492c admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.184474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce988099-b4bf-473d-af8b-b3bf8192492c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:44.184883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce988099-b4bf-473d-af8b-b3bf8192492c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:44.186615 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce988099-b4bf-473d-af8b-b3bf8192492c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:44.196982 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1132/2280] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:44.200982 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c97603-9ec4-4506-b6e5-f24f79cbe545 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:44.204174 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1149/2281] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:44.208519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce988099-b4bf-473d-af8b-b3bf8192492c admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:44.218577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c97603-9ec4-4506-b6e5-f24f79cbe545 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:44.228168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046d3a-ab7d-4f49-b381-b65a4e1f859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:44.229300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046d3a-ab7d-4f49-b381-b65a4e1f859a admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.229784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046d3a-ab7d-4f49-b381-b65a4e1f859a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.230199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046d3a-ab7d-4f49-b381-b65a4e1f859a admin admin] PATH_INFO: `/v3/projects/ff8f7c5c81e5480280f70be8b7a6c883/users/ea013748647c4ac79f5785e402757148/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.232020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce988099-b4bf-473d-af8b-b3bf8192492c admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:44.245054 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46527ac-7a4f-4939-9a03-6e11a8d1ff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:44.246073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46527ac-7a4f-4939-9a03-6e11a8d1ff43 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.246688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46527ac-7a4f-4939-9a03-6e11a8d1ff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.247194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46527ac-7a4f-4939-9a03-6e11a8d1ff43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.248092 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46527ac-7a4f-4939-9a03-6e11a8d1ff43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:44.250290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46527ac-7a4f-4939-9a03-6e11a8d1ff43 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:44.276927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7046d3a-ab7d-4f49-b381-b65a4e1f859a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8f7c5c81e5480280f70be8b7a6c883, user_id=ea013748647c4ac79f5785e402757148, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:44.280172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7046d3a-ab7d-4f49-b381-b65a4e1f859a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:44.295452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1150/2282] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:44 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:44.298239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46527ac-7a4f-4939-9a03-6e11a8d1ff43 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:44.318466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1133/2283] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:44 2022] PUT /identity/v3/projects/ff8f7c5c81e5480280f70be8b7a6c883/users/ea013748647c4ac79f5785e402757148/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:44.330742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a60dd-2c5b-4c4f-b26b-b05236189fd9 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.331031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a60dd-2c5b-4c4f-b26b-b05236189fd9 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.331513 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a60dd-2c5b-4c4f-b26b-b05236189fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.390467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-4f4a60dd-2c5b-4c4f-b26b-b05236189fd9 None None] MFA Rules not processed for user `ea013748647c4ac79f5785e402757148`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:44.398875 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4f4a60dd-2c5b-4c4f-b26b-b05236189fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:44.402241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46527ac-7a4f-4939-9a03-6e11a8d1ff43 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:44.473425 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53e785-dd54-4fb5-93b5-ff4c29a2c516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:44.474395 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e785-dd54-4fb5-93b5-ff4c29a2c516 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.475010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e785-dd54-4fb5-93b5-ff4c29a2c516 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.475470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53e785-dd54-4fb5-93b5-ff4c29a2c516 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.476337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53e785-dd54-4fb5-93b5-ff4c29a2c516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:44.479438 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53e785-dd54-4fb5-93b5-ff4c29a2c516 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:44.510254 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1151/2284] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:44 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:44.514212 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53e785-dd54-4fb5-93b5-ff4c29a2c516 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:44.527105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53e785-dd54-4fb5-93b5-ff4c29a2c516 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:44.536116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1134/2285] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:44.542669 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a60dd-2c5b-4c4f-b26b-b05236189fd9 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:44.550498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee653df6-706b-4c64-8bf0-6a089e0f4c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:44.551390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee653df6-706b-4c64-8bf0-6a089e0f4c04 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.551620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee653df6-706b-4c64-8bf0-6a089e0f4c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.552148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee653df6-706b-4c64-8bf0-6a089e0f4c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.552832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee653df6-706b-4c64-8bf0-6a089e0f4c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:44.554648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee653df6-706b-4c64-8bf0-6a089e0f4c04 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:44.563987 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a60dd-2c5b-4c4f-b26b-b05236189fd9 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:44.571111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05747f04-7b7e-4622-b636-05baaab75b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:44.572045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05747f04-7b7e-4622-b636-05baaab75b58 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.572573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05747f04-7b7e-4622-b636-05baaab75b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.573252 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05747f04-7b7e-4622-b636-05baaab75b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.574453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05747f04-7b7e-4622-b636-05baaab75b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:44.576600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05747f04-7b7e-4622-b636-05baaab75b58 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:44.577966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1152/2286] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:44.582290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee653df6-706b-4c64-8bf0-6a089e0f4c04 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:44.613210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee653df6-706b-4c64-8bf0-6a089e0f4c04 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:44.620579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32d6ae-dabd-40af-b69e-80c9abe31de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:44.621605 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32d6ae-dabd-40af-b69e-80c9abe31de3 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.621937 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32d6ae-dabd-40af-b69e-80c9abe31de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.622218 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32d6ae-dabd-40af-b69e-80c9abe31de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.625661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32d6ae-dabd-40af-b69e-80c9abe31de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:44.625908 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1135/2287] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:44 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:44.626765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05747f04-7b7e-4622-b636-05baaab75b58 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:44.627094 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32d6ae-dabd-40af-b69e-80c9abe31de3 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:44.651681 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1153/2288] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:44.655749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32d6ae-dabd-40af-b69e-80c9abe31de3 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:44.675968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32d6ae-dabd-40af-b69e-80c9abe31de3 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:44.757842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05747f04-7b7e-4622-b636-05baaab75b58 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:44.790344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dc045-f635-44d5-9864-ccbbf4d81fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:44.791423 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dc045-f635-44d5-9864-ccbbf4d81fdc admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.792910 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dc045-f635-44d5-9864-ccbbf4d81fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.793431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dc045-f635-44d5-9864-ccbbf4d81fdc admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.797627 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dc045-f635-44d5-9864-ccbbf4d81fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:44.804367 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dc045-f635-44d5-9864-ccbbf4d81fdc admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:44.813701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d15b-d249-4175-b7aa-c875d44d07b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:44.815235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d15b-d249-4175-b7aa-c875d44d07b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.815933 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d15b-d249-4175-b7aa-c875d44d07b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.817842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d15b-d249-4175-b7aa-c875d44d07b2 admin admin] PATH_INFO: `/v3/projects/560db648dab442839d2eb34071a08c54/users/ceecfde315004240bcf5b6fea7d7d39d/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.837909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d15b-d249-4175-b7aa-c875d44d07b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560db648dab442839d2eb34071a08c54, user_id=ceecfde315004240bcf5b6fea7d7d39d, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:44.841138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d15b-d249-4175-b7aa-c875d44d07b2 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:44.855452 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1136/2289] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:44 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:44.859629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dc045-f635-44d5-9864-ccbbf4d81fdc admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:44.868232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1154/2290] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:44 2022] PUT /identity/v3/projects/560db648dab442839d2eb34071a08c54/users/ceecfde315004240bcf5b6fea7d7d39d/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:44.879886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff2536-80b0-4d24-ba44-e2d0ddd8758a None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:44.880341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff2536-80b0-4d24-ba44-e2d0ddd8758a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:44.880795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff2536-80b0-4d24-ba44-e2d0ddd8758a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:44.881926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dc045-f635-44d5-9864-ccbbf4d81fdc admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:44.958382 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-71ff2536-80b0-4d24-ba44-e2d0ddd8758a None None] MFA Rules not processed for user `ceecfde315004240bcf5b6fea7d7d39d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:44.959718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-71ff2536-80b0-4d24-ba44-e2d0ddd8758a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:45.020338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b4550-1faa-44d5-b78b-849eb92f91ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:45.021713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b4550-1faa-44d5-b78b-849eb92f91ea admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:45.022106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b4550-1faa-44d5-b78b-849eb92f91ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:45.022383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b4550-1faa-44d5-b78b-849eb92f91ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:45.023131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b4550-1faa-44d5-b78b-849eb92f91ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:45.029269 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b4550-1faa-44d5-b78b-849eb92f91ea admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:45.067465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1137/2291] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:45.071799 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1155/2292] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:45.071982 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b4550-1faa-44d5-b78b-849eb92f91ea admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:45.076540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff2536-80b0-4d24-ba44-e2d0ddd8758a None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:45.089515 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff2536-80b0-4d24-ba44-e2d0ddd8758a None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:45.094651 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e26b-a035-4e12-9f9d-95d48393387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:45.095160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b4550-1faa-44d5-b78b-849eb92f91ea admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:45.095577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e26b-a035-4e12-9f9d-95d48393387b admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:45.095861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e26b-a035-4e12-9f9d-95d48393387b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:45.096235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e26b-a035-4e12-9f9d-95d48393387b admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:45.097158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4e26b-a035-4e12-9f9d-95d48393387b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:45.099280 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4e26b-a035-4e12-9f9d-95d48393387b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:45.117916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89aec6-f3dd-4718-ab38-396e6b21d83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:45.118179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89aec6-f3dd-4718-ab38-396e6b21d83a admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:45.118356 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89aec6-f3dd-4718-ab38-396e6b21d83a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:45.120477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89aec6-f3dd-4718-ab38-396e6b21d83a admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:45.122509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89aec6-f3dd-4718-ab38-396e6b21d83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:45.124329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89aec6-f3dd-4718-ab38-396e6b21d83a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:45.154209 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1138/2293] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:45.154800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1156/2294] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:45 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:45.158690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89aec6-f3dd-4718-ab38-396e6b21d83a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:45.165799 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e26b-a035-4e12-9f9d-95d48393387b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:45.184815 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89aec6-f3dd-4718-ab38-396e6b21d83a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:45.302714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e26b-a035-4e12-9f9d-95d48393387b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:45.317582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1368bb-4e48-42af-845c-abd1e2bf8257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:45.317582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1368bb-4e48-42af-845c-abd1e2bf8257 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:45.317582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1368bb-4e48-42af-845c-abd1e2bf8257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:45.317582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1368bb-4e48-42af-845c-abd1e2bf8257 admin admin] PATH_INFO: `/v3/projects/dfbf2344e82c45468c0439907f17ba3d/users/0481f66c6d174c2aacbbe171e877a0a3/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:45.337585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1368bb-4e48-42af-845c-abd1e2bf8257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbf2344e82c45468c0439907f17ba3d, user_id=0481f66c6d174c2aacbbe171e877a0a3, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:45.340439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c991d-3871-4ebe-9f25-96cf5306b3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:45.342021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1368bb-4e48-42af-845c-abd1e2bf8257 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:45.343324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c991d-3871-4ebe-9f25-96cf5306b3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:45.343950 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c991d-3871-4ebe-9f25-96cf5306b3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:45.344544 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c991d-3871-4ebe-9f25-96cf5306b3c4 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:45.346541 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c991d-3871-4ebe-9f25-96cf5306b3c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:45.356364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c991d-3871-4ebe-9f25-96cf5306b3c4 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:45.372815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1157/2295] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:45 2022] PUT /identity/v3/projects/dfbf2344e82c45468c0439907f17ba3d/users/0481f66c6d174c2aacbbe171e877a0a3/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:45.387520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f4dea-38c8-443d-9710-b26c4534150e None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:45.387825 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f4dea-38c8-443d-9710-b26c4534150e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:45.388111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f4dea-38c8-443d-9710-b26c4534150e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:45.390771 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1139/2296] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:45 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:45.394565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c991d-3871-4ebe-9f25-96cf5306b3c4 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:45.409153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c991d-3871-4ebe-9f25-96cf5306b3c4 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:45.463128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-c00f4dea-38c8-443d-9710-b26c4534150e None None] MFA Rules not processed for user `0481f66c6d174c2aacbbe171e877a0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:45.465557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c00f4dea-38c8-443d-9710-b26c4534150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:45.563945 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2821c-6ff6-4f83-b301-1342f70592ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:45.564624 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2821c-6ff6-4f83-b301-1342f70592ae admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:45.565696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2821c-6ff6-4f83-b301-1342f70592ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:45.565976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2821c-6ff6-4f83-b301-1342f70592ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:45.566723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2821c-6ff6-4f83-b301-1342f70592ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:45.568442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2821c-6ff6-4f83-b301-1342f70592ae admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:45.595104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1140/2297] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:45.600035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9732d1-5c8f-43b2-95aa-6bf8a0d2ba81 None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:45.600035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9732d1-5c8f-43b2-95aa-6bf8a0d2ba81 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:45.606006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9732d1-5c8f-43b2-95aa-6bf8a0d2ba81 None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:45.606006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1141/2298] 10.222.0.73 () {54 vars in 921 bytes} [Wed May 4 13:49:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:49:45.606006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9732d1-5c8f-43b2-95aa-6bf8a0d2ba81 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:45.644179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1158/2299] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:45.647856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e95c99-f066-4835-85da-abe6ca4e0715 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:45.648230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e95c99-f066-4835-85da-abe6ca4e0715 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:45.648693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e95c99-f066-4835-85da-abe6ca4e0715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:45.662846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9732d1-5c8f-43b2-95aa-6bf8a0d2ba81 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:45.682695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669564-a94c-4b1d-984f-99ce64ca1ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:45.683857 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669564-a94c-4b1d-984f-99ce64ca1ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:45.684353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669564-a94c-4b1d-984f-99ce64ca1ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:45.685108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32669564-a94c-4b1d-984f-99ce64ca1ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:45.685934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32669564-a94c-4b1d-984f-99ce64ca1ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:45.687686 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32669564-a94c-4b1d-984f-99ce64ca1ed3 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:45.705449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-68e95c99-f066-4835-85da-abe6ca4e0715 None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:45.707034 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-68e95c99-f066-4835-85da-abe6ca4e0715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:45.711320 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1142/2300] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:45.723976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669564-a94c-4b1d-984f-99ce64ca1ed3 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:45.749786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32669564-a94c-4b1d-984f-99ce64ca1ed3 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:45.766369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de399d-6d34-44be-8185-b922d2f6ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:45.766369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de399d-6d34-44be-8185-b922d2f6ae01 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:45.766369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de399d-6d34-44be-8185-b922d2f6ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:45.766369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de399d-6d34-44be-8185-b922d2f6ae01 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:45.767027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de399d-6d34-44be-8185-b922d2f6ae01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:45.767027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de399d-6d34-44be-8185-b922d2f6ae01 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:45.829169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1143/2301] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:45 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:45.829930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de399d-6d34-44be-8185-b922d2f6ae01 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:45.900926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1159/2302] 10.222.0.73 () {58 vars in 1018 bytes} [Wed May 4 13:49:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:45.906948 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e95c99-f066-4835-85da-abe6ca4e0715 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:45.920855 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e95c99-f066-4835-85da-abe6ca4e0715 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:45.970468 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de399d-6d34-44be-8185-b922d2f6ae01 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:45.978923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde68bbb-e78e-4a97-862e-72e897d7b092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:45.980113 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde68bbb-e78e-4a97-862e-72e897d7b092 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:45.980413 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde68bbb-e78e-4a97-862e-72e897d7b092 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:45.980684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde68bbb-e78e-4a97-862e-72e897d7b092 admin admin] PATH_INFO: `/v3/projects/103de5b1e74c4abea95782852316efbe/users/9e9974d0483b41c5b17e5a20f826b1fb/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.007961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde68bbb-e78e-4a97-862e-72e897d7b092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103de5b1e74c4abea95782852316efbe, user_id=9e9974d0483b41c5b17e5a20f826b1fb, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:46.011131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde68bbb-e78e-4a97-862e-72e897d7b092 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:46.031260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1144/2303] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:45 2022] PUT /identity/v3/projects/103de5b1e74c4abea95782852316efbe/users/9e9974d0483b41c5b17e5a20f826b1fb/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:46.031260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde68bbb-e78e-4a97-862e-72e897d7b092 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:46.031260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cde68bbb-e78e-4a97-862e-72e897d7b092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:46.032854 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45ee3-16e2-46c9-9b2d-dbf37a3e7845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:46.034328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45ee3-16e2-46c9-9b2d-dbf37a3e7845 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:46.034753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45ee3-16e2-46c9-9b2d-dbf37a3e7845 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:46.035169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45ee3-16e2-46c9-9b2d-dbf37a3e7845 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.041578 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b45ee3-16e2-46c9-9b2d-dbf37a3e7845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:46.045946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b45ee3-16e2-46c9-9b2d-dbf37a3e7845 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:46.083866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1160/2304] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:45 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:46.085716 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de486cf-c926-452b-8bda-e66b67e90c59 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:46.086261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de486cf-c926-452b-8bda-e66b67e90c59 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:46.086823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de486cf-c926-452b-8bda-e66b67e90c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.141147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-1de486cf-c926-452b-8bda-e66b67e90c59 None None] MFA Rules not processed for user `9e9974d0483b41c5b17e5a20f826b1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:46.142372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1de486cf-c926-452b-8bda-e66b67e90c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:46.165010 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde68bbb-e78e-4a97-862e-72e897d7b092 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:46.179458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc0abf-0831-4703-993c-d82899276685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:46.180334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc0abf-0831-4703-993c-d82899276685 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:46.180623 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc0abf-0831-4703-993c-d82899276685 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:46.181346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc0abf-0831-4703-993c-d82899276685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.229569 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc0abf-0831-4703-993c-d82899276685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:46.232417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc0abf-0831-4703-993c-d82899276685 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:46.266766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1145/2305] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:46.267760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc0abf-0831-4703-993c-d82899276685 service nova] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:46.399696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1161/2306] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:46.401185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de486cf-c926-452b-8bda-e66b67e90c59 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:46.430951 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc0abf-0831-4703-993c-d82899276685 service nova] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:46.454741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c6530-6abb-4005-9fcf-07d83580cd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:46.455986 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c6530-6abb-4005-9fcf-07d83580cd8f admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:46.456270 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c6530-6abb-4005-9fcf-07d83580cd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:46.456542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c6530-6abb-4005-9fcf-07d83580cd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.457699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c6530-6abb-4005-9fcf-07d83580cd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:46.458878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c6530-6abb-4005-9fcf-07d83580cd8f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:46.485821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1146/2307] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:46.490114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c6530-6abb-4005-9fcf-07d83580cd8f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:46.501238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de486cf-c926-452b-8bda-e66b67e90c59 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:46.506686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f799a-fe7a-47d5-9040-246be6226f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:46.507404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f799a-fe7a-47d5-9040-246be6226f3b admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:46.508219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f799a-fe7a-47d5-9040-246be6226f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:46.508482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f799a-fe7a-47d5-9040-246be6226f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.509172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f799a-fe7a-47d5-9040-246be6226f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:46.516772 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f799a-fe7a-47d5-9040-246be6226f3b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:46.523903 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c6530-6abb-4005-9fcf-07d83580cd8f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:46.539338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bafd-7aa0-4db2-a6a0-6599f5849754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:46.540234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bafd-7aa0-4db2-a6a0-6599f5849754 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:46.540520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bafd-7aa0-4db2-a6a0-6599f5849754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:46.541784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bafd-7aa0-4db2-a6a0-6599f5849754 admin admin] PATH_INFO: `/v3/projects/d04c7b60c27d4aef98ec8d00604e3001/users/d22cd5dd7aef49d889a3b390aa35116b/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.556176 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1162/2308] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:46 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:46.559915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f799a-fe7a-47d5-9040-246be6226f3b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:46.597104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3bafd-7aa0-4db2-a6a0-6599f5849754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04c7b60c27d4aef98ec8d00604e3001, user_id=d22cd5dd7aef49d889a3b390aa35116b, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:46.600571 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3bafd-7aa0-4db2-a6a0-6599f5849754 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:46.627280 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1147/2309] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:46 2022] PUT /identity/v3/projects/d04c7b60c27d4aef98ec8d00604e3001/users/d22cd5dd7aef49d889a3b390aa35116b/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:46.629162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bafd-7aa0-4db2-a6a0-6599f5849754 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:46.665910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f799a-fe7a-47d5-9040-246be6226f3b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:46.722559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bafd-7aa0-4db2-a6a0-6599f5849754 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:46.732346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b9223-51a3-43d9-b4db-286e6c3439d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:46.733604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b9223-51a3-43d9-b4db-286e6c3439d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:46.734223 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b9223-51a3-43d9-b4db-286e6c3439d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:46.734454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b9223-51a3-43d9-b4db-286e6c3439d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.735267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b9223-51a3-43d9-b4db-286e6c3439d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:46.737171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b9223-51a3-43d9-b4db-286e6c3439d7 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:46.756077 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bb7e8-7386-4845-b0de-9cc5d737fd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:46.761669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bb7e8-7386-4845-b0de-9cc5d737fd47 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:46.762202 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bb7e8-7386-4845-b0de-9cc5d737fd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:46.762503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bb7e8-7386-4845-b0de-9cc5d737fd47 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.763600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bb7e8-7386-4845-b0de-9cc5d737fd47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:46.764657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1148/2310] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:46.765897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bb7e8-7386-4845-b0de-9cc5d737fd47 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:46.766105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b9223-51a3-43d9-b4db-286e6c3439d7 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:46.783492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b9223-51a3-43d9-b4db-286e6c3439d7 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:46.792028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fd971-d5db-490d-942f-4aeb33125108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:46.792716 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1163/2311] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:46 2022] POST /identity/v3/users => generated 294 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:46.793364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fd971-d5db-490d-942f-4aeb33125108 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:46.793809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fd971-d5db-490d-942f-4aeb33125108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:46.794220 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fd971-d5db-490d-942f-4aeb33125108 admin admin] PATH_INFO: `/v3/projects/d04c7b60c27d4aef98ec8d00604e3001/users/d22cd5dd7aef49d889a3b390aa35116b/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.797083 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bb7e8-7386-4845-b0de-9cc5d737fd47 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:46.797762 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fd971-d5db-490d-942f-4aeb33125108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04c7b60c27d4aef98ec8d00604e3001, user_id=d22cd5dd7aef49d889a3b390aa35116b, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:46.800717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fd971-d5db-490d-942f-4aeb33125108 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:46.811738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1149/2312] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:46 2022] PUT /identity/v3/projects/d04c7b60c27d4aef98ec8d00604e3001/users/d22cd5dd7aef49d889a3b390aa35116b/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:46.814499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bb7e8-7386-4845-b0de-9cc5d737fd47 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:46.822910 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f034d-f259-430a-b05b-16a1c8cff4a6 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:46.823298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f034d-f259-430a-b05b-16a1c8cff4a6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:46.823597 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f034d-f259-430a-b05b-16a1c8cff4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.866236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-0b3f034d-f259-430a-b05b-16a1c8cff4a6 None None] MFA Rules not processed for user `d22cd5dd7aef49d889a3b390aa35116b`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:46.868023 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0b3f034d-f259-430a-b05b-16a1c8cff4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:46.922793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080fa24-c58b-4684-8e8b-4396f9bc88b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:46.923633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080fa24-c58b-4684-8e8b-4396f9bc88b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:46.923923 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080fa24-c58b-4684-8e8b-4396f9bc88b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:46.924899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080fa24-c58b-4684-8e8b-4396f9bc88b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.925692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080fa24-c58b-4684-8e8b-4396f9bc88b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:46.927440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080fa24-c58b-4684-8e8b-4396f9bc88b0 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:46.941064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1164/2313] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:46.945116 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080fa24-c58b-4684-8e8b-4396f9bc88b0 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:46.954278 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1150/2314] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:46.962070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080fa24-c58b-4684-8e8b-4396f9bc88b0 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:46.966628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc548fd-698e-46e9-958a-9066e0c35a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:46.967542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc548fd-698e-46e9-958a-9066e0c35a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:46.967829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc548fd-698e-46e9-958a-9066e0c35a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:46.968097 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc548fd-698e-46e9-958a-9066e0c35a18 admin admin] PATH_INFO: `/v3/projects/b860a733ccd041c1b147d68c7dbbb948/users/94c9baf3c226417e807cdb8456d0f863/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:46.968731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f034d-f259-430a-b05b-16a1c8cff4a6 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:46.973669 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0b3f034d-f259-430a-b05b-16a1c8cff4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:46.984062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc548fd-698e-46e9-958a-9066e0c35a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b860a733ccd041c1b147d68c7dbbb948, user_id=94c9baf3c226417e807cdb8456d0f863, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:46.987388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc548fd-698e-46e9-958a-9066e0c35a18 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:47.002469 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1165/2315] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:46 2022] PUT /identity/v3/projects/b860a733ccd041c1b147d68c7dbbb948/users/94c9baf3c226417e807cdb8456d0f863/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:47.006786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc548fd-698e-46e9-958a-9066e0c35a18 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:47.043365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f034d-f259-430a-b05b-16a1c8cff4a6 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:47.092229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc548fd-698e-46e9-958a-9066e0c35a18 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:47.097684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326eb56-f306-415a-9465-190608c8e67e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:47.098214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc356c-fbb7-418f-97d6-2c60b6347e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:47.098340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326eb56-f306-415a-9465-190608c8e67e service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:47.098803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326eb56-f306-415a-9465-190608c8e67e service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:47.098923 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc356c-fbb7-418f-97d6-2c60b6347e12 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:47.099175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326eb56-f306-415a-9465-190608c8e67e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:47.099303 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc356c-fbb7-418f-97d6-2c60b6347e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:47.099673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc356c-fbb7-418f-97d6-2c60b6347e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:47.100497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc356c-fbb7-418f-97d6-2c60b6347e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:47.102370 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc356c-fbb7-418f-97d6-2c60b6347e12 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:47.115822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1166/2316] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:47.119842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc356c-fbb7-418f-97d6-2c60b6347e12 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:47.130736 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc356c-fbb7-418f-97d6-2c60b6347e12 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:47.135648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0acfd-b907-4864-bb46-78f3b4047c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:47.136542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0acfd-b907-4864-bb46-78f3b4047c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:47.136897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0acfd-b907-4864-bb46-78f3b4047c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:47.137238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0acfd-b907-4864-bb46-78f3b4047c34 admin admin] PATH_INFO: `/v3/projects/b860a733ccd041c1b147d68c7dbbb948/users/94c9baf3c226417e807cdb8456d0f863/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:47.139494 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0acfd-b907-4864-bb46-78f3b4047c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b860a733ccd041c1b147d68c7dbbb948, user_id=94c9baf3c226417e807cdb8456d0f863, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:47.142337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0acfd-b907-4864-bb46-78f3b4047c34 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:47.155936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1167/2317] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:47 2022] PUT /identity/v3/projects/b860a733ccd041c1b147d68c7dbbb948/users/94c9baf3c226417e807cdb8456d0f863/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:47.165667 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326eb56-f306-415a-9465-190608c8e67e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:47.167117 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326eb56-f306-415a-9465-190608c8e67e service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:47.167606 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4cd52-e103-4eea-9704-436b11ceae79 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:47.167908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4cd52-e103-4eea-9704-436b11ceae79 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:47.168191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4cd52-e103-4eea-9704-436b11ceae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:47.176568 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1151/2318] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:47.197460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-c9a4cd52-e103-4eea-9704-436b11ceae79 None None] MFA Rules not processed for user `94c9baf3c226417e807cdb8456d0f863`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:47.198794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c9a4cd52-e103-4eea-9704-436b11ceae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:47.265864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1168/2319] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:47.277533 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326eb56-f306-415a-9465-190608c8e67e service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:47.279031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9326eb56-f306-415a-9465-190608c8e67e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:47.290397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326eb56-f306-415a-9465-190608c8e67e service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:47.344077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd4167-c667-4478-a75b-5cd6e1598d69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:47.344729 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd4167-c667-4478-a75b-5cd6e1598d69 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:47.345010 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd4167-c667-4478-a75b-5cd6e1598d69 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:47.345282 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd4167-c667-4478-a75b-5cd6e1598d69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:47.408342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd4167-c667-4478-a75b-5cd6e1598d69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:47.410483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd4167-c667-4478-a75b-5cd6e1598d69 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:47.431367 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1152/2320] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:47.815975 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4cd52-e103-4eea-9704-436b11ceae79 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:47.817115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c9a4cd52-e103-4eea-9704-436b11ceae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:47.892369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4cd52-e103-4eea-9704-436b11ceae79 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:47.897607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef399b-697e-4d22-b80e-c76523dad048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:47.898584 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef399b-697e-4d22-b80e-c76523dad048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:47.898861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef399b-697e-4d22-b80e-c76523dad048 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:47.899129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef399b-697e-4d22-b80e-c76523dad048 admin admin] PATH_INFO: `/v3/users/46bf88a9adf0439d8119e235cdb16e83` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:47.900502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef399b-697e-4d22-b80e-c76523dad048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46bf88a9adf0439d8119e235cdb16e83)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:47.902393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef399b-697e-4d22-b80e-c76523dad048 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:47.950406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bcef399b-697e-4d22-b80e-c76523dad048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46bf88a9adf0439d8119e235cdb16e83'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:47.959377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bcef399b-697e-4d22-b80e-c76523dad048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46bf88a9adf0439d8119e235cdb16e83'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:47.960327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bcef399b-697e-4d22-b80e-c76523dad048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46bf88a9adf0439d8119e235cdb16e83'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:47.968254 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bcef399b-697e-4d22-b80e-c76523dad048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46bf88a9adf0439d8119e235cdb16e83'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:47.978672 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd4167-c667-4478-a75b-5cd6e1598d69 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:47.980447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cddd4167-c667-4478-a75b-5cd6e1598d69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:47.986003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bcef399b-697e-4d22-b80e-c76523dad048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46bf88a9adf0439d8119e235cdb16e83'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.000611 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1169/2321] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:47 2022] DELETE /identity/v3/users/46bf88a9adf0439d8119e235cdb16e83 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:48.005516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15089c-f123-4488-8458-0e6bd2c661ea None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:48.005918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15089c-f123-4488-8458-0e6bd2c661ea None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:48.006261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15089c-f123-4488-8458-0e6bd2c661ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:48.006552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd4167-c667-4478-a75b-5cd6e1598d69 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:48.024781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-3d15089c-f123-4488-8458-0e6bd2c661ea None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:48.026126 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3d15089c-f123-4488-8458-0e6bd2c661ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:48.067495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d556a92-387d-42bf-a760-c519b3fb35b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:48.068363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556a92-387d-42bf-a760-c519b3fb35b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:48.068643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556a92-387d-42bf-a760-c519b3fb35b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:48.068915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d556a92-387d-42bf-a760-c519b3fb35b3 admin admin] PATH_INFO: `/v3/users/da85a83db1d14431b84da40016646765` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:48.070115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d556a92-387d-42bf-a760-c519b3fb35b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da85a83db1d14431b84da40016646765)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:48.072181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d556a92-387d-42bf-a760-c519b3fb35b3 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:48.088649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1170/2322] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:48.098379 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15089c-f123-4488-8458-0e6bd2c661ea None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:48.099715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3d15089c-f123-4488-8458-0e6bd2c661ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:48.118993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1d556a92-387d-42bf-a760-c519b3fb35b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da85a83db1d14431b84da40016646765'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.126011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1d556a92-387d-42bf-a760-c519b3fb35b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da85a83db1d14431b84da40016646765'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.133344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1d556a92-387d-42bf-a760-c519b3fb35b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da85a83db1d14431b84da40016646765'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.133914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1d556a92-387d-42bf-a760-c519b3fb35b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da85a83db1d14431b84da40016646765'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.134512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1d556a92-387d-42bf-a760-c519b3fb35b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da85a83db1d14431b84da40016646765'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.150810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1153/2323] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:47 2022] DELETE /identity/v3/users/da85a83db1d14431b84da40016646765 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:48.155043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de267b6-f41e-457e-a17c-100caa9d133e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:48.155361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de267b6-f41e-457e-a17c-100caa9d133e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:48.155523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15089c-f123-4488-8458-0e6bd2c661ea None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:48.155626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de267b6-f41e-457e-a17c-100caa9d133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:48.171700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-2de267b6-f41e-457e-a17c-100caa9d133e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:48.172887 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2de267b6-f41e-457e-a17c-100caa9d133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:48.203682 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80021b9-dd68-48b6-8dd4-648f7f9c61ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:48.204330 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80021b9-dd68-48b6-8dd4-648f7f9c61ef service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:48.204607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80021b9-dd68-48b6-8dd4-648f7f9c61ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:48.204880 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80021b9-dd68-48b6-8dd4-648f7f9c61ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:48.206677 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f80021b9-dd68-48b6-8dd4-648f7f9c61ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:48.231465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1154/2324] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:48.241561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de267b6-f41e-457e-a17c-100caa9d133e None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:48.242854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2de267b6-f41e-457e-a17c-100caa9d133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:48.254860 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de267b6-f41e-457e-a17c-100caa9d133e None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:48.258489 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf4810-c2a9-43af-bd3f-d6dc888ab8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:48.259145 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf4810-c2a9-43af-bd3f-d6dc888ab8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:48.259457 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf4810-c2a9-43af-bd3f-d6dc888ab8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:48.259732 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf4810-c2a9-43af-bd3f-d6dc888ab8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:48.267331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80021b9-dd68-48b6-8dd4-648f7f9c61ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:48.268718 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf4810-c2a9-43af-bd3f-d6dc888ab8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:48.268830 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80021b9-dd68-48b6-8dd4-648f7f9c61ef service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:48.270126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf4810-c2a9-43af-bd3f-d6dc888ab8f4 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:48.278241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1171/2325] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:48.279964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1155/2326] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:48.553645 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80021b9-dd68-48b6-8dd4-648f7f9c61ef service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:48.555551 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f80021b9-dd68-48b6-8dd4-648f7f9c61ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:48.583903 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80021b9-dd68-48b6-8dd4-648f7f9c61ef service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:48.589535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:48.590547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:48.590909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:48.591229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] PATH_INFO: `/v3/projects/162582ed0f614e74acc662dd183bb53b` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:48.592591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=162582ed0f614e74acc662dd183bb53b)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:48.594849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:48.636774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf4810-c2a9-43af-bd3f-d6dc888ab8f4 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:48.638711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1acf4810-c2a9-43af-bd3f-d6dc888ab8f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:48.652988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf4810-c2a9-43af-bd3f-d6dc888ab8f4 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:48.671199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162582ed0f614e74acc662dd183bb53b', 'request_id': 'req-d47fdbd2-87f4-45db-a97a-42c598c4e153'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.682251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162582ed0f614e74acc662dd183bb53b', 'request_id': 'req-d47fdbd2-87f4-45db-a97a-42c598c4e153'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.710309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162582ed0f614e74acc662dd183bb53b', 'request_id': 'req-d47fdbd2-87f4-45db-a97a-42c598c4e153'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.724464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] The token cache is being invalidate because project 162582ed0f614e74acc662dd183bb53b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:48.724752 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.725537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.727431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1172/2327] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:48 2022] DELETE /identity/v3/projects/162582ed0f614e74acc662dd183bb53b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:48.731586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:48.732828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:48.741009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:48.741009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:48.741009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:48.741009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] PATH_INFO: `/v3/projects/73a324aa966c48aeaa8c83cecf211a09` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:48.741445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73a324aa966c48aeaa8c83cecf211a09)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:48.742520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:48.752498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fdbd2-87f4-45db-a97a-42c598c4e153 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:48.758017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:48.758899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:48.759185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:48.759506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] PATH_INFO: `/v3/users/9d8a675bd94d426c903f1835b87445a8` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:48.760842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d8a675bd94d426c903f1835b87445a8)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:48.762808 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:48.807479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73a324aa966c48aeaa8c83cecf211a09', 'request_id': 'req-62aaace2-e5ca-4bdd-9349-827f12b590c6'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.816177 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73a324aa966c48aeaa8c83cecf211a09', 'request_id': 'req-62aaace2-e5ca-4bdd-9349-827f12b590c6'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.821627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d8a675bd94d426c903f1835b87445a8'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.826431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73a324aa966c48aeaa8c83cecf211a09', 'request_id': 'req-62aaace2-e5ca-4bdd-9349-827f12b590c6'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.833326 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d8a675bd94d426c903f1835b87445a8'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.834063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d8a675bd94d426c903f1835b87445a8'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.839126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] The token cache is being invalidate because project 73a324aa966c48aeaa8c83cecf211a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:48.839375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.840075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.844732 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1156/2328] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:48 2022] DELETE /identity/v3/projects/73a324aa966c48aeaa8c83cecf211a09 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:48.844864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d8a675bd94d426c903f1835b87445a8'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.844949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:48.844949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:48.856430 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d8a675bd94d426c903f1835b87445a8'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:48.864168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1173/2329] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:48 2022] DELETE /identity/v3/users/9d8a675bd94d426c903f1835b87445a8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:48.864998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:48.866322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:48.918281 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aaace2-e5ca-4bdd-9349-827f12b590c6 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:48.978954 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03962fd4-01dd-4fd2-aa5a-e4eafffd90ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:48.980079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03962fd4-01dd-4fd2-aa5a-e4eafffd90ca service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:48.980079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03962fd4-01dd-4fd2-aa5a-e4eafffd90ca service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:48.980338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03962fd4-01dd-4fd2-aa5a-e4eafffd90ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:48.983060 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-03962fd4-01dd-4fd2-aa5a-e4eafffd90ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:49.010237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6882bf-3afe-4339-9730-6db64fd9b97e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:49.032887 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:49.034743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:49.035178 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:49.035487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] PATH_INFO: `/v3/users/7c30994b33ea4103a0127dd49f6281b4` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:49.042884 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c30994b33ea4103a0127dd49f6281b4)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:49.045805 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:49.060922 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03962fd4-01dd-4fd2-aa5a-e4eafffd90ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:49.063365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03962fd4-01dd-4fd2-aa5a-e4eafffd90ca service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:49.076420 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1157/2330] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:49.113622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03962fd4-01dd-4fd2-aa5a-e4eafffd90ca service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:49.115417 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-03962fd4-01dd-4fd2-aa5a-e4eafffd90ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:49.137818 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03962fd4-01dd-4fd2-aa5a-e4eafffd90ca service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:49.147534 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a33e-d172-4bab-929d-b6f3b1484167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:49.149500 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a33e-d172-4bab-929d-b6f3b1484167 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:49.149785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a33e-d172-4bab-929d-b6f3b1484167 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:49.150064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a33e-d172-4bab-929d-b6f3b1484167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:49.156129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4cb1a33e-d172-4bab-929d-b6f3b1484167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:49.169568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c30994b33ea4103a0127dd49f6281b4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:49.197859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c30994b33ea4103a0127dd49f6281b4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:49.198485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c30994b33ea4103a0127dd49f6281b4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:49.208558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c30994b33ea4103a0127dd49f6281b4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:49.235072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c30994b33ea4103a0127dd49f6281b4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:49.244378 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1174/2331] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:48 2022] DELETE /identity/v3/users/7c30994b33ea4103a0127dd49f6281b4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:49.263872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1a33e-d172-4bab-929d-b6f3b1484167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:49.265460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1a33e-d172-4bab-929d-b6f3b1484167 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:49.276509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1158/2332] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:50.071956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:50.073848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a33e-d172-4bab-929d-b6f3b1484167 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:50.076928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4cb1a33e-d172-4bab-929d-b6f3b1484167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:50.077926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:50.102789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a33e-d172-4bab-929d-b6f3b1484167 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:50.195178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8933658-0ede-4ccf-9253-9cb8deeac09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:50.196265 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8933658-0ede-4ccf-9253-9cb8deeac09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.196728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8933658-0ede-4ccf-9253-9cb8deeac09b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.197100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8933658-0ede-4ccf-9253-9cb8deeac09b admin admin] PATH_INFO: `/v3/projects/54ec7148c9484278aecd2d12cc12c622` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.198976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8933658-0ede-4ccf-9253-9cb8deeac09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ec7148c9484278aecd2d12cc12c622)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:50.201020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8933658-0ede-4ccf-9253-9cb8deeac09b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:50.259952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f4619-a6c0-43f6-ab0a-be613675ad9e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:50.267599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:50.269384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.269667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.270045 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] PATH_INFO: `/v3/projects/58dba535d54c4930913fd1d5885ae151` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.271494 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58dba535d54c4930913fd1d5885ae151)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:50.274140 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:50.284228 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a8933658-0ede-4ccf-9253-9cb8deeac09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ec7148c9484278aecd2d12cc12c622', 'request_id': 'req-a8933658-0ede-4ccf-9253-9cb8deeac09b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:50.293504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a8933658-0ede-4ccf-9253-9cb8deeac09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ec7148c9484278aecd2d12cc12c622', 'request_id': 'req-a8933658-0ede-4ccf-9253-9cb8deeac09b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:50.307242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a8933658-0ede-4ccf-9253-9cb8deeac09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ec7148c9484278aecd2d12cc12c622', 'request_id': 'req-a8933658-0ede-4ccf-9253-9cb8deeac09b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:50.321443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a8933658-0ede-4ccf-9253-9cb8deeac09b admin admin] The token cache is being invalidate because project 54ec7148c9484278aecd2d12cc12c622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:50.322149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a8933658-0ede-4ccf-9253-9cb8deeac09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:50.323153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a8933658-0ede-4ccf-9253-9cb8deeac09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:50.325577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1159/2333] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:50 2022] DELETE /identity/v3/projects/54ec7148c9484278aecd2d12cc12c622 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:50.333235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66873346-5220-4f2f-9600-9a4c014b5b40 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.333529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66873346-5220-4f2f-9600-9a4c014b5b40 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.333810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66873346-5220-4f2f-9600-9a4c014b5b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.364376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-66873346-5220-4f2f-9600-9a4c014b5b40 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:50.364787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58dba535d54c4930913fd1d5885ae151', 'request_id': 'req-fa546d8c-d047-415d-b433-37d36f65a4f3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:50.365587 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-66873346-5220-4f2f-9600-9a4c014b5b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:50.374659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58dba535d54c4930913fd1d5885ae151', 'request_id': 'req-fa546d8c-d047-415d-b433-37d36f65a4f3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:50.384358 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58dba535d54c4930913fd1d5885ae151', 'request_id': 'req-fa546d8c-d047-415d-b433-37d36f65a4f3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:50.396524 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] The token cache is being invalidate because project 58dba535d54c4930913fd1d5885ae151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:50.396816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:50.397569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:50.400996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1175/2334] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:50 2022] DELETE /identity/v3/projects/58dba535d54c4930913fd1d5885ae151 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:50.406443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:50.408237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:50.438036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1160/2335] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:50.439639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb8297-4cfd-4559-b79f-195a43fb5b67 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.440682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb8297-4cfd-4559-b79f-195a43fb5b67 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.441110 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb8297-4cfd-4559-b79f-195a43fb5b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.474810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-aceb8297-4cfd-4559-b79f-195a43fb5b67 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:50.475429 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa546d8c-d047-415d-b433-37d36f65a4f3 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:50.476221 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-aceb8297-4cfd-4559-b79f-195a43fb5b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:50.479579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed610ae-7038-49c8-b117-dc299e50b350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:50.480479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed610ae-7038-49c8-b117-dc299e50b350 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.480705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed610ae-7038-49c8-b117-dc299e50b350 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.480989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed610ae-7038-49c8-b117-dc299e50b350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.483153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-aed610ae-7038-49c8-b117-dc299e50b350 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:50.492560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1161/2336] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:50.494344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524467f-e431-46ae-a056-7d091f903bbd None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.494636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524467f-e431-46ae-a056-7d091f903bbd None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.494914 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524467f-e431-46ae-a056-7d091f903bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.515856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-1524467f-e431-46ae-a056-7d091f903bbd None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:50.517092 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1524467f-e431-46ae-a056-7d091f903bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:50.527342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1162/2337] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:50.528885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c7b5-b076-4c02-8739-35b054333c86 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.529373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c7b5-b076-4c02-8739-35b054333c86 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.529848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c7b5-b076-4c02-8739-35b054333c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.551137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-cf55c7b5-b076-4c02-8739-35b054333c86 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:50.552535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cf55c7b5-b076-4c02-8739-35b054333c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:50.560736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1163/2338] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:50.561544 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c7b5-b076-4c02-8739-35b054333c86 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:50.562750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cf55c7b5-b076-4c02-8739-35b054333c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:50.575455 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed610ae-7038-49c8-b117-dc299e50b350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:50.575841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c7b5-b076-4c02-8739-35b054333c86 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:50.576891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed610ae-7038-49c8-b117-dc299e50b350 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:50.579410 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bac05-c1b4-4130-9288-4f05c5b4788f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:50.580037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bac05-c1b4-4130-9288-4f05c5b4788f service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.580405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bac05-c1b4-4130-9288-4f05c5b4788f service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.581215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bac05-c1b4-4130-9288-4f05c5b4788f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.583077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3a3bac05-c1b4-4130-9288-4f05c5b4788f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:50.587415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1176/2339] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:50.588234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed610ae-7038-49c8-b117-dc299e50b350 service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:50.597774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed610ae-7038-49c8-b117-dc299e50b350 service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:50.603197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da4740-1976-4742-9425-5fcc8e0b958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:50.603881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da4740-1976-4742-9425-5fcc8e0b958e admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.604164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da4740-1976-4742-9425-5fcc8e0b958e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.604435 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da4740-1976-4742-9425-5fcc8e0b958e admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.606779 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da4740-1976-4742-9425-5fcc8e0b958e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:50.606779 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da4740-1976-4742-9425-5fcc8e0b958e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:50.607601 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da4740-1976-4742-9425-5fcc8e0b958e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:50.626486 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1177/2340] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:50.629111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da4740-1976-4742-9425-5fcc8e0b958e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:50.649649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da4740-1976-4742-9425-5fcc8e0b958e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:50.667913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a83497-524e-41fa-a99f-6c64f2fe4d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:50.669910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a83497-524e-41fa-a99f-6c64f2fe4d41 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.671182 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a83497-524e-41fa-a99f-6c64f2fe4d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.671972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a83497-524e-41fa-a99f-6c64f2fe4d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.673600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a83497-524e-41fa-a99f-6c64f2fe4d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:50.674828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a83497-524e-41fa-a99f-6c64f2fe4d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:50.676866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a83497-524e-41fa-a99f-6c64f2fe4d41 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:50.700608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1178/2341] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:50.702772 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a83497-524e-41fa-a99f-6c64f2fe4d41 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:50.704339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bac05-c1b4-4130-9288-4f05c5b4788f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:50.706524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bac05-c1b4-4130-9288-4f05c5b4788f service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:50.733835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1164/2342] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:50.734731 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bac05-c1b4-4130-9288-4f05c5b4788f service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:50.737171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a83497-524e-41fa-a99f-6c64f2fe4d41 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:50.746432 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bac05-c1b4-4130-9288-4f05c5b4788f service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:50.753136 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3d1d-5bcc-4dc6-8290-39ec8be72353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:50.756038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3d1d-5bcc-4dc6-8290-39ec8be72353 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.756038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3d1d-5bcc-4dc6-8290-39ec8be72353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.756038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3d1d-5bcc-4dc6-8290-39ec8be72353 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.756038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b3d1d-5bcc-4dc6-8290-39ec8be72353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:50.756520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d85d4f-05fb-489c-8136-465f8c0e7c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:50.757396 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85d4f-05fb-489c-8136-465f8c0e7c8a admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.757860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85d4f-05fb-489c-8136-465f8c0e7c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.758097 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b3d1d-5bcc-4dc6-8290-39ec8be72353 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:50.758502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85d4f-05fb-489c-8136-465f8c0e7c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.759404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d85d4f-05fb-489c-8136-465f8c0e7c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:50.766473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d85d4f-05fb-489c-8136-465f8c0e7c8a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:50.802475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1165/2343] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:50 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:50.806646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3d1d-5bcc-4dc6-8290-39ec8be72353 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:50.820024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1179/2344] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:50 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:50.823998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d85d4f-05fb-489c-8136-465f8c0e7c8a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:50.916505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3d1d-5bcc-4dc6-8290-39ec8be72353 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:50.944100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d85d4f-05fb-489c-8136-465f8c0e7c8a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:50.951853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b589a-7226-4152-b668-0c14870b90a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:50.952559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b589a-7226-4152-b668-0c14870b90a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:50.952967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b589a-7226-4152-b668-0c14870b90a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:50.953319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b589a-7226-4152-b668-0c14870b90a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:50.954164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b589a-7226-4152-b668-0c14870b90a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:50.958311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b589a-7226-4152-b668-0c14870b90a4 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.001750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1180/2345] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:50 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:51.003473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b589a-7226-4152-b668-0c14870b90a4 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.004257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514475aa-e22e-4cb0-9c62-aaf03cdd4e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.005397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514475aa-e22e-4cb0-9c62-aaf03cdd4e19 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.005828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514475aa-e22e-4cb0-9c62-aaf03cdd4e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.006237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514475aa-e22e-4cb0-9c62-aaf03cdd4e19 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.007076 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514475aa-e22e-4cb0-9c62-aaf03cdd4e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.009211 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514475aa-e22e-4cb0-9c62-aaf03cdd4e19 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.014739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b589a-7226-4152-b668-0c14870b90a4 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.020437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf111d-f222-49b2-ba31-413a8db04456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.021226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf111d-f222-49b2-ba31-413a8db04456 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.021632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf111d-f222-49b2-ba31-413a8db04456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.021915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf111d-f222-49b2-ba31-413a8db04456 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.022731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf111d-f222-49b2-ba31-413a8db04456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.024685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf111d-f222-49b2-ba31-413a8db04456 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.031861 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1166/2346] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:50 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:51.035985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514475aa-e22e-4cb0-9c62-aaf03cdd4e19 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.037195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1181/2347] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:51.041063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf111d-f222-49b2-ba31-413a8db04456 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.049007 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514475aa-e22e-4cb0-9c62-aaf03cdd4e19 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.052423 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf111d-f222-49b2-ba31-413a8db04456 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.055733 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781f3b7-72e2-4bd6-a82c-f67bc3d705d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.056537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781f3b7-72e2-4bd6-a82c-f67bc3d705d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.056830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781f3b7-72e2-4bd6-a82c-f67bc3d705d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.057338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781f3b7-72e2-4bd6-a82c-f67bc3d705d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.057594 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17e7b0-456a-4ee8-a8e5-ba8e2e464097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.058134 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781f3b7-72e2-4bd6-a82c-f67bc3d705d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.058245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17e7b0-456a-4ee8-a8e5-ba8e2e464097 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.058555 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17e7b0-456a-4ee8-a8e5-ba8e2e464097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.058957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17e7b0-456a-4ee8-a8e5-ba8e2e464097 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.059636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17e7b0-456a-4ee8-a8e5-ba8e2e464097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.060765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781f3b7-72e2-4bd6-a82c-f67bc3d705d0 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.061281 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17e7b0-456a-4ee8-a8e5-ba8e2e464097 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.075272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1167/2348] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:51.075468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1182/2349] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:51.079123 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781f3b7-72e2-4bd6-a82c-f67bc3d705d0 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.079826 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17e7b0-456a-4ee8-a8e5-ba8e2e464097 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.089816 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781f3b7-72e2-4bd6-a82c-f67bc3d705d0 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.091540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17e7b0-456a-4ee8-a8e5-ba8e2e464097 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.095577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25184775-fc70-4745-a274-2e43a753ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.096438 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25184775-fc70-4745-a274-2e43a753ab94 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.096723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25184775-fc70-4745-a274-2e43a753ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.097412 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25184775-fc70-4745-a274-2e43a753ab94 admin admin] PATH_INFO: `/v3/projects/09d16d0020594b84b389e0b7d29ba95e/users/55ee26ec43d54327914287bc70d9f9c5/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.097867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcacca0-d47d-435b-9f04-2e0f5686d64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.098536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcacca0-d47d-435b-9f04-2e0f5686d64a admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.098850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcacca0-d47d-435b-9f04-2e0f5686d64a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.099187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcacca0-d47d-435b-9f04-2e0f5686d64a admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.100049 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcacca0-d47d-435b-9f04-2e0f5686d64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.101531 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcacca0-d47d-435b-9f04-2e0f5686d64a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.113006 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1183/2350] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:51.117064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcacca0-d47d-435b-9f04-2e0f5686d64a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.118630 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25184775-fc70-4745-a274-2e43a753ab94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d16d0020594b84b389e0b7d29ba95e, user_id=55ee26ec43d54327914287bc70d9f9c5, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.121328 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25184775-fc70-4745-a274-2e43a753ab94 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.126794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcacca0-d47d-435b-9f04-2e0f5686d64a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.132278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ac23c-c4fc-489e-b452-489482a6a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.133173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ac23c-c4fc-489e-b452-489482a6a2eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.133448 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ac23c-c4fc-489e-b452-489482a6a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.133715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ac23c-c4fc-489e-b452-489482a6a2eb admin admin] PATH_INFO: `/v3/projects/f84ea68cb45d440daaa9a5be55b84eac/users/0ef3602cf7f64a5995c2e9f83c6ffbeb/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.134799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1168/2351] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:51 2022] PUT /identity/v3/projects/09d16d0020594b84b389e0b7d29ba95e/users/55ee26ec43d54327914287bc70d9f9c5/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:51.145723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcdbeb-d341-4112-a62c-6b6f23f7b2f6 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.146018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcdbeb-d341-4112-a62c-6b6f23f7b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.146300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcdbeb-d341-4112-a62c-6b6f23f7b2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.148118 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ac23c-c4fc-489e-b452-489482a6a2eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84ea68cb45d440daaa9a5be55b84eac, user_id=0ef3602cf7f64a5995c2e9f83c6ffbeb, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.150740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ac23c-c4fc-489e-b452-489482a6a2eb admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.163323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1184/2352] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:51 2022] PUT /identity/v3/projects/f84ea68cb45d440daaa9a5be55b84eac/users/0ef3602cf7f64a5995c2e9f83c6ffbeb/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:51.172177 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-40fcdbeb-d341-4112-a62c-6b6f23f7b2f6 None None] MFA Rules not processed for user `55ee26ec43d54327914287bc70d9f9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:51.173387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-40fcdbeb-d341-4112-a62c-6b6f23f7b2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:51.174595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902929-c15a-42a2-8739-9bc57d9ffa58 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.174882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902929-c15a-42a2-8739-9bc57d9ffa58 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.175151 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97902929-c15a-42a2-8739-9bc57d9ffa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.202033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-97902929-c15a-42a2-8739-9bc57d9ffa58 None None] MFA Rules not processed for user `0ef3602cf7f64a5995c2e9f83c6ffbeb`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:51.203143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-97902929-c15a-42a2-8739-9bc57d9ffa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:51.237269 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1169/2353] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:51.241668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcdbeb-d341-4112-a62c-6b6f23f7b2f6 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.270811 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1185/2354] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:51.275286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97902929-c15a-42a2-8739-9bc57d9ffa58 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.305450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcdbeb-d341-4112-a62c-6b6f23f7b2f6 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.310278 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa0e62-6ea0-48f0-867f-4ff7900a2c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.310998 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa0e62-6ea0-48f0-867f-4ff7900a2c89 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.311237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa0e62-6ea0-48f0-867f-4ff7900a2c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.311506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa0e62-6ea0-48f0-867f-4ff7900a2c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.312188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa0e62-6ea0-48f0-867f-4ff7900a2c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.314465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa0e62-6ea0-48f0-867f-4ff7900a2c89 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.339315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1170/2355] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:51 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:51.341594 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97902929-c15a-42a2-8739-9bc57d9ffa58 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.343180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa0e62-6ea0-48f0-867f-4ff7900a2c89 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.396842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100c72a-3561-45db-8184-7218c7140df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.397967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100c72a-3561-45db-8184-7218c7140df4 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.398482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100c72a-3561-45db-8184-7218c7140df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.398822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100c72a-3561-45db-8184-7218c7140df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.399623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100c72a-3561-45db-8184-7218c7140df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.403132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100c72a-3561-45db-8184-7218c7140df4 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.403929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa0e62-6ea0-48f0-867f-4ff7900a2c89 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.409151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423d76c-bbe7-4058-8f8e-8451fea5397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.409811 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423d76c-bbe7-4058-8f8e-8451fea5397d admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.410094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423d76c-bbe7-4058-8f8e-8451fea5397d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.410367 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423d76c-bbe7-4058-8f8e-8451fea5397d admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.411054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423d76c-bbe7-4058-8f8e-8451fea5397d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.413003 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423d76c-bbe7-4058-8f8e-8451fea5397d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.437791 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1171/2356] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:51 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:51.438839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423d76c-bbe7-4058-8f8e-8451fea5397d admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.444544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1186/2357] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:51 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:51.449663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423d76c-bbe7-4058-8f8e-8451fea5397d admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.451942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100c72a-3561-45db-8184-7218c7140df4 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.512612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec8a9f-ef32-4d5d-a72e-6a03dc7daf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.513466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec8a9f-ef32-4d5d-a72e-6a03dc7daf22 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.513753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec8a9f-ef32-4d5d-a72e-6a03dc7daf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.514025 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec8a9f-ef32-4d5d-a72e-6a03dc7daf22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.514754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec8a9f-ef32-4d5d-a72e-6a03dc7daf22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.516640 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec8a9f-ef32-4d5d-a72e-6a03dc7daf22 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.523107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100c72a-3561-45db-8184-7218c7140df4 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.527652 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1172/2358] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:51.528778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94af444-8a09-4eff-aa78-167ce06faafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.528953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94af444-8a09-4eff-aa78-167ce06faafd admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.529278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94af444-8a09-4eff-aa78-167ce06faafd admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.529493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94af444-8a09-4eff-aa78-167ce06faafd admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.530187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94af444-8a09-4eff-aa78-167ce06faafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.531801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec8a9f-ef32-4d5d-a72e-6a03dc7daf22 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.532293 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94af444-8a09-4eff-aa78-167ce06faafd admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.542766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec8a9f-ef32-4d5d-a72e-6a03dc7daf22 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.549142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0face634-7e4d-4663-84ef-e8594655b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.550198 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0face634-7e4d-4663-84ef-e8594655b0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.550501 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0face634-7e4d-4663-84ef-e8594655b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.550759 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0face634-7e4d-4663-84ef-e8594655b0e6 admin admin] PATH_INFO: `/v3/projects/b57ffea0c26341739a4fb1e83d10832c/users/a969ccbfbd084695a1a7fb630f1c0172/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.561897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1187/2359] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:51 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:51.567086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94af444-8a09-4eff-aa78-167ce06faafd admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.572189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0face634-7e4d-4663-84ef-e8594655b0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b57ffea0c26341739a4fb1e83d10832c, user_id=a969ccbfbd084695a1a7fb630f1c0172, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.574915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0face634-7e4d-4663-84ef-e8594655b0e6 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.583756 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94af444-8a09-4eff-aa78-167ce06faafd admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.589499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429051c-4f7f-4628-887e-13e332357168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.590236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429051c-4f7f-4628-887e-13e332357168 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.590517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429051c-4f7f-4628-887e-13e332357168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.590800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429051c-4f7f-4628-887e-13e332357168 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.597356 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1173/2360] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:51 2022] PUT /identity/v3/projects/b57ffea0c26341739a4fb1e83d10832c/users/a969ccbfbd084695a1a7fb630f1c0172/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:51.599789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429051c-4f7f-4628-887e-13e332357168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.603003 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0face634-7e4d-4663-84ef-e8594655b0e6 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.606234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429051c-4f7f-4628-887e-13e332357168 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.628727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1188/2361] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:51.633637 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429051c-4f7f-4628-887e-13e332357168 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.645666 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429051c-4f7f-4628-887e-13e332357168 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.689148 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0face634-7e4d-4663-84ef-e8594655b0e6 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.696245 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341891d6-bdc8-4dc6-83f0-3f937091a42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.697499 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341891d6-bdc8-4dc6-83f0-3f937091a42e admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.697843 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341891d6-bdc8-4dc6-83f0-3f937091a42e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.698129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341891d6-bdc8-4dc6-83f0-3f937091a42e admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.698870 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341891d6-bdc8-4dc6-83f0-3f937091a42e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.700629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341891d6-bdc8-4dc6-83f0-3f937091a42e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.711316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1174/2362] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:51.714946 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341891d6-bdc8-4dc6-83f0-3f937091a42e admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.715661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7407329-e8df-490c-955f-d35465538a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.716548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7407329-e8df-490c-955f-d35465538a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.716833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7407329-e8df-490c-955f-d35465538a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.717119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7407329-e8df-490c-955f-d35465538a79 admin admin] PATH_INFO: `/v3/projects/453e36aacbaa4a2faa2cf67599422bc0/users/03c2a59246c44615aca4590624435831/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.724791 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341891d6-bdc8-4dc6-83f0-3f937091a42e admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.729554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4e7e5-145a-4d32-9f39-56ef7a0085bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.730498 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4e7e5-145a-4d32-9f39-56ef7a0085bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.730783 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4e7e5-145a-4d32-9f39-56ef7a0085bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.731059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4e7e5-145a-4d32-9f39-56ef7a0085bd admin admin] PATH_INFO: `/v3/projects/b57ffea0c26341739a4fb1e83d10832c/users/a969ccbfbd084695a1a7fb630f1c0172/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.733273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4e7e5-145a-4d32-9f39-56ef7a0085bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b57ffea0c26341739a4fb1e83d10832c, user_id=a969ccbfbd084695a1a7fb630f1c0172, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.737674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4e7e5-145a-4d32-9f39-56ef7a0085bd admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.742087 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7407329-e8df-490c-955f-d35465538a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=453e36aacbaa4a2faa2cf67599422bc0, user_id=03c2a59246c44615aca4590624435831, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.745027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7407329-e8df-490c-955f-d35465538a79 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.748841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1175/2363] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:51 2022] PUT /identity/v3/projects/b57ffea0c26341739a4fb1e83d10832c/users/a969ccbfbd084695a1a7fb630f1c0172/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:51.761070 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b7a0f-6b8d-41cc-b36a-6a3fcf77511c None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.761418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b7a0f-6b8d-41cc-b36a-6a3fcf77511c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.761757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b7a0f-6b8d-41cc-b36a-6a3fcf77511c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.774745 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1189/2364] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:51 2022] PUT /identity/v3/projects/453e36aacbaa4a2faa2cf67599422bc0/users/03c2a59246c44615aca4590624435831/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:51.778438 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7407329-e8df-490c-955f-d35465538a79 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.819167 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-cd7b7a0f-6b8d-41cc-b36a-6a3fcf77511c None None] MFA Rules not processed for user `a969ccbfbd084695a1a7fb630f1c0172`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:51.822122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cd7b7a0f-6b8d-41cc-b36a-6a3fcf77511c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:51.868091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7407329-e8df-490c-955f-d35465538a79 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.872900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cca9aa-6ce9-460a-80a9-d3ce6a20cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.873576 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cca9aa-6ce9-460a-80a9-d3ce6a20cacd admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.873860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cca9aa-6ce9-460a-80a9-d3ce6a20cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.874142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cca9aa-6ce9-460a-80a9-d3ce6a20cacd admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.874908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cca9aa-6ce9-460a-80a9-d3ce6a20cacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.876695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cca9aa-6ce9-460a-80a9-d3ce6a20cacd admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.887706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1190/2365] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:51.892125 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cca9aa-6ce9-460a-80a9-d3ce6a20cacd admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:51.909272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cca9aa-6ce9-460a-80a9-d3ce6a20cacd admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:51.917184 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb0e7c-7844-4053-94a0-84ecb7599acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:51.918350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb0e7c-7844-4053-94a0-84ecb7599acc admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.918589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb0e7c-7844-4053-94a0-84ecb7599acc admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.918943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb0e7c-7844-4053-94a0-84ecb7599acc admin admin] PATH_INFO: `/v3/projects/453e36aacbaa4a2faa2cf67599422bc0/users/03c2a59246c44615aca4590624435831/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:51.921407 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb0e7c-7844-4053-94a0-84ecb7599acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=453e36aacbaa4a2faa2cf67599422bc0, user_id=03c2a59246c44615aca4590624435831, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:51.925885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb0e7c-7844-4053-94a0-84ecb7599acc admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:51.936042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1176/2366] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:51.948234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1191/2367] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:51 2022] PUT /identity/v3/projects/453e36aacbaa4a2faa2cf67599422bc0/users/03c2a59246c44615aca4590624435831/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:51.961599 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebdc68-623a-4afb-866e-08b702647f2a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:51.963709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebdc68-623a-4afb-866e-08b702647f2a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:51.964001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebdc68-623a-4afb-866e-08b702647f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:52.000887 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-a7ebdc68-623a-4afb-866e-08b702647f2a None None] MFA Rules not processed for user `03c2a59246c44615aca4590624435831`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:52.004915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a7ebdc68-623a-4afb-866e-08b702647f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:52.089700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb0e7c-7844-4053-94a0-84ecb7599acc admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:52.154259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1177/2368] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:52.202673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb0e7c-7844-4053-94a0-84ecb7599acc admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:52.206784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ecf8-526e-48a7-b0b5-84a176a5669b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:52.207570 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ecf8-526e-48a7-b0b5-84a176a5669b service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:52.207916 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ecf8-526e-48a7-b0b5-84a176a5669b service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:52.208301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1ecf8-526e-48a7-b0b5-84a176a5669b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:52.291561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebdc68-623a-4afb-866e-08b702647f2a None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:52.311133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebdc68-623a-4afb-866e-08b702647f2a None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:52.317713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1ecf8-526e-48a7-b0b5-84a176a5669b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:52.319995 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1ecf8-526e-48a7-b0b5-84a176a5669b service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:52.323425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0d9a9-b4ff-45bf-a15a-ac94c04c7e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:52.324151 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0d9a9-b4ff-45bf-a15a-ac94c04c7e2f service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:52.324354 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0d9a9-b4ff-45bf-a15a-ac94c04c7e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:52.324629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0d9a9-b4ff-45bf-a15a-ac94c04c7e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:52.336629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0d9a9-b4ff-45bf-a15a-ac94c04c7e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:52.338224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0d9a9-b4ff-45bf-a15a-ac94c04c7e2f service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:52.341214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1192/2369] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:52.355781 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1178/2370] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:52.816208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ecf8-526e-48a7-b0b5-84a176a5669b service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:52.878302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1ecf8-526e-48a7-b0b5-84a176a5669b service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:52.882761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:52.883674 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:52.883949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:52.884219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] PATH_INFO: `/v3/users/0ef3602cf7f64a5995c2e9f83c6ffbeb` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:52.885423 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef3602cf7f64a5995c2e9f83c6ffbeb)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:52.887349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:52.931201 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef3602cf7f64a5995c2e9f83c6ffbeb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:52.938565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef3602cf7f64a5995c2e9f83c6ffbeb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:52.939281 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef3602cf7f64a5995c2e9f83c6ffbeb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:52.947038 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef3602cf7f64a5995c2e9f83c6ffbeb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:52.959297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef3602cf7f64a5995c2e9f83c6ffbeb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:52.965322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1193/2371] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:52 2022] DELETE /identity/v3/users/0ef3602cf7f64a5995c2e9f83c6ffbeb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:52.969864 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e2cb-d88d-402a-981f-aeaddeea31dc None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:52.970154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e2cb-d88d-402a-981f-aeaddeea31dc None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:52.970429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e2cb-d88d-402a-981f-aeaddeea31dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:52.988988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-cd83e2cb-d88d-402a-981f-aeaddeea31dc None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:52.990121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cd83e2cb-d88d-402a-981f-aeaddeea31dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:53.047142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1179/2372] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:53.056582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:53.058085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:53.116238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1819d-0702-4b25-88dc-f45b2e4def95 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:53.123991 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb28c7-ec55-4fbf-b63f-f736331b8dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:53.124766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb28c7-ec55-4fbf-b63f-f736331b8dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:53.125241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb28c7-ec55-4fbf-b63f-f736331b8dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:53.125718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb28c7-ec55-4fbf-b63f-f736331b8dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:53.139319 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb28c7-ec55-4fbf-b63f-f736331b8dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:53.140784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb28c7-ec55-4fbf-b63f-f736331b8dd0 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:53.154618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1194/2373] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:53.699970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83e2cb-d88d-402a-981f-aeaddeea31dc None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:53.701422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cd83e2cb-d88d-402a-981f-aeaddeea31dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:53.714671 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83e2cb-d88d-402a-981f-aeaddeea31dc None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:53.719690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:53.720604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:53.720881 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:53.721736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] PATH_INFO: `/v3/projects/f84ea68cb45d440daaa9a5be55b84eac` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:53.723063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f84ea68cb45d440daaa9a5be55b84eac)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:53.725182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:53.807351 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f84ea68cb45d440daaa9a5be55b84eac', 'request_id': 'req-a23350f4-97dc-45a4-8a17-23907b6cbd5a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:53.814964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f84ea68cb45d440daaa9a5be55b84eac', 'request_id': 'req-a23350f4-97dc-45a4-8a17-23907b6cbd5a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:53.837619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f84ea68cb45d440daaa9a5be55b84eac', 'request_id': 'req-a23350f4-97dc-45a4-8a17-23907b6cbd5a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:53.862298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] The token cache is being invalidate because project f84ea68cb45d440daaa9a5be55b84eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:53.862465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:53.863107 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:53.868928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb28c7-ec55-4fbf-b63f-f736331b8dd0 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:53.869410 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1180/2374] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:53 2022] DELETE /identity/v3/projects/f84ea68cb45d440daaa9a5be55b84eac => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:53.888842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb28c7-ec55-4fbf-b63f-f736331b8dd0 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:53.989875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90e77-bca8-4d61-b659-5cc07ed9aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:53.991627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90e77-bca8-4d61-b659-5cc07ed9aae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:53.991930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90e77-bca8-4d61-b659-5cc07ed9aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:53.992210 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90e77-bca8-4d61-b659-5cc07ed9aae7 admin admin] PATH_INFO: `/v3/users/03c2a59246c44615aca4590624435831` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:53.994298 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90e77-bca8-4d61-b659-5cc07ed9aae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c2a59246c44615aca4590624435831)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:53.996326 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90e77-bca8-4d61-b659-5cc07ed9aae7 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:54.078599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-3fc90e77-bca8-4d61-b659-5cc07ed9aae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c2a59246c44615aca4590624435831'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:54.092646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-3fc90e77-bca8-4d61-b659-5cc07ed9aae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c2a59246c44615aca4590624435831'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:54.093264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-3fc90e77-bca8-4d61-b659-5cc07ed9aae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c2a59246c44615aca4590624435831'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:54.101715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-3fc90e77-bca8-4d61-b659-5cc07ed9aae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c2a59246c44615aca4590624435831'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:54.117635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-3fc90e77-bca8-4d61-b659-5cc07ed9aae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c2a59246c44615aca4590624435831'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:54.126469 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1195/2375] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:53 2022] DELETE /identity/v3/users/03c2a59246c44615aca4590624435831 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:54.410272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:54.411743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:54.424800 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23350f4-97dc-45a4-8a17-23907b6cbd5a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:54.479605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85be442-3d5d-458e-aa63-f9f792878b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:54.480458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85be442-3d5d-458e-aa63-f9f792878b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:54.480740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85be442-3d5d-458e-aa63-f9f792878b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:54.481016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85be442-3d5d-458e-aa63-f9f792878b6e admin admin] PATH_INFO: `/v3/projects/453e36aacbaa4a2faa2cf67599422bc0` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:54.482182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85be442-3d5d-458e-aa63-f9f792878b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=453e36aacbaa4a2faa2cf67599422bc0)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:54.484108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85be442-3d5d-458e-aa63-f9f792878b6e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:54.529456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d85be442-3d5d-458e-aa63-f9f792878b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453e36aacbaa4a2faa2cf67599422bc0', 'request_id': 'req-d85be442-3d5d-458e-aa63-f9f792878b6e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:54.535331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d85be442-3d5d-458e-aa63-f9f792878b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453e36aacbaa4a2faa2cf67599422bc0', 'request_id': 'req-d85be442-3d5d-458e-aa63-f9f792878b6e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:54.542287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d85be442-3d5d-458e-aa63-f9f792878b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453e36aacbaa4a2faa2cf67599422bc0', 'request_id': 'req-d85be442-3d5d-458e-aa63-f9f792878b6e'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:54.552031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d85be442-3d5d-458e-aa63-f9f792878b6e admin admin] The token cache is being invalidate because project 453e36aacbaa4a2faa2cf67599422bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:54.552315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d85be442-3d5d-458e-aa63-f9f792878b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:54.552945 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d85be442-3d5d-458e-aa63-f9f792878b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:54.554431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1181/2376] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:54 2022] DELETE /identity/v3/projects/453e36aacbaa4a2faa2cf67599422bc0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:54.559913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02ff8-87ef-4779-a907-c33e515707ca None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:54.560230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02ff8-87ef-4779-a907-c33e515707ca None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:54.560485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02ff8-87ef-4779-a907-c33e515707ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:54.579143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-6ca02ff8-87ef-4779-a907-c33e515707ca None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:54.580966 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6ca02ff8-87ef-4779-a907-c33e515707ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:54.638156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1196/2377] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:54.647449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315205a-ce2a-4f8a-9f8b-cd52783ca144 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:54.647735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315205a-ce2a-4f8a-9f8b-cd52783ca144 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:54.648013 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315205a-ce2a-4f8a-9f8b-cd52783ca144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:54.665478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-5315205a-ce2a-4f8a-9f8b-cd52783ca144 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:54.666649 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-5315205a-ce2a-4f8a-9f8b-cd52783ca144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:54.675474 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1182/2378] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:54.679604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca02ff8-87ef-4779-a907-c33e515707ca None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:54.689326 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca02ff8-87ef-4779-a907-c33e515707ca None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:54.695579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952af63-0c81-4f31-bd1a-528522204b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:54.696252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952af63-0c81-4f31-bd1a-528522204b61 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:54.696536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952af63-0c81-4f31-bd1a-528522204b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:54.696813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952af63-0c81-4f31-bd1a-528522204b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:54.697542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952af63-0c81-4f31-bd1a-528522204b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:54.697848 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952af63-0c81-4f31-bd1a-528522204b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:54.699447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952af63-0c81-4f31-bd1a-528522204b61 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:54.710777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1197/2379] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:49:54.715028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315205a-ce2a-4f8a-9f8b-cd52783ca144 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:54.723992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315205a-ce2a-4f8a-9f8b-cd52783ca144 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:54.728647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7212f-e598-4b6d-97c8-413ac3980daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:54.729286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7212f-e598-4b6d-97c8-413ac3980daa admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:54.729565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7212f-e598-4b6d-97c8-413ac3980daa admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:54.729841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7212f-e598-4b6d-97c8-413ac3980daa admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:54.730529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7212f-e598-4b6d-97c8-413ac3980daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:54.732454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7212f-e598-4b6d-97c8-413ac3980daa admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:54.757218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1183/2380] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:54 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:54.761262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952af63-0c81-4f31-bd1a-528522204b61 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:54.770904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952af63-0c81-4f31-bd1a-528522204b61 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:54.831497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8b6f9-4dd3-44d7-aa1f-316d58387017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:54.832078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8b6f9-4dd3-44d7-aa1f-316d58387017 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:54.832358 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8b6f9-4dd3-44d7-aa1f-316d58387017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:54.832629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8b6f9-4dd3-44d7-aa1f-316d58387017 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:54.833316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8b6f9-4dd3-44d7-aa1f-316d58387017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:54.835315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8b6f9-4dd3-44d7-aa1f-316d58387017 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:54.858320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1198/2381] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:54 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:54.859837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7212f-e598-4b6d-97c8-413ac3980daa admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:54.870565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7212f-e598-4b6d-97c8-413ac3980daa admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:54.875581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d81080-a59c-400c-b1e9-6db8eb7bc494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:54.876232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d81080-a59c-400c-b1e9-6db8eb7bc494 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:54.876628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d81080-a59c-400c-b1e9-6db8eb7bc494 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:54.876909 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d81080-a59c-400c-b1e9-6db8eb7bc494 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:54.878217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d81080-a59c-400c-b1e9-6db8eb7bc494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:54.879824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d81080-a59c-400c-b1e9-6db8eb7bc494 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:54.890426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1184/2382] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:54.894417 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8b6f9-4dd3-44d7-aa1f-316d58387017 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:54.905023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8b6f9-4dd3-44d7-aa1f-316d58387017 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:54.914787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a9e4b-8a29-473b-9150-d9f54e8a0454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:54.915615 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a9e4b-8a29-473b-9150-d9f54e8a0454 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:54.916159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a9e4b-8a29-473b-9150-d9f54e8a0454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:54.916756 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a9e4b-8a29-473b-9150-d9f54e8a0454 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:54.918271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a9e4b-8a29-473b-9150-d9f54e8a0454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:54.921320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a9e4b-8a29-473b-9150-d9f54e8a0454 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:54.935440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1199/2383] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:54.939431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d81080-a59c-400c-b1e9-6db8eb7bc494 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:54.951241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d81080-a59c-400c-b1e9-6db8eb7bc494 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:54.957743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b05c-7018-44ca-ad5b-23bdf4c64344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:54.958623 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b05c-7018-44ca-ad5b-23bdf4c64344 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:54.958900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b05c-7018-44ca-ad5b-23bdf4c64344 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:54.959174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b05c-7018-44ca-ad5b-23bdf4c64344 admin admin] PATH_INFO: `/v3/projects/e41057c9b1f4427ca9da10f589541a95/users/65701efe3b9546cbb3ea9a671fee6c30/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:54.966766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a9e4b-8a29-473b-9150-d9f54e8a0454 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:54.968539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-101a9e4b-8a29-473b-9150-d9f54e8a0454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:54.977586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314b05c-7018-44ca-ad5b-23bdf4c64344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41057c9b1f4427ca9da10f589541a95, user_id=65701efe3b9546cbb3ea9a671fee6c30, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:54.980269 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314b05c-7018-44ca-ad5b-23bdf4c64344 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:54.984571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a9e4b-8a29-473b-9150-d9f54e8a0454 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:54.992835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:54.993710 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:54.993993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:54.994267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] PATH_INFO: `/v3/users/ea013748647c4ac79f5785e402757148` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:54.996833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea013748647c4ac79f5785e402757148)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:54.998742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:54.999326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1185/2384] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:54 2022] PUT /identity/v3/projects/e41057c9b1f4427ca9da10f589541a95/users/65701efe3b9546cbb3ea9a671fee6c30/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:55.011158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3c2a1-ad31-445f-9f33-b69b8aa3b95a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:55.011486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3c2a1-ad31-445f-9f33-b69b8aa3b95a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:55.011766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3c2a1-ad31-445f-9f33-b69b8aa3b95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:55.037747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-a6c3c2a1-ad31-445f-9f33-b69b8aa3b95a None None] MFA Rules not processed for user `65701efe3b9546cbb3ea9a671fee6c30`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:55.038979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a6c3c2a1-ad31-445f-9f33-b69b8aa3b95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.052650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea013748647c4ac79f5785e402757148'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.059882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea013748647c4ac79f5785e402757148'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.060506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea013748647c4ac79f5785e402757148'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.069067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea013748647c4ac79f5785e402757148'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.081953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea013748647c4ac79f5785e402757148'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.088760 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1200/2385] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:54 2022] DELETE /identity/v3/users/ea013748647c4ac79f5785e402757148 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:55.093509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:55.093902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.110554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1186/2386] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:55.112491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43ba2d-6ce8-448e-9be7-9e3ce66800ee None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:55.112889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43ba2d-6ce8-448e-9be7-9e3ce66800ee None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:55.113172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43ba2d-6ce8-448e-9be7-9e3ce66800ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:55.130770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-2c43ba2d-6ce8-448e-9be7-9e3ce66800ee None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:55.132006 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2c43ba2d-6ce8-448e-9be7-9e3ce66800ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.166800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68c7d5-00ef-4e29-81c8-e06e03c94330 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:55.179742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:55.179742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:55.179742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:55.179742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] PATH_INFO: `/v3/users/55ee26ec43d54327914287bc70d9f9c5` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:55.181720 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ee26ec43d54327914287bc70d9f9c5)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:55.183663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:55.206448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1187/2387] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:55.206448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43ba2d-6ce8-448e-9be7-9e3ce66800ee None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:55.206448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2c43ba2d-6ce8-448e-9be7-9e3ce66800ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.273003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ee26ec43d54327914287bc70d9f9c5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.281392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ee26ec43d54327914287bc70d9f9c5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.282145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ee26ec43d54327914287bc70d9f9c5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.291552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ee26ec43d54327914287bc70d9f9c5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.297450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43ba2d-6ce8-448e-9be7-9e3ce66800ee None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:55.304476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ee95d-ae3a-46dc-8f52-91ab85239f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:55.305144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ee95d-ae3a-46dc-8f52-91ab85239f52 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:55.305427 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ee95d-ae3a-46dc-8f52-91ab85239f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:55.305706 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ee95d-ae3a-46dc-8f52-91ab85239f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:55.307567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ee26ec43d54327914287bc70d9f9c5'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.307707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b86ee95d-ae3a-46dc-8f52-91ab85239f52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.316111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1201/2388] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:55 2022] DELETE /identity/v3/users/55ee26ec43d54327914287bc70d9f9c5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:55.317497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:55.319267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.377438 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ee95d-ae3a-46dc-8f52-91ab85239f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:55.379475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ee95d-ae3a-46dc-8f52-91ab85239f52 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:55.390753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1188/2389] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:55.392002 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ee95d-ae3a-46dc-8f52-91ab85239f52 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:55.393891 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938395c6-52a9-4e5a-94e5-d81fca1d98ac admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:55.394296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b86ee95d-ae3a-46dc-8f52-91ab85239f52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.399336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffc3cb-2182-4bd8-8d67-2445a5b8fa93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:55.400504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffc3cb-2182-4bd8-8d67-2445a5b8fa93 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:55.400931 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffc3cb-2182-4bd8-8d67-2445a5b8fa93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:55.401818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffc3cb-2182-4bd8-8d67-2445a5b8fa93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:55.404670 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-37ffc3cb-2182-4bd8-8d67-2445a5b8fa93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.412565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ee95d-ae3a-46dc-8f52-91ab85239f52 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:55.488152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffc3cb-2182-4bd8-8d67-2445a5b8fa93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:55.489896 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffc3cb-2182-4bd8-8d67-2445a5b8fa93 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:55.496886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:55.497788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:55.498071 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:55.498348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] PATH_INFO: `/v3/users/ceecfde315004240bcf5b6fea7d7d39d` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:55.499684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceecfde315004240bcf5b6fea7d7d39d)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:55.501206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1202/2390] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:55.501611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:55.502382 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5533486-0499-471b-8ce6-1a288f604659 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:55.502667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5533486-0499-471b-8ce6-1a288f604659 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:55.503008 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5533486-0499-471b-8ce6-1a288f604659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:55.522701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-f5533486-0499-471b-8ce6-1a288f604659 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:55.524076 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f5533486-0499-471b-8ce6-1a288f604659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.537699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1203/2391] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:55.545472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5533486-0499-471b-8ce6-1a288f604659 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:55.548227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f5533486-0499-471b-8ce6-1a288f604659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.560856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5533486-0499-471b-8ce6-1a288f604659 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:55.562584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceecfde315004240bcf5b6fea7d7d39d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.565738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac31f77-c262-4db1-9154-cc41887c10b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:55.566510 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31f77-c262-4db1-9154-cc41887c10b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:55.566882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31f77-c262-4db1-9154-cc41887c10b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:55.567398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31f77-c262-4db1-9154-cc41887c10b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:55.573903 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceecfde315004240bcf5b6fea7d7d39d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.579929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac31f77-c262-4db1-9154-cc41887c10b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:55.582613 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac31f77-c262-4db1-9154-cc41887c10b0 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:55.585834 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceecfde315004240bcf5b6fea7d7d39d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.586623 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceecfde315004240bcf5b6fea7d7d39d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.587705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceecfde315004240bcf5b6fea7d7d39d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.596608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1204/2392] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:55.620761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1189/2393] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:55 2022] DELETE /identity/v3/users/ceecfde315004240bcf5b6fea7d7d39d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:55.622528 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1658b8-7fbd-44e5-9ecc-2d61f12abdfb None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:55.622841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1658b8-7fbd-44e5-9ecc-2d61f12abdfb None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:55.623322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1658b8-7fbd-44e5-9ecc-2d61f12abdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:55.644350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-9b1658b8-7fbd-44e5-9ecc-2d61f12abdfb None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:55.645564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-9b1658b8-7fbd-44e5-9ecc-2d61f12abdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.744470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1205/2394] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:55.754717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:55.756585 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.863491 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1658b8-7fbd-44e5-9ecc-2d61f12abdfb None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:55.865816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-9b1658b8-7fbd-44e5-9ecc-2d61f12abdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.882194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1658b8-7fbd-44e5-9ecc-2d61f12abdfb None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:55.888755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:55.889502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a38e1-52f4-4567-9bf8-5da39014411e admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:55.890203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:55.890601 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:55.891010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] PATH_INFO: `/v3/projects/ff8f7c5c81e5480280f70be8b7a6c883` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:55.894050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8f7c5c81e5480280f70be8b7a6c883)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:55.897422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:55.902227 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767486a-284f-4bb9-8023-a0747a06f87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:55.903399 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767486a-284f-4bb9-8023-a0747a06f87d service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:55.908054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767486a-284f-4bb9-8023-a0747a06f87d service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:55.908192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767486a-284f-4bb9-8023-a0747a06f87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:55.923552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767486a-284f-4bb9-8023-a0747a06f87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:55.925786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767486a-284f-4bb9-8023-a0747a06f87d service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:55.939017 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1190/2395] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:55.958711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767486a-284f-4bb9-8023-a0747a06f87d service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:55.959758 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8f7c5c81e5480280f70be8b7a6c883', 'request_id': 'req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.964446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a767486a-284f-4bb9-8023-a0747a06f87d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:55.966594 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8f7c5c81e5480280f70be8b7a6c883', 'request_id': 'req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.976534 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8f7c5c81e5480280f70be8b7a6c883', 'request_id': 'req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.979907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767486a-284f-4bb9-8023-a0747a06f87d service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:55.989681 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] The token cache is being invalidate because project ff8f7c5c81e5480280f70be8b7a6c883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:55.990090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.990852 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:55.992732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1206/2396] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:55 2022] DELETE /identity/v3/projects/ff8f7c5c81e5480280f70be8b7a6c883 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:55.996741 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:56.001612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:56.087621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:56.089190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:56.090268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:56.091001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] PATH_INFO: `/v3/projects/09d16d0020594b84b389e0b7d29ba95e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:56.093684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d16d0020594b84b389e0b7d29ba95e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:56.096644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:56.128945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1adf88b-ab88-4313-9ac5-c8de41cdb9a2 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:56.134612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:56.135535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:56.135817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:56.136090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] PATH_INFO: `/v3/users/0481f66c6d174c2aacbbe171e877a0a3` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:56.137381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0481f66c6d174c2aacbbe171e877a0a3)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:56.139339 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:56.187242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d16d0020594b84b389e0b7d29ba95e', 'request_id': 'req-8809286a-1c42-4bf4-9309-a2dbc2c53844'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.199360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d16d0020594b84b389e0b7d29ba95e', 'request_id': 'req-8809286a-1c42-4bf4-9309-a2dbc2c53844'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.210571 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d16d0020594b84b389e0b7d29ba95e', 'request_id': 'req-8809286a-1c42-4bf4-9309-a2dbc2c53844'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.219973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0481f66c6d174c2aacbbe171e877a0a3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.223775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] The token cache is being invalidate because project 09d16d0020594b84b389e0b7d29ba95e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:56.224107 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.225042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.227254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1191/2397] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:55 2022] DELETE /identity/v3/projects/09d16d0020594b84b389e0b7d29ba95e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:56.232446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:56.233987 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:56.235690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0481f66c6d174c2aacbbe171e877a0a3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.237973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0481f66c6d174c2aacbbe171e877a0a3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.249331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0481f66c6d174c2aacbbe171e877a0a3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.267981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0481f66c6d174c2aacbbe171e877a0a3'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.274868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1207/2398] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:55 2022] DELETE /identity/v3/users/0481f66c6d174c2aacbbe171e877a0a3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:56.293269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:56.295075 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:56.347530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809286a-1c42-4bf4-9309-a2dbc2c53844 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:56.405541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d908d20-b336-429d-bd8b-7a384cda77de admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:56.410945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:56.411932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:56.412296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:56.412642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] PATH_INFO: `/v3/projects/560db648dab442839d2eb34071a08c54` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:56.413940 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=560db648dab442839d2eb34071a08c54)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:56.416523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:56.426156 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:56.427300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:56.427587 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:56.427934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] PATH_INFO: `/v3/users/a969ccbfbd084695a1a7fb630f1c0172` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:56.429498 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a969ccbfbd084695a1a7fb630f1c0172)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:56.432304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:56.498087 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a969ccbfbd084695a1a7fb630f1c0172'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.498651 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560db648dab442839d2eb34071a08c54', 'request_id': 'req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.509683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560db648dab442839d2eb34071a08c54', 'request_id': 'req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.514442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a969ccbfbd084695a1a7fb630f1c0172'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.519875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560db648dab442839d2eb34071a08c54', 'request_id': 'req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.528752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a969ccbfbd084695a1a7fb630f1c0172'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.529681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a969ccbfbd084695a1a7fb630f1c0172'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.531592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a969ccbfbd084695a1a7fb630f1c0172'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.541047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] The token cache is being invalidate because project 560db648dab442839d2eb34071a08c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:56.542122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.543648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.548316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1208/2399] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:56 2022] DELETE /identity/v3/projects/560db648dab442839d2eb34071a08c54 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:56.552882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:56.554369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:56.559977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1192/2400] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:56 2022] DELETE /identity/v3/users/a969ccbfbd084695a1a7fb630f1c0172 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:56.626024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04dfc6-2b05-42cf-be1e-664e85e7bc24 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:56.696868 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:56.698500 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:56.698989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:56.699437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] PATH_INFO: `/v3/users/9e9974d0483b41c5b17e5a20f826b1fb` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:56.700801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9974d0483b41c5b17e5a20f826b1fb)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:56.704649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:56.763507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9974d0483b41c5b17e5a20f826b1fb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.775161 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9974d0483b41c5b17e5a20f826b1fb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.775782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9974d0483b41c5b17e5a20f826b1fb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.794529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9974d0483b41c5b17e5a20f826b1fb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.811145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9974d0483b41c5b17e5a20f826b1fb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:56.818523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1209/2401] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:56 2022] DELETE /identity/v3/users/9e9974d0483b41c5b17e5a20f826b1fb => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:56.827867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:56.829578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:56.845551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af12668-634e-4d7a-ac6f-fe30700f409b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:56.897020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:56.899310 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:56.950184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:56.951524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:56.951895 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:56.952259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] PATH_INFO: `/v3/projects/dfbf2344e82c45468c0439907f17ba3d` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:56.954018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfbf2344e82c45468c0439907f17ba3d)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:56.957825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:57.009193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a2382-57d6-4253-ae80-12c76be447d1 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:57.019458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfbf2344e82c45468c0439907f17ba3d', 'request_id': 'req-b209f20d-2c59-4d92-97bd-515170d13666'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.027364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfbf2344e82c45468c0439907f17ba3d', 'request_id': 'req-b209f20d-2c59-4d92-97bd-515170d13666'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.041576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfbf2344e82c45468c0439907f17ba3d', 'request_id': 'req-b209f20d-2c59-4d92-97bd-515170d13666'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.074791 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] The token cache is being invalidate because project dfbf2344e82c45468c0439907f17ba3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:57.075031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.076108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.079886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1193/2402] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:56 2022] DELETE /identity/v3/projects/dfbf2344e82c45468c0439907f17ba3d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:57.084889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:57.091992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:57.152766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:57.156470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:57.156859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:57.157211 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] PATH_INFO: `/v3/projects/b57ffea0c26341739a4fb1e83d10832c` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:57.159810 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b57ffea0c26341739a4fb1e83d10832c)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:57.162108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:57.251773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209f20d-2c59-4d92-97bd-515170d13666 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:57.260379 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b57ffea0c26341739a4fb1e83d10832c', 'request_id': 'req-2bcf6581-4a19-4d76-930e-002b983e12c6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.267302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b57ffea0c26341739a4fb1e83d10832c', 'request_id': 'req-2bcf6581-4a19-4d76-930e-002b983e12c6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.281139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b57ffea0c26341739a4fb1e83d10832c', 'request_id': 'req-2bcf6581-4a19-4d76-930e-002b983e12c6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.326851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] The token cache is being invalidate because project b57ffea0c26341739a4fb1e83d10832c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:57.327152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.328388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.336031 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1210/2403] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:56 2022] DELETE /identity/v3/projects/b57ffea0c26341739a4fb1e83d10832c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:57.336930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:57.338295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:57.354508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132d1e0-1006-40cf-9cc7-441146a731db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:57.355590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132d1e0-1006-40cf-9cc7-441146a731db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:57.359425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132d1e0-1006-40cf-9cc7-441146a731db admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:57.359976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132d1e0-1006-40cf-9cc7-441146a731db admin admin] PATH_INFO: `/v3/users/d22cd5dd7aef49d889a3b390aa35116b` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:57.361577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132d1e0-1006-40cf-9cc7-441146a731db admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22cd5dd7aef49d889a3b390aa35116b)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:57.363729 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132d1e0-1006-40cf-9cc7-441146a731db admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:57.419110 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf6581-4a19-4d76-930e-002b983e12c6 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:57.420748 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d132d1e0-1006-40cf-9cc7-441146a731db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22cd5dd7aef49d889a3b390aa35116b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.424936 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:57.426058 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:57.426236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:57.426615 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] PATH_INFO: `/v3/projects/103de5b1e74c4abea95782852316efbe` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:57.428040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=103de5b1e74c4abea95782852316efbe)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:57.430380 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:57.443083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d132d1e0-1006-40cf-9cc7-441146a731db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22cd5dd7aef49d889a3b390aa35116b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.453617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d132d1e0-1006-40cf-9cc7-441146a731db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22cd5dd7aef49d889a3b390aa35116b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.454442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d132d1e0-1006-40cf-9cc7-441146a731db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22cd5dd7aef49d889a3b390aa35116b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.455848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d132d1e0-1006-40cf-9cc7-441146a731db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22cd5dd7aef49d889a3b390aa35116b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.486227 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103de5b1e74c4abea95782852316efbe', 'request_id': 'req-6d58800c-cd6e-4c22-8211-b078a340fb7a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.499983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103de5b1e74c4abea95782852316efbe', 'request_id': 'req-6d58800c-cd6e-4c22-8211-b078a340fb7a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.501506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1194/2404] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:57 2022] DELETE /identity/v3/users/d22cd5dd7aef49d889a3b390aa35116b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:57.503779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1b35-5a64-448d-acf0-d3e808d20b23 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:57.504329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1b35-5a64-448d-acf0-d3e808d20b23 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:57.504906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1b35-5a64-448d-acf0-d3e808d20b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:57.524089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103de5b1e74c4abea95782852316efbe', 'request_id': 'req-6d58800c-cd6e-4c22-8211-b078a340fb7a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.529474 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f48a1b35-5a64-448d-acf0-d3e808d20b23 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:57.531787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f48a1b35-5a64-448d-acf0-d3e808d20b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:57.537341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] The token cache is being invalidate because project 103de5b1e74c4abea95782852316efbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:57.537630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.538635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.540924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1211/2405] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:57 2022] DELETE /identity/v3/projects/103de5b1e74c4abea95782852316efbe => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:57.545367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:57.558461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:57.663074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1195/2406] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:57.672005 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c79fc-5cb5-4299-9e7b-358eab776ecc None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:57.672298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c79fc-5cb5-4299-9e7b-358eab776ecc None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:57.672573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c79fc-5cb5-4299-9e7b-358eab776ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:57.687433 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58800c-cd6e-4c22-8211-b078a340fb7a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:57.713521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:57.714426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:57.714708 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:57.715063 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] PATH_INFO: `/v3/users/94c9baf3c226417e807cdb8456d0f863` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:57.716550 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c9baf3c226417e807cdb8456d0f863)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:57.718512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:57.728254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-7e7c79fc-5cb5-4299-9e7b-358eab776ecc None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:57.729928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7e7c79fc-5cb5-4299-9e7b-358eab776ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:57.750559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1196/2407] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:57.755454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c79fc-5cb5-4299-9e7b-358eab776ecc None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:57.773549 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c79fc-5cb5-4299-9e7b-358eab776ecc None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:57.797536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195462a-e642-4810-a072-48e05af4ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:57.800315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195462a-e642-4810-a072-48e05af4ebe3 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:57.800315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195462a-e642-4810-a072-48e05af4ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:57.800658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195462a-e642-4810-a072-48e05af4ebe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:57.801338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195462a-e642-4810-a072-48e05af4ebe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:57.801668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195462a-e642-4810-a072-48e05af4ebe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:57.803281 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195462a-e642-4810-a072-48e05af4ebe3 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:57.808713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c9baf3c226417e807cdb8456d0f863'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.823641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c9baf3c226417e807cdb8456d0f863'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.825949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c9baf3c226417e807cdb8456d0f863'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.828501 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1197/2408] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:49:57.836329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195462a-e642-4810-a072-48e05af4ebe3 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:57.836951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c9baf3c226417e807cdb8456d0f863'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.840563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-5195462a-e642-4810-a072-48e05af4ebe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:57.872537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195462a-e642-4810-a072-48e05af4ebe3 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:57.879771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c9baf3c226417e807cdb8456d0f863'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:57.882789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe944e-9454-4239-b61c-beea9d756079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:57.883562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe944e-9454-4239-b61c-beea9d756079 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:57.883894 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe944e-9454-4239-b61c-beea9d756079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:57.884337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe944e-9454-4239-b61c-beea9d756079 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:57.885485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe944e-9454-4239-b61c-beea9d756079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:57.887885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe944e-9454-4239-b61c-beea9d756079 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:57.895583 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1212/2409] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:57 2022] DELETE /identity/v3/users/94c9baf3c226417e807cdb8456d0f863 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:57.952873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1198/2410] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:57 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:57.956961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.030869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4096670-3cb3-4498-91ea-e0848fe451fc admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.094132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe944e-9454-4239-b61c-beea9d756079 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.097644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cdbe944e-9454-4239-b61c-beea9d756079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:58.150841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7028f0-c2f7-4edf-a20e-6daf8c966a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.152216 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7028f0-c2f7-4edf-a20e-6daf8c966a93 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.153253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7028f0-c2f7-4edf-a20e-6daf8c966a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.154681 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7028f0-c2f7-4edf-a20e-6daf8c966a93 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.156893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7028f0-c2f7-4edf-a20e-6daf8c966a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.161674 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7028f0-c2f7-4edf-a20e-6daf8c966a93 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.214392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1213/2411] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:57 2022] POST /identity/v3/users => generated 284 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:49:58.216187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7028f0-c2f7-4edf-a20e-6daf8c966a93 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.231010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7028f0-c2f7-4edf-a20e-6daf8c966a93 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.239108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54f515-4818-4452-97f3-5a48a8eb4160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.239913 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54f515-4818-4452-97f3-5a48a8eb4160 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.240265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54f515-4818-4452-97f3-5a48a8eb4160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.240569 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54f515-4818-4452-97f3-5a48a8eb4160 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.241314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54f515-4818-4452-97f3-5a48a8eb4160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.242981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54f515-4818-4452-97f3-5a48a8eb4160 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.246723 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe944e-9454-4239-b61c-beea9d756079 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.255401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.256694 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.257064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.257666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] PATH_INFO: `/v3/projects/d04c7b60c27d4aef98ec8d00604e3001` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.259082 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04c7b60c27d4aef98ec8d00604e3001)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.261563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.264479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1214/2412] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:58.265366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54f515-4818-4452-97f3-5a48a8eb4160 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.276235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54f515-4818-4452-97f3-5a48a8eb4160 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.284631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53405c-9d49-44c4-83a0-22fa22957124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.286105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53405c-9d49-44c4-83a0-22fa22957124 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.286405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53405c-9d49-44c4-83a0-22fa22957124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.286686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53405c-9d49-44c4-83a0-22fa22957124 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.287457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53405c-9d49-44c4-83a0-22fa22957124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.289235 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53405c-9d49-44c4-83a0-22fa22957124 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.302829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1215/2413] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:58.305230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53405c-9d49-44c4-83a0-22fa22957124 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.307475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-8b53405c-9d49-44c4-83a0-22fa22957124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:58.325240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53405c-9d49-44c4-83a0-22fa22957124 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.338739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04c7b60c27d4aef98ec8d00604e3001', 'request_id': 'req-e7590bfb-7058-46ac-94d2-d4aa60a13cad'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:58.344959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04c7b60c27d4aef98ec8d00604e3001', 'request_id': 'req-e7590bfb-7058-46ac-94d2-d4aa60a13cad'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:58.354174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04c7b60c27d4aef98ec8d00604e3001', 'request_id': 'req-e7590bfb-7058-46ac-94d2-d4aa60a13cad'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:58.368962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] The token cache is being invalidate because project d04c7b60c27d4aef98ec8d00604e3001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:58.369305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:58.369975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:58.371658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1199/2414] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:58 2022] DELETE /identity/v3/projects/d04c7b60c27d4aef98ec8d00604e3001 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:58.376053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.377741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:58.391269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7340f-f09d-44e5-8a46-4bb1676707a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.393494 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7340f-f09d-44e5-8a46-4bb1676707a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.394035 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7340f-f09d-44e5-8a46-4bb1676707a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.394382 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7340f-f09d-44e5-8a46-4bb1676707a6 admin admin] PATH_INFO: `/v3/projects/b860a733ccd041c1b147d68c7dbbb948` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.395799 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7340f-f09d-44e5-8a46-4bb1676707a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b860a733ccd041c1b147d68c7dbbb948)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.398083 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7340f-f09d-44e5-8a46-4bb1676707a6 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.451263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7590bfb-7058-46ac-94d2-d4aa60a13cad admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.456648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6cf7340f-f09d-44e5-8a46-4bb1676707a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b860a733ccd041c1b147d68c7dbbb948', 'request_id': 'req-6cf7340f-f09d-44e5-8a46-4bb1676707a6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:58.463114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6cf7340f-f09d-44e5-8a46-4bb1676707a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b860a733ccd041c1b147d68c7dbbb948', 'request_id': 'req-6cf7340f-f09d-44e5-8a46-4bb1676707a6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:58.472961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6cf7340f-f09d-44e5-8a46-4bb1676707a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b860a733ccd041c1b147d68c7dbbb948', 'request_id': 'req-6cf7340f-f09d-44e5-8a46-4bb1676707a6'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:58.486974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6cf7340f-f09d-44e5-8a46-4bb1676707a6 admin admin] The token cache is being invalidate because project b860a733ccd041c1b147d68c7dbbb948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:49:58.487713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6cf7340f-f09d-44e5-8a46-4bb1676707a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:58.488591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6cf7340f-f09d-44e5-8a46-4bb1676707a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:58.490405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1216/2415] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:58 2022] DELETE /identity/v3/projects/b860a733ccd041c1b147d68c7dbbb948 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:58.495366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f05155-18ea-4be5-85d7-00a5e08652c2 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.495657 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f05155-18ea-4be5-85d7-00a5e08652c2 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.495924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f05155-18ea-4be5-85d7-00a5e08652c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.515512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-35f05155-18ea-4be5-85d7-00a5e08652c2 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:58.516978 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-35f05155-18ea-4be5-85d7-00a5e08652c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:58.520561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8751869-826f-4372-93e2-be029a45ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.521465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8751869-826f-4372-93e2-be029a45ddbc admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.521739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8751869-826f-4372-93e2-be029a45ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.522018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8751869-826f-4372-93e2-be029a45ddbc admin admin] PATH_INFO: `/v3/projects/50f8db7869ef42cabbb743ab6479cb3d/users/4f3c9aa6f15342c69a4315bda738465a/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.526246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1217/2416] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:58.536152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11b30b-9069-4f97-9c02-6e8ce5a723bf None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.536440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11b30b-9069-4f97-9c02-6e8ce5a723bf None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.536718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11b30b-9069-4f97-9c02-6e8ce5a723bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.539605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8751869-826f-4372-93e2-be029a45ddbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f8db7869ef42cabbb743ab6479cb3d, user_id=4f3c9aa6f15342c69a4315bda738465a, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.542311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8751869-826f-4372-93e2-be029a45ddbc admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.555448 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ce11b30b-9069-4f97-9c02-6e8ce5a723bf None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:58.556846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1200/2417] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:58 2022] PUT /identity/v3/projects/50f8db7869ef42cabbb743ab6479cb3d/users/4f3c9aa6f15342c69a4315bda738465a/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:58.556964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ce11b30b-9069-4f97-9c02-6e8ce5a723bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:58.567549 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03aac35-8cef-4ea9-a39e-f9f7651aee6b None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.567855 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03aac35-8cef-4ea9-a39e-f9f7651aee6b None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.568217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03aac35-8cef-4ea9-a39e-f9f7651aee6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.593678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-d03aac35-8cef-4ea9-a39e-f9f7651aee6b None None] MFA Rules not processed for user `4f3c9aa6f15342c69a4315bda738465a`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:58.594859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d03aac35-8cef-4ea9-a39e-f9f7651aee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:58.616637 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1218/2418] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:49:58.620717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11b30b-9069-4f97-9c02-6e8ce5a723bf None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.629843 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11b30b-9069-4f97-9c02-6e8ce5a723bf None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.634547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7c8ac-c406-42e3-98df-0a78251f2852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.635192 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7c8ac-c406-42e3-98df-0a78251f2852 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.635506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7c8ac-c406-42e3-98df-0a78251f2852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.635783 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7c8ac-c406-42e3-98df-0a78251f2852 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.636507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7c8ac-c406-42e3-98df-0a78251f2852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:49:58.636817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7c8ac-c406-42e3-98df-0a78251f2852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.638608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7c8ac-c406-42e3-98df-0a78251f2852 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.653709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1219/2419] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:49:58.654634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7c8ac-c406-42e3-98df-0a78251f2852 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.656824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1201/2420] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:58.665495 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7c8ac-c406-42e3-98df-0a78251f2852 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.668392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03aac35-8cef-4ea9-a39e-f9f7651aee6b None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.669738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d03aac35-8cef-4ea9-a39e-f9f7651aee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:58.670269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9b718-071b-4dbc-8aaf-f61ade2c9171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.670954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9b718-071b-4dbc-8aaf-f61ade2c9171 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.671270 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9b718-071b-4dbc-8aaf-f61ade2c9171 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.671547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9b718-071b-4dbc-8aaf-f61ade2c9171 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.672248 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9b718-071b-4dbc-8aaf-f61ade2c9171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.674137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9b718-071b-4dbc-8aaf-f61ade2c9171 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.699747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1220/2421] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:49:58 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:58.703732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9b718-071b-4dbc-8aaf-f61ade2c9171 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.726890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03aac35-8cef-4ea9-a39e-f9f7651aee6b None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.762507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9b718-071b-4dbc-8aaf-f61ade2c9171 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.767152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cdc3d-b274-4f02-875d-19eaae39e54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.768362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cdc3d-b274-4f02-875d-19eaae39e54f admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.768643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cdc3d-b274-4f02-875d-19eaae39e54f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.768914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cdc3d-b274-4f02-875d-19eaae39e54f admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.769587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cdc3d-b274-4f02-875d-19eaae39e54f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.771516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cdc3d-b274-4f02-875d-19eaae39e54f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.773128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a89cc-8694-420f-bf51-52136c4eb53d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf2b88cc78d4defa7cefb7bf0ae6144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.773763 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a89cc-8694-420f-bf51-52136c4eb53d service glance] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.774042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a89cc-8694-420f-bf51-52136c4eb53d service glance] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.774315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a89cc-8694-420f-bf51-52136c4eb53d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.793635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1221/2422] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:49:58 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:49:58.797527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cdc3d-b274-4f02-875d-19eaae39e54f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.806970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cdc3d-b274-4f02-875d-19eaae39e54f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.811584 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59641be2-e599-465f-9265-cd6a25a9c155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.812224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59641be2-e599-465f-9265-cd6a25a9c155 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.812504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59641be2-e599-465f-9265-cd6a25a9c155 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.812778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59641be2-e599-465f-9265-cd6a25a9c155 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.813492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59641be2-e599-465f-9265-cd6a25a9c155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.815877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59641be2-e599-465f-9265-cd6a25a9c155 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.825412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1222/2423] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:49:58.829449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59641be2-e599-465f-9265-cd6a25a9c155 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.835699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a89cc-8694-420f-bf51-52136c4eb53d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.837133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a89cc-8694-420f-bf51-52136c4eb53d service glance] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.839499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59641be2-e599-465f-9265-cd6a25a9c155 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.844257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5425e-07ee-4cca-b8b4-f00d52208eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.844888 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5425e-07ee-4cca-b8b4-f00d52208eee admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.845170 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5425e-07ee-4cca-b8b4-f00d52208eee admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.845468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5425e-07ee-4cca-b8b4-f00d52208eee admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.846012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1202/2424] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:58.846346 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5425e-07ee-4cca-b8b4-f00d52208eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.848148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5425e-07ee-4cca-b8b4-f00d52208eee admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.859241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1223/2425] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:49:58.862843 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a89cc-8694-420f-bf51-52136c4eb53d service glance] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:58.873745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a89cc-8694-420f-bf51-52136c4eb53d service glance] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:58.878872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e7d65-7798-4d22-ac18-ab92cbb61a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:58.879806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e7d65-7798-4d22-ac18-ab92cbb61a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.880200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e7d65-7798-4d22-ac18-ab92cbb61a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.880479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e7d65-7798-4d22-ac18-ab92cbb61a5e admin admin] PATH_INFO: `/v3/projects/3b247ac663df481cb07ef27e3759d6fe/users/e9277fe48f24411299df2224a16ee823/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.895553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e7d65-7798-4d22-ac18-ab92cbb61a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b247ac663df481cb07ef27e3759d6fe, user_id=e9277fe48f24411299df2224a16ee823, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:58.898177 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e7d65-7798-4d22-ac18-ab92cbb61a5e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:58.912679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1203/2426] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:49:58 2022] PUT /identity/v3/projects/3b247ac663df481cb07ef27e3759d6fe/users/e9277fe48f24411299df2224a16ee823/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:49:58.917647 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc19b9c-0bc2-492a-b15b-f1b1e7dd80d1 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:58.917939 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc19b9c-0bc2-492a-b15b-f1b1e7dd80d1 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:58.918249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc19b9c-0bc2-492a-b15b-f1b1e7dd80d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:58.935959 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-4bc19b9c-0bc2-492a-b15b-f1b1e7dd80d1 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:58.937178 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4bc19b9c-0bc2-492a-b15b-f1b1e7dd80d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:58.999335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e7d65-7798-4d22-ac18-ab92cbb61a5e admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:59.001062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2d3e7d65-7798-4d22-ac18-ab92cbb61a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:59.008989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1224/2427] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:59.017184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e7d65-7798-4d22-ac18-ab92cbb61a5e admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:59.021472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc19b9c-0bc2-492a-b15b-f1b1e7dd80d1 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:59.022692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63c4a3-220f-45ce-bc46-d17eeaa5c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:59.023166 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4bc19b9c-0bc2-492a-b15b-f1b1e7dd80d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:59.023604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63c4a3-220f-45ce-bc46-d17eeaa5c9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:59.023886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63c4a3-220f-45ce-bc46-d17eeaa5c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:59.024162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63c4a3-220f-45ce-bc46-d17eeaa5c9df admin admin] PATH_INFO: `/v3/users/65701efe3b9546cbb3ea9a671fee6c30` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:59.025326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63c4a3-220f-45ce-bc46-d17eeaa5c9df admin admin] RBAC: Authorizing `identity:delete_user(user_id=65701efe3b9546cbb3ea9a671fee6c30)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:59.027263 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63c4a3-220f-45ce-bc46-d17eeaa5c9df admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:59.084764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7d63c4a3-220f-45ce-bc46-d17eeaa5c9df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65701efe3b9546cbb3ea9a671fee6c30'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:59.093282 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7d63c4a3-220f-45ce-bc46-d17eeaa5c9df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65701efe3b9546cbb3ea9a671fee6c30'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:59.100496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc19b9c-0bc2-492a-b15b-f1b1e7dd80d1 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:59.102000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7d63c4a3-220f-45ce-bc46-d17eeaa5c9df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65701efe3b9546cbb3ea9a671fee6c30'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:59.102697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7d63c4a3-220f-45ce-bc46-d17eeaa5c9df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65701efe3b9546cbb3ea9a671fee6c30'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:59.103451 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7d63c4a3-220f-45ce-bc46-d17eeaa5c9df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65701efe3b9546cbb3ea9a671fee6c30'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:49:59.105347 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e2e92-257b-41c0-a0f9-ebe4522b9050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:59.106141 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e2e92-257b-41c0-a0f9-ebe4522b9050 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:59.106443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e2e92-257b-41c0-a0f9-ebe4522b9050 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:59.106724 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e2e92-257b-41c0-a0f9-ebe4522b9050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:59.108617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e26e2e92-257b-41c0-a0f9-ebe4522b9050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:59.120689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1204/2428] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:49:58 2022] DELETE /identity/v3/users/65701efe3b9546cbb3ea9a671fee6c30 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:49:59.122894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e2e92-257b-41c0-a0f9-ebe4522b9050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:59.124946 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63577fae-138d-41d7-9fc1-51a127bae5f6 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:59.125080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e2e92-257b-41c0-a0f9-ebe4522b9050 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:59.125551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63577fae-138d-41d7-9fc1-51a127bae5f6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:59.125738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63577fae-138d-41d7-9fc1-51a127bae5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:59.140100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1225/2429] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:49:59.146086 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-63577fae-138d-41d7-9fc1-51a127bae5f6 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:49:59.147575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-63577fae-138d-41d7-9fc1-51a127bae5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:59.235539 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1205/2430] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:49:59.252866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e2e92-257b-41c0-a0f9-ebe4522b9050 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:59.254312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e26e2e92-257b-41c0-a0f9-ebe4522b9050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:59.276333 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e2e92-257b-41c0-a0f9-ebe4522b9050 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:49:59.356754 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37966fab-abe2-47a0-ad82-68c59550075d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:49:59.358340 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37966fab-abe2-47a0-ad82-68c59550075d service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:49:59.358630 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37966fab-abe2-47a0-ad82-68c59550075d service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:49:59.358941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37966fab-abe2-47a0-ad82-68c59550075d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:49:59.386850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37966fab-abe2-47a0-ad82-68c59550075d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:49:59.388374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37966fab-abe2-47a0-ad82-68c59550075d service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:49:59.399518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1226/2431] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:49:59.977710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63577fae-138d-41d7-9fc1-51a127bae5f6 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:49:59.980073 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-63577fae-138d-41d7-9fc1-51a127bae5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:49:59.995381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63577fae-138d-41d7-9fc1-51a127bae5f6 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:00.003321 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b47cff-1891-4290-a14d-444953286e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:00.005859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b47cff-1891-4290-a14d-444953286e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:00.006340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b47cff-1891-4290-a14d-444953286e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:00.007016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b47cff-1891-4290-a14d-444953286e18 admin admin] PATH_INFO: `/v3/projects/e41057c9b1f4427ca9da10f589541a95` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:00.009092 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b47cff-1891-4290-a14d-444953286e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41057c9b1f4427ca9da10f589541a95)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:00.012483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b47cff-1891-4290-a14d-444953286e18 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:00.089337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd8f07-fedf-44bd-9094-1b222a4d5a84 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:00.089776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd8f07-fedf-44bd-9094-1b222a4d5a84 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:00.090057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd8f07-fedf-44bd-9094-1b222a4d5a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:00.101762 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-74b47cff-1891-4290-a14d-444953286e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41057c9b1f4427ca9da10f589541a95', 'request_id': 'req-74b47cff-1891-4290-a14d-444953286e18'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:00.109147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-74b47cff-1891-4290-a14d-444953286e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41057c9b1f4427ca9da10f589541a95', 'request_id': 'req-74b47cff-1891-4290-a14d-444953286e18'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:00.117483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-74b47cff-1891-4290-a14d-444953286e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41057c9b1f4427ca9da10f589541a95', 'request_id': 'req-74b47cff-1891-4290-a14d-444953286e18'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:00.136300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-74b47cff-1891-4290-a14d-444953286e18 admin admin] The token cache is being invalidate because project e41057c9b1f4427ca9da10f589541a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:50:00.136506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-cedd8f07-fedf-44bd-9094-1b222a4d5a84 None None] MFA Rules not processed for user `e9277fe48f24411299df2224a16ee823`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:00.136711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-74b47cff-1891-4290-a14d-444953286e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:00.137279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-74b47cff-1891-4290-a14d-444953286e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:00.137527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-cedd8f07-fedf-44bd-9094-1b222a4d5a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:00.139051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1206/2432] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:49:59 2022] DELETE /identity/v3/projects/e41057c9b1f4427ca9da10f589541a95 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:00.144314 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4b589-514a-4f55-a622-46b44c4cc196 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:00.144743 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4b589-514a-4f55-a622-46b44c4cc196 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:00.145035 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4b589-514a-4f55-a622-46b44c4cc196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:00.165344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f1a4b589-514a-4f55-a622-46b44c4cc196 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:00.167425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f1a4b589-514a-4f55-a622-46b44c4cc196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:00.235095 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1227/2433] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:50:00.249529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd8f07-fedf-44bd-9094-1b222a4d5a84 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:00.251095 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-cedd8f07-fedf-44bd-9094-1b222a4d5a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:00.270888 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1207/2434] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:00.273338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42283d2e-5c2a-4b96-a3aa-6fa399ec0050 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:00.273634 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42283d2e-5c2a-4b96-a3aa-6fa399ec0050 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:00.274143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42283d2e-5c2a-4b96-a3aa-6fa399ec0050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:00.306312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-42283d2e-5c2a-4b96-a3aa-6fa399ec0050 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:00.307918 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-42283d2e-5c2a-4b96-a3aa-6fa399ec0050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:00.323344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1208/2435] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:00.327434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42283d2e-5c2a-4b96-a3aa-6fa399ec0050 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:00.338739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42283d2e-5c2a-4b96-a3aa-6fa399ec0050 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:00.348119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd8f07-fedf-44bd-9094-1b222a4d5a84 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:00.350450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84b7ee-6823-40c3-ad28-9a7268d3a34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:00.351043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b7ee-6823-40c3-ad28-9a7268d3a34f admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:00.351405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b7ee-6823-40c3-ad28-9a7268d3a34f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:00.351612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b7ee-6823-40c3-ad28-9a7268d3a34f admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:00.353052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84b7ee-6823-40c3-ad28-9a7268d3a34f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:50:00.353363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84b7ee-6823-40c3-ad28-9a7268d3a34f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:00.354974 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84b7ee-6823-40c3-ad28-9a7268d3a34f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:00.363157 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f9c2c-185b-4fdd-b73c-b861c387f731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:00.364047 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f9c2c-185b-4fdd-b73c-b861c387f731 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:00.364386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f9c2c-185b-4fdd-b73c-b861c387f731 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:00.364687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f9c2c-185b-4fdd-b73c-b861c387f731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:00.374295 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1209/2436] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:50:00.379021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84b7ee-6823-40c3-ad28-9a7268d3a34f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:00.391155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f9c2c-185b-4fdd-b73c-b861c387f731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:00.392311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84b7ee-6823-40c3-ad28-9a7268d3a34f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:00.392640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f9c2c-185b-4fdd-b73c-b861c387f731 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:00.397911 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb00d9-3350-40d0-80b6-042b153bcd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:00.398600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb00d9-3350-40d0-80b6-042b153bcd2c admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:00.398878 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb00d9-3350-40d0-80b6-042b153bcd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:00.399154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb00d9-3350-40d0-80b6-042b153bcd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:00.399883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb00d9-3350-40d0-80b6-042b153bcd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:00.401792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb00d9-3350-40d0-80b6-042b153bcd2c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:00.403841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1228/2437] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:50:00.445179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1210/2438] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:50:00 2022] POST /identity/v3/projects => generated 363 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:50:00.445313 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f9c2c-185b-4fdd-b73c-b861c387f731 service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:00.462173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f9c2c-185b-4fdd-b73c-b861c387f731 service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:00.602991 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805ec92-36b9-4a54-9cff-3108c7905a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:00.603809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805ec92-36b9-4a54-9cff-3108c7905a15 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:00.604143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805ec92-36b9-4a54-9cff-3108c7905a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:00.604382 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805ec92-36b9-4a54-9cff-3108c7905a15 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:00.605056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805ec92-36b9-4a54-9cff-3108c7905a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:00.607301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805ec92-36b9-4a54-9cff-3108c7905a15 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:00.627059 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1229/2439] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:50:00 2022] POST /identity/v3/users => generated 282 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:50:00.632194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb00d9-3350-40d0-80b6-042b153bcd2c admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:00.647191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb00d9-3350-40d0-80b6-042b153bcd2c admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:00.652443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0e99c-ca9a-4307-b293-34b7594a8598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:00.653106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0e99c-ca9a-4307-b293-34b7594a8598 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:00.653396 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0e99c-ca9a-4307-b293-34b7594a8598 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:00.653676 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0e99c-ca9a-4307-b293-34b7594a8598 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:00.654404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0e99c-ca9a-4307-b293-34b7594a8598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:00.656058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0e99c-ca9a-4307-b293-34b7594a8598 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:00.666964 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1211/2440] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:50:00.671332 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805ec92-36b9-4a54-9cff-3108c7905a15 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:00.683360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805ec92-36b9-4a54-9cff-3108c7905a15 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:00.688531 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e974d2e-38e4-49e7-9dc1-bc98fa8ede42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:00.689261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e974d2e-38e4-49e7-9dc1-bc98fa8ede42 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:00.689758 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e974d2e-38e4-49e7-9dc1-bc98fa8ede42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:00.690152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e974d2e-38e4-49e7-9dc1-bc98fa8ede42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:00.691251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e974d2e-38e4-49e7-9dc1-bc98fa8ede42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:00.697451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e974d2e-38e4-49e7-9dc1-bc98fa8ede42 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:00.710635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1230/2441] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:50:00.716381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0e99c-ca9a-4307-b293-34b7594a8598 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:00.730555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0e99c-ca9a-4307-b293-34b7594a8598 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:00.736645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4227f9-e2b6-47b3-9036-34f9f15c3001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:00.737786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4227f9-e2b6-47b3-9036-34f9f15c3001 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:00.743952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4227f9-e2b6-47b3-9036-34f9f15c3001 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:00.744114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4227f9-e2b6-47b3-9036-34f9f15c3001 admin admin] PATH_INFO: `/v3/projects/6fd7f04861924246a7ed18f50f1dc024/users/c3a52780187344c1844b3eab89d5737d/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:00.775069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4227f9-e2b6-47b3-9036-34f9f15c3001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd7f04861924246a7ed18f50f1dc024, user_id=c3a52780187344c1844b3eab89d5737d, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:00.780107 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4227f9-e2b6-47b3-9036-34f9f15c3001 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:00.801061 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1212/2442] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:50:00 2022] PUT /identity/v3/projects/6fd7f04861924246a7ed18f50f1dc024/users/c3a52780187344c1844b3eab89d5737d/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:00.815104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243f140-290a-425e-a300-b17f647e899f None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:00.817544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243f140-290a-425e-a300-b17f647e899f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:00.817953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243f140-290a-425e-a300-b17f647e899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:00.870244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-7243f140-290a-425e-a300-b17f647e899f None None] MFA Rules not processed for user `c3a52780187344c1844b3eab89d5737d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:00.871703 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7243f140-290a-425e-a300-b17f647e899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:00.960297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1231/2443] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:00.967952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4227f9-e2b6-47b3-9036-34f9f15c3001 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:01.043476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4227f9-e2b6-47b3-9036-34f9f15c3001 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:01.046953 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f14571-218b-4f5d-8252-6c9eade95a57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:01.047628 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f14571-218b-4f5d-8252-6c9eade95a57 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:01.047907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f14571-218b-4f5d-8252-6c9eade95a57 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:01.048181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f14571-218b-4f5d-8252-6c9eade95a57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:01.057463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f14571-218b-4f5d-8252-6c9eade95a57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:01.058911 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f14571-218b-4f5d-8252-6c9eade95a57 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:01.068960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1213/2444] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:50:01.361500 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4f617-dceb-4a52-8e6f-3083cb1f2242 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:01.362320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4f617-dceb-4a52-8e6f-3083cb1f2242 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:01.362606 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4f617-dceb-4a52-8e6f-3083cb1f2242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:01.382535 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-dec4f617-dceb-4a52-8e6f-3083cb1f2242 None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:01.383764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-dec4f617-dceb-4a52-8e6f-3083cb1f2242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:01.444100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1232/2445] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:50:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:01.488144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f14571-218b-4f5d-8252-6c9eade95a57 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:01.489601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-47f14571-218b-4f5d-8252-6c9eade95a57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:01.561185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f14571-218b-4f5d-8252-6c9eade95a57 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:01.566938 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c5a68-553f-42a5-aadd-9381a4cc7ab8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:01.567602 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c5a68-553f-42a5-aadd-9381a4cc7ab8 service swift] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:01.567884 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c5a68-553f-42a5-aadd-9381a4cc7ab8 service swift] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:01.568154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c5a68-553f-42a5-aadd-9381a4cc7ab8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:01.576075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c5a68-553f-42a5-aadd-9381a4cc7ab8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:01.577636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c5a68-553f-42a5-aadd-9381a4cc7ab8 service swift] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:01.585520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1214/2446] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:50:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 13:50:01.869089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03359c95-c6f4-4b17-9e30-69e6326b75c7 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:01.869315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03359c95-c6f4-4b17-9e30-69e6326b75c7 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:01.869586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03359c95-c6f4-4b17-9e30-69e6326b75c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:01.887579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-03359c95-c6f4-4b17-9e30-69e6326b75c7 None None] MFA Rules not processed for user `e9277fe48f24411299df2224a16ee823`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:01.888886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-03359c95-c6f4-4b17-9e30-69e6326b75c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:01.953143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1233/2447] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:02.135033 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a88bec-9161-4964-937c-5637c453defe None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:02.135905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a88bec-9161-4964-937c-5637c453defe None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:02.136190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a88bec-9161-4964-937c-5637c453defe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:02.162162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-21a88bec-9161-4964-937c-5637c453defe None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:02.163436 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-21a88bec-9161-4964-937c-5637c453defe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:02.171235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1215/2448] 10.222.0.73 () {58 vars in 967 bytes} [Wed May 4 13:50:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:02.184237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03359c95-c6f4-4b17-9e30-69e6326b75c7 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:02.196395 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03359c95-c6f4-4b17-9e30-69e6326b75c7 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:02.201577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ccde8-693d-48a9-bba9-75a868223bd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:02.205831 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ccde8-693d-48a9-bba9-75a868223bd7 service swift] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:02.206191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ccde8-693d-48a9-bba9-75a868223bd7 service swift] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:02.206531 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ccde8-693d-48a9-bba9-75a868223bd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:02.215271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ccde8-693d-48a9-bba9-75a868223bd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:02.216922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ccde8-693d-48a9-bba9-75a868223bd7 service swift] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:02.225661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1234/2449] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:50:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:50:02.464498 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8a75e-d58b-4d38-9998-b88ea511cc0d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:02.464796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8a75e-d58b-4d38-9998-b88ea511cc0d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:02.465079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8a75e-d58b-4d38-9998-b88ea511cc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:02.486636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-3ec8a75e-d58b-4d38-9998-b88ea511cc0d None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:02.488030 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3ec8a75e-d58b-4d38-9998-b88ea511cc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:02.496894 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1216/2450] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:50:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:02.520263 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ccde8-693d-48a9-bba9-75a868223bd7 service swift] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:02.525834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ccde8-693d-48a9-bba9-75a868223bd7 service swift] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:02.531403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78436841-3f2a-4944-bad9-c8779686e7aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:02.532090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78436841-3f2a-4944-bad9-c8779686e7aa service swift] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:02.532402 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78436841-3f2a-4944-bad9-c8779686e7aa service swift] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:02.532678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78436841-3f2a-4944-bad9-c8779686e7aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:02.541885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78436841-3f2a-4944-bad9-c8779686e7aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:02.543478 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78436841-3f2a-4944-bad9-c8779686e7aa service swift] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:02.558083 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1235/2451] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:50:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:50:02.976012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6689e25-3881-442d-a16a-0c64990a51de None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:02.976306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6689e25-3881-442d-a16a-0c64990a51de None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:02.976588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6689e25-3881-442d-a16a-0c64990a51de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:03.022966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f6689e25-3881-442d-a16a-0c64990a51de None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:03.024514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f6689e25-3881-442d-a16a-0c64990a51de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:03.033988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1217/2452] 10.222.0.73 () {58 vars in 967 bytes} [Wed May 4 13:50:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:03.052836 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78436841-3f2a-4944-bad9-c8779686e7aa service swift] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:03.067609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78436841-3f2a-4944-bad9-c8779686e7aa service swift] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:03.073232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e78042-7342-417e-b4bf-641e532bd79b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:03.073883 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e78042-7342-417e-b4bf-641e532bd79b service swift] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:03.074165 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e78042-7342-417e-b4bf-641e532bd79b service swift] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:03.074441 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e78042-7342-417e-b4bf-641e532bd79b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:03.082961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e78042-7342-417e-b4bf-641e532bd79b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:03.084559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e78042-7342-417e-b4bf-641e532bd79b service swift] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:03.092498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1236/2453] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:50:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:50:05.277528 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6689e25-3881-442d-a16a-0c64990a51de None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:05.278970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f6689e25-3881-442d-a16a-0c64990a51de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:05.363066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6689e25-3881-442d-a16a-0c64990a51de None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:05.368726 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:05.369603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:05.369885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:05.370168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] PATH_INFO: `/v3/users/b555d88504ad4580a35d061b938c8d7a` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:05.371439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b555d88504ad4580a35d061b938c8d7a)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:05.373521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:05.435790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b555d88504ad4580a35d061b938c8d7a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:05.445112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b555d88504ad4580a35d061b938c8d7a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:05.453852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b555d88504ad4580a35d061b938c8d7a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:05.457083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b555d88504ad4580a35d061b938c8d7a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:05.457426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b555d88504ad4580a35d061b938c8d7a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:05.475169 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1218/2454] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:50:05 2022] DELETE /identity/v3/users/b555d88504ad4580a35d061b938c8d7a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:05.479732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa546721-73de-43a7-918e-4ecb94ddcc6c None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:05.480660 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa546721-73de-43a7-918e-4ecb94ddcc6c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:05.481111 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa546721-73de-43a7-918e-4ecb94ddcc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:05.506685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-aa546721-73de-43a7-918e-4ecb94ddcc6c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:05.508331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-aa546721-73de-43a7-918e-4ecb94ddcc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:05.577752 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1237/2455] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:05.588453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:05.590214 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:05.654205 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3a1ef-bab7-4f43-9ed7-551043fd21b5 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:05.658625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c1edc-bf71-4c87-8281-1c49504d7916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:05.659405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c1edc-bf71-4c87-8281-1c49504d7916 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:05.659722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c1edc-bf71-4c87-8281-1c49504d7916 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:05.660043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c1edc-bf71-4c87-8281-1c49504d7916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:05.669640 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c1edc-bf71-4c87-8281-1c49504d7916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:05.671061 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c1edc-bf71-4c87-8281-1c49504d7916 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:05.681821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1219/2456] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:50:05.866838 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa546721-73de-43a7-918e-4ecb94ddcc6c None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:05.868451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-aa546721-73de-43a7-918e-4ecb94ddcc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:05.881874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa546721-73de-43a7-918e-4ecb94ddcc6c None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:05.887659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45e058-232a-4f76-abf0-38d367f87a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:05.888649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45e058-232a-4f76-abf0-38d367f87a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:05.889028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45e058-232a-4f76-abf0-38d367f87a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:05.889398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45e058-232a-4f76-abf0-38d367f87a96 admin admin] PATH_INFO: `/v3/projects/4144b8f8d82547e0bda57e65a659d3c8` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:05.890704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45e058-232a-4f76-abf0-38d367f87a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4144b8f8d82547e0bda57e65a659d3c8)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:05.893309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45e058-232a-4f76-abf0-38d367f87a96 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:05.948029 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5c45e058-232a-4f76-abf0-38d367f87a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4144b8f8d82547e0bda57e65a659d3c8', 'request_id': 'req-5c45e058-232a-4f76-abf0-38d367f87a96'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:05.954228 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5c45e058-232a-4f76-abf0-38d367f87a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4144b8f8d82547e0bda57e65a659d3c8', 'request_id': 'req-5c45e058-232a-4f76-abf0-38d367f87a96'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:05.961663 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5c45e058-232a-4f76-abf0-38d367f87a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4144b8f8d82547e0bda57e65a659d3c8', 'request_id': 'req-5c45e058-232a-4f76-abf0-38d367f87a96'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:05.989453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5c45e058-232a-4f76-abf0-38d367f87a96 admin admin] The token cache is being invalidate because project 4144b8f8d82547e0bda57e65a659d3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:50:05.989453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5c45e058-232a-4f76-abf0-38d367f87a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:05.989453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5c45e058-232a-4f76-abf0-38d367f87a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:05.989453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1238/2457] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:50:05 2022] DELETE /identity/v3/projects/4144b8f8d82547e0bda57e65a659d3c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:05.989803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c102b45-0354-4512-9b43-5526ac5e3634 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:05.989803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c102b45-0354-4512-9b43-5526ac5e3634 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:05.989803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c102b45-0354-4512-9b43-5526ac5e3634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:06.008239 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6c102b45-0354-4512-9b43-5526ac5e3634 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:06.009423 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6c102b45-0354-4512-9b43-5526ac5e3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:06.086844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1220/2458] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:06.095134 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c7ae9-2bb0-4a0a-bb64-37fc4da7764c None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:06.095723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c7ae9-2bb0-4a0a-bb64-37fc4da7764c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:06.096154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c7ae9-2bb0-4a0a-bb64-37fc4da7764c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:06.115965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-5b9c7ae9-2bb0-4a0a-bb64-37fc4da7764c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:06.117146 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5b9c7ae9-2bb0-4a0a-bb64-37fc4da7764c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:06.125341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1239/2459] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:50:06.130292 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c102b45-0354-4512-9b43-5526ac5e3634 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:06.140072 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c102b45-0354-4512-9b43-5526ac5e3634 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:06.145419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1cce7-6387-4868-ba24-6554557270d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:06.146114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1cce7-6387-4868-ba24-6554557270d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:06.146462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1cce7-6387-4868-ba24-6554557270d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:06.146810 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1cce7-6387-4868-ba24-6554557270d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:06.147734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1cce7-6387-4868-ba24-6554557270d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:50:06.148059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1cce7-6387-4868-ba24-6554557270d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:06.149713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1cce7-6387-4868-ba24-6554557270d5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:06.165835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1221/2460] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:50:06.167066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c7ae9-2bb0-4a0a-bb64-37fc4da7764c None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:06.177413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c7ae9-2bb0-4a0a-bb64-37fc4da7764c None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:06.182087 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15de905-ce61-4bcb-9d8a-44c0c56594bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:06.182752 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de905-ce61-4bcb-9d8a-44c0c56594bf admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:06.183035 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de905-ce61-4bcb-9d8a-44c0c56594bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:06.183348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de905-ce61-4bcb-9d8a-44c0c56594bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:06.184049 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15de905-ce61-4bcb-9d8a-44c0c56594bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:06.185957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15de905-ce61-4bcb-9d8a-44c0c56594bf admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:06.218349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1240/2461] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:50:06 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:50:06.222621 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1cce7-6387-4868-ba24-6554557270d5 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:06.233625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1cce7-6387-4868-ba24-6554557270d5 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:06.295039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31952106-a0ce-4927-a1e0-b1ce94760e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:06.295829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31952106-a0ce-4927-a1e0-b1ce94760e08 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:06.296203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31952106-a0ce-4927-a1e0-b1ce94760e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:06.296722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31952106-a0ce-4927-a1e0-b1ce94760e08 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:06.297521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31952106-a0ce-4927-a1e0-b1ce94760e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:06.300173 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31952106-a0ce-4927-a1e0-b1ce94760e08 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:06.322105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1222/2462] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:50:06 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:50:06.325636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15de905-ce61-4bcb-9d8a-44c0c56594bf admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:06.336322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15de905-ce61-4bcb-9d8a-44c0c56594bf admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:06.341277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45363c-b12a-4f6e-bacc-871754c225e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:06.341941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45363c-b12a-4f6e-bacc-871754c225e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:06.342225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45363c-b12a-4f6e-bacc-871754c225e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:06.342498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45363c-b12a-4f6e-bacc-871754c225e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:06.343250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45363c-b12a-4f6e-bacc-871754c225e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:06.344826 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45363c-b12a-4f6e-bacc-871754c225e7 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:06.359398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1241/2463] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:50:06.362043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31952106-a0ce-4927-a1e0-b1ce94760e08 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:06.372788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31952106-a0ce-4927-a1e0-b1ce94760e08 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:06.377604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bb925-61f5-4be9-9d1c-70402c7cc4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:06.378270 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bb925-61f5-4be9-9d1c-70402c7cc4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:06.378552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bb925-61f5-4be9-9d1c-70402c7cc4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:06.378828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bb925-61f5-4be9-9d1c-70402c7cc4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:06.379609 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bb925-61f5-4be9-9d1c-70402c7cc4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:06.381203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bb925-61f5-4be9-9d1c-70402c7cc4c1 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:06.391031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1223/2464] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:50:06.395336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45363c-b12a-4f6e-bacc-871754c225e7 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:06.405348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45363c-b12a-4f6e-bacc-871754c225e7 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:06.410820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f06473-a53c-44e5-b412-d2ebf9a5b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:06.411750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f06473-a53c-44e5-b412-d2ebf9a5b880 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:06.412033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f06473-a53c-44e5-b412-d2ebf9a5b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:06.412307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f06473-a53c-44e5-b412-d2ebf9a5b880 admin admin] PATH_INFO: `/v3/projects/05f64d63ad6d44dca07315ac8fd865e5/users/30809c6c3edc4262b48ceb548ed18fce/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:06.437723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f06473-a53c-44e5-b412-d2ebf9a5b880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f64d63ad6d44dca07315ac8fd865e5, user_id=30809c6c3edc4262b48ceb548ed18fce, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:06.440744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f06473-a53c-44e5-b412-d2ebf9a5b880 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:06.453941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1242/2465] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:50:06 2022] PUT /identity/v3/projects/05f64d63ad6d44dca07315ac8fd865e5/users/30809c6c3edc4262b48ceb548ed18fce/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:06.458907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50093f20-471f-4201-81e1-5145390e6c3e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:06.459242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50093f20-471f-4201-81e1-5145390e6c3e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:06.459533 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50093f20-471f-4201-81e1-5145390e6c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:06.478184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-50093f20-471f-4201-81e1-5145390e6c3e None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:06.479761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-50093f20-471f-4201-81e1-5145390e6c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:06.539583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1224/2466] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:06.550015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f06473-a53c-44e5-b412-d2ebf9a5b880 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:06.551730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a4f06473-a53c-44e5-b412-d2ebf9a5b880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:06.615518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f06473-a53c-44e5-b412-d2ebf9a5b880 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:06.619851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461bb41-c9bf-45bb-8a63-772eea6dee60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:06.620548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461bb41-c9bf-45bb-8a63-772eea6dee60 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:06.620927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461bb41-c9bf-45bb-8a63-772eea6dee60 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:06.621323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461bb41-c9bf-45bb-8a63-772eea6dee60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:06.630462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461bb41-c9bf-45bb-8a63-772eea6dee60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:06.631896 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461bb41-c9bf-45bb-8a63-772eea6dee60 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:06.643121 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1243/2467] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:50:12.164097 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d04cbf-6b94-46ed-b38b-d9d6c2635b2e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:12.164594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d04cbf-6b94-46ed-b38b-d9d6c2635b2e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:12.164675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d04cbf-6b94-46ed-b38b-d9d6c2635b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:12.198235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-56d04cbf-6b94-46ed-b38b-d9d6c2635b2e None None] MFA Rules not processed for user `30809c6c3edc4262b48ceb548ed18fce`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:12.199554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-56d04cbf-6b94-46ed-b38b-d9d6c2635b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:12.263075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1225/2468] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:12.267526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461bb41-c9bf-45bb-8a63-772eea6dee60 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:12.277204 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461bb41-c9bf-45bb-8a63-772eea6dee60 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:12.282318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7ef6f-4a48-41c6-9c06-ddad5f2ef281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:12.282965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7ef6f-4a48-41c6-9c06-ddad5f2ef281 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:12.283803 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7ef6f-4a48-41c6-9c06-ddad5f2ef281 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:12.284082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7ef6f-4a48-41c6-9c06-ddad5f2ef281 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:12.284779 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7ef6f-4a48-41c6-9c06-ddad5f2ef281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:12.286664 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7ef6f-4a48-41c6-9c06-ddad5f2ef281 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:12.315991 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1244/2469] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:50:12 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:50:12.317176 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d04cbf-6b94-46ed-b38b-d9d6c2635b2e None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:12.327955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d04cbf-6b94-46ed-b38b-d9d6c2635b2e None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:12.384058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a474e6-99cf-4089-aec8-4e802195f521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:12.384725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a474e6-99cf-4089-aec8-4e802195f521 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:12.385007 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a474e6-99cf-4089-aec8-4e802195f521 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:12.385283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a474e6-99cf-4089-aec8-4e802195f521 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:12.385960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a474e6-99cf-4089-aec8-4e802195f521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:12.387935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a474e6-99cf-4089-aec8-4e802195f521 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:12.409583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1226/2470] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:50:12 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:50:12.413599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7ef6f-4a48-41c6-9c06-ddad5f2ef281 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:12.424927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7ef6f-4a48-41c6-9c06-ddad5f2ef281 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:12.429997 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730bc6e-7abc-43c0-97ec-c2700edb708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:12.430668 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730bc6e-7abc-43c0-97ec-c2700edb708c admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:12.430956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730bc6e-7abc-43c0-97ec-c2700edb708c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:12.431258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730bc6e-7abc-43c0-97ec-c2700edb708c admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:12.431993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730bc6e-7abc-43c0-97ec-c2700edb708c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:12.433589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730bc6e-7abc-43c0-97ec-c2700edb708c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:12.445300 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1245/2471] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:50:12.449475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a474e6-99cf-4089-aec8-4e802195f521 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:12.459897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a474e6-99cf-4089-aec8-4e802195f521 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:12.464516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e4cd3-4679-4c5f-ab5f-70bf011ce43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:12.465386 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e4cd3-4679-4c5f-ab5f-70bf011ce43c admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:12.465665 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e4cd3-4679-4c5f-ab5f-70bf011ce43c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:12.465937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e4cd3-4679-4c5f-ab5f-70bf011ce43c admin admin] PATH_INFO: `/v3/projects/1c2f56d4b9c842568c5fc12f85dd0d3f/users/17d5ea0e077d4ffeaca1ca85adc0d8b4/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:12.480299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e4cd3-4679-4c5f-ab5f-70bf011ce43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2f56d4b9c842568c5fc12f85dd0d3f, user_id=17d5ea0e077d4ffeaca1ca85adc0d8b4, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:12.482959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e4cd3-4679-4c5f-ab5f-70bf011ce43c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:12.495178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1227/2472] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:50:12 2022] PUT /identity/v3/projects/1c2f56d4b9c842568c5fc12f85dd0d3f/users/17d5ea0e077d4ffeaca1ca85adc0d8b4/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:50:12.499052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730bc6e-7abc-43c0-97ec-c2700edb708c admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:12.509706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730bc6e-7abc-43c0-97ec-c2700edb708c admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:12.575972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7508-bd5f-4120-9795-d879bc0cdf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:12.575972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7508-bd5f-4120-9795-d879bc0cdf03 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:12.575972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7508-bd5f-4120-9795-d879bc0cdf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:12.575972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7508-bd5f-4120-9795-d879bc0cdf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:12.576482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc7508-bd5f-4120-9795-d879bc0cdf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:12.576482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc7508-bd5f-4120-9795-d879bc0cdf03 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:12.587091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1246/2473] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:50:12.590844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e4cd3-4679-4c5f-ab5f-70bf011ce43c admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:12.601308 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e4cd3-4679-4c5f-ab5f-70bf011ce43c admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:12.607509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69219ff3-fd29-4c6b-9a68-f985ff5c9a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:12.608422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69219ff3-fd29-4c6b-9a68-f985ff5c9a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:12.608823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69219ff3-fd29-4c6b-9a68-f985ff5c9a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:12.609104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69219ff3-fd29-4c6b-9a68-f985ff5c9a7d admin admin] PATH_INFO: `/v3/projects/1c2f56d4b9c842568c5fc12f85dd0d3f/users/17d5ea0e077d4ffeaca1ca85adc0d8b4/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:12.611270 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69219ff3-fd29-4c6b-9a68-f985ff5c9a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2f56d4b9c842568c5fc12f85dd0d3f, user_id=17d5ea0e077d4ffeaca1ca85adc0d8b4, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:12.613908 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69219ff3-fd29-4c6b-9a68-f985ff5c9a7d admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:12.627666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1228/2474] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:50:12 2022] PUT /identity/v3/projects/1c2f56d4b9c842568c5fc12f85dd0d3f/users/17d5ea0e077d4ffeaca1ca85adc0d8b4/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:19.110452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ec39e-dc94-4a5a-85bb-0b97168c47ad None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:19.112376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ec39e-dc94-4a5a-85bb-0b97168c47ad None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:19.113118 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ec39e-dc94-4a5a-85bb-0b97168c47ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:19.136145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-619ec39e-dc94-4a5a-85bb-0b97168c47ad None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:19.137673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-619ec39e-dc94-4a5a-85bb-0b97168c47ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:19.140299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ba50a-16b1-452b-a16c-948df1448c43 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:19.141565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ba50a-16b1-452b-a16c-948df1448c43 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:19.142112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ba50a-16b1-452b-a16c-948df1448c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:19.184530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6f7ba50a-16b1-452b-a16c-948df1448c43 None None] MFA Rules not processed for user `17d5ea0e077d4ffeaca1ca85adc0d8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:19.188605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6f7ba50a-16b1-452b-a16c-948df1448c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:19.289549 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1247/2475] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:50:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:50:19.307001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ec39e-dc94-4a5a-85bb-0b97168c47ad None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:19.309250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-619ec39e-dc94-4a5a-85bb-0b97168c47ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:19.318595 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1229/2476] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:50:19.389791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ec39e-dc94-4a5a-85bb-0b97168c47ad None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:19.395620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7952b-1a3b-4182-a5c8-1b897e37adc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:19.396290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7952b-1a3b-4182-a5c8-1b897e37adc8 service swift] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:19.396577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7952b-1a3b-4182-a5c8-1b897e37adc8 service swift] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:19.396853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7952b-1a3b-4182-a5c8-1b897e37adc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:19.406129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7952b-1a3b-4182-a5c8-1b897e37adc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:19.407786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7952b-1a3b-4182-a5c8-1b897e37adc8 service swift] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:19.417381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1248/2477] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:50:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:50:20.370704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf9bf1-d9b8-4ee4-9f84-20a34bee68bb None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:20.371447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf9bf1-d9b8-4ee4-9f84-20a34bee68bb None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:20.371552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf9bf1-d9b8-4ee4-9f84-20a34bee68bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:20.391955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-edcf9bf1-d9b8-4ee4-9f84-20a34bee68bb None None] MFA Rules not processed for user `e9277fe48f24411299df2224a16ee823`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:20.393566 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-edcf9bf1-d9b8-4ee4-9f84-20a34bee68bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:20.514026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1230/2478] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:28.829405 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7952b-1a3b-4182-a5c8-1b897e37adc8 service swift] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:28.830908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d0b7952b-1a3b-4182-a5c8-1b897e37adc8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:28.928484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7952b-1a3b-4182-a5c8-1b897e37adc8 service swift] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:28.932330 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be737a-6567-4062-b58f-ab3a46046fbd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf2b88cc78d4defa7cefb7bf0ae6144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:28.933150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be737a-6567-4062-b58f-ab3a46046fbd service glance] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:28.933648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be737a-6567-4062-b58f-ab3a46046fbd service glance] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:28.934152 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be737a-6567-4062-b58f-ab3a46046fbd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:29.016609 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be737a-6567-4062-b58f-ab3a46046fbd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:29.018059 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be737a-6567-4062-b58f-ab3a46046fbd service glance] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:29.029388 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1249/2479] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:50:29.171657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf9bf1-d9b8-4ee4-9f84-20a34bee68bb None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:29.174767 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-edcf9bf1-d9b8-4ee4-9f84-20a34bee68bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:29.227036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187d9a-15a0-4dc5-a1cc-c7ed71f1a7db None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:29.227861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187d9a-15a0-4dc5-a1cc-c7ed71f1a7db None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:29.228241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187d9a-15a0-4dc5-a1cc-c7ed71f1a7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:29.250916 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a3187d9a-15a0-4dc5-a1cc-c7ed71f1a7db None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:29.253730 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a3187d9a-15a0-4dc5-a1cc-c7ed71f1a7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:29.262178 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1250/2480] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:50:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:29.279658 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187d9a-15a0-4dc5-a1cc-c7ed71f1a7db None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:29.317525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187d9a-15a0-4dc5-a1cc-c7ed71f1a7db None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:29.332631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbd047-f97e-4541-aff7-656653995c38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:29.333300 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbd047-f97e-4541-aff7-656653995c38 service swift] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:29.333582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbd047-f97e-4541-aff7-656653995c38 service swift] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:29.333860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbd047-f97e-4541-aff7-656653995c38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:29.350002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbd047-f97e-4541-aff7-656653995c38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:29.351701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbd047-f97e-4541-aff7-656653995c38 service swift] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:29.362340 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1251/2481] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:50:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 13:50:29.390705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf9bf1-d9b8-4ee4-9f84-20a34bee68bb None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:29.395812 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:29.396692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:29.396970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:29.402283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] PATH_INFO: `/v3/users/4f3c9aa6f15342c69a4315bda738465a` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:29.402283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3c9aa6f15342c69a4315bda738465a)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:29.403682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:29.499184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3c9aa6f15342c69a4315bda738465a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:29.520229 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3c9aa6f15342c69a4315bda738465a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:29.531237 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3c9aa6f15342c69a4315bda738465a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:29.533980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3c9aa6f15342c69a4315bda738465a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:29.534604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3c9aa6f15342c69a4315bda738465a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:29.577843 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1231/2482] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:50:29 2022] DELETE /identity/v3/users/4f3c9aa6f15342c69a4315bda738465a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:29.578922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b1d36-10ec-4acd-9da9-67326759b96b None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:29.579472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b1d36-10ec-4acd-9da9-67326759b96b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:29.580208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b1d36-10ec-4acd-9da9-67326759b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:29.646766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-e76b1d36-10ec-4acd-9da9-67326759b96b None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:29.648012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e76b1d36-10ec-4acd-9da9-67326759b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:29.754182 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1252/2483] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:29.766639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:29.768304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:29.877649 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb4dd8-e147-41d8-96bb-cec1fb2cf90e admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:29.884428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877c2ec-bb29-49b7-9ffe-e4940b4080a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:29.885088 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877c2ec-bb29-49b7-9ffe-e4940b4080a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:29.885366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877c2ec-bb29-49b7-9ffe-e4940b4080a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:29.885640 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877c2ec-bb29-49b7-9ffe-e4940b4080a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:29.900173 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877c2ec-bb29-49b7-9ffe-e4940b4080a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:29.903322 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877c2ec-bb29-49b7-9ffe-e4940b4080a7 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:29.919183 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1232/2484] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:50:30.462970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b1d36-10ec-4acd-9da9-67326759b96b None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:30.464651 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e76b1d36-10ec-4acd-9da9-67326759b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:30.477986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b1d36-10ec-4acd-9da9-67326759b96b None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:30.482692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb195b1-288e-4012-bcb5-e5325fe47e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:30.484020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb195b1-288e-4012-bcb5-e5325fe47e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:30.484020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb195b1-288e-4012-bcb5-e5325fe47e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:30.484262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb195b1-288e-4012-bcb5-e5325fe47e72 admin admin] PATH_INFO: `/v3/projects/50f8db7869ef42cabbb743ab6479cb3d` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:30.485809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb195b1-288e-4012-bcb5-e5325fe47e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f8db7869ef42cabbb743ab6479cb3d)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:30.488341 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb195b1-288e-4012-bcb5-e5325fe47e72 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:30.600335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5bb195b1-288e-4012-bcb5-e5325fe47e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f8db7869ef42cabbb743ab6479cb3d', 'request_id': 'req-5bb195b1-288e-4012-bcb5-e5325fe47e72'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:30.606259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5bb195b1-288e-4012-bcb5-e5325fe47e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f8db7869ef42cabbb743ab6479cb3d', 'request_id': 'req-5bb195b1-288e-4012-bcb5-e5325fe47e72'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:30.626718 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5bb195b1-288e-4012-bcb5-e5325fe47e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f8db7869ef42cabbb743ab6479cb3d', 'request_id': 'req-5bb195b1-288e-4012-bcb5-e5325fe47e72'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:30.650872 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5bb195b1-288e-4012-bcb5-e5325fe47e72 admin admin] The token cache is being invalidate because project 50f8db7869ef42cabbb743ab6479cb3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:50:30.651365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5bb195b1-288e-4012-bcb5-e5325fe47e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:30.652927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5bb195b1-288e-4012-bcb5-e5325fe47e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:30.655901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1253/2485] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:50:30 2022] DELETE /identity/v3/projects/50f8db7869ef42cabbb743ab6479cb3d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:30.661198 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe44a7-ef94-47c9-a185-c06796963167 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:30.661699 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe44a7-ef94-47c9-a185-c06796963167 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:30.661790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe44a7-ef94-47c9-a185-c06796963167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:30.735446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f8fe44a7-ef94-47c9-a185-c06796963167 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:30.737160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f8fe44a7-ef94-47c9-a185-c06796963167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:30.837054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1233/2486] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:30.846156 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a31b8-9f65-43b3-8006-ee806f062163 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:30.846866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a31b8-9f65-43b3-8006-ee806f062163 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:30.847223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a31b8-9f65-43b3-8006-ee806f062163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:30.884057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-550a31b8-9f65-43b3-8006-ee806f062163 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:30.888069 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-550a31b8-9f65-43b3-8006-ee806f062163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:30.905321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1254/2487] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:30.909773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe44a7-ef94-47c9-a185-c06796963167 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:30.920865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe44a7-ef94-47c9-a185-c06796963167 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:30.926365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee4f2c-d613-4792-b645-4b448cc975c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:30.927378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee4f2c-d613-4792-b645-4b448cc975c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:30.927829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee4f2c-d613-4792-b645-4b448cc975c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:30.928254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee4f2c-d613-4792-b645-4b448cc975c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:30.929155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee4f2c-d613-4792-b645-4b448cc975c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:50:30.929623 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee4f2c-d613-4792-b645-4b448cc975c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:30.935948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee4f2c-d613-4792-b645-4b448cc975c5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:30.971045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1234/2488] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:50:30.975081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a31b8-9f65-43b3-8006-ee806f062163 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:30.991518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a31b8-9f65-43b3-8006-ee806f062163 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:31.001129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb55fe0-5ae1-4254-a7f8-23ead5f7c7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:31.003197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb55fe0-5ae1-4254-a7f8-23ead5f7c7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:31.004089 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb55fe0-5ae1-4254-a7f8-23ead5f7c7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:31.004526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb55fe0-5ae1-4254-a7f8-23ead5f7c7c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:31.006371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb55fe0-5ae1-4254-a7f8-23ead5f7c7c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:31.011030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb55fe0-5ae1-4254-a7f8-23ead5f7c7c0 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:31.079192 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1255/2489] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:50:30 2022] POST /identity/v3/projects => generated 399 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:50:31.085524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee4f2c-d613-4792-b645-4b448cc975c5 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:31.102457 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee4f2c-d613-4792-b645-4b448cc975c5 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:31.225683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887739cd-428d-4203-84f2-9d7a8788b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:31.226175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887739cd-428d-4203-84f2-9d7a8788b81b admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:31.226469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887739cd-428d-4203-84f2-9d7a8788b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:31.226753 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887739cd-428d-4203-84f2-9d7a8788b81b admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:31.227483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887739cd-428d-4203-84f2-9d7a8788b81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:31.229503 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887739cd-428d-4203-84f2-9d7a8788b81b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:31.259004 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1235/2490] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:50:31 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:50:31.263393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb55fe0-5ae1-4254-a7f8-23ead5f7c7c0 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:31.278381 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb55fe0-5ae1-4254-a7f8-23ead5f7c7c0 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:31.284408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997ea65-4e1f-4ba0-b0cc-96969a2ba673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:31.285402 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ea65-4e1f-4ba0-b0cc-96969a2ba673 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:31.286241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ea65-4e1f-4ba0-b0cc-96969a2ba673 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:31.286241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997ea65-4e1f-4ba0-b0cc-96969a2ba673 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:31.287033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997ea65-4e1f-4ba0-b0cc-96969a2ba673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:31.288996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997ea65-4e1f-4ba0-b0cc-96969a2ba673 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:31.318346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887739cd-428d-4203-84f2-9d7a8788b81b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:31.326999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1256/2491] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:50:31.332077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887739cd-428d-4203-84f2-9d7a8788b81b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:31.343875 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc25e7-1bdd-4221-b407-6c252ab4b30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:31.345096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc25e7-1bdd-4221-b407-6c252ab4b30e admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:31.353494 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc25e7-1bdd-4221-b407-6c252ab4b30e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:31.354022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc25e7-1bdd-4221-b407-6c252ab4b30e admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:31.356075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc25e7-1bdd-4221-b407-6c252ab4b30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:31.357747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc25e7-1bdd-4221-b407-6c252ab4b30e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:31.375373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1236/2492] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:50:31.376506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997ea65-4e1f-4ba0-b0cc-96969a2ba673 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:31.390963 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997ea65-4e1f-4ba0-b0cc-96969a2ba673 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:31.397099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb2d54-7cb0-450b-a5ed-f670c1059308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:31.398316 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb2d54-7cb0-450b-a5ed-f670c1059308 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:31.398881 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb2d54-7cb0-450b-a5ed-f670c1059308 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:31.399195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb2d54-7cb0-450b-a5ed-f670c1059308 admin admin] PATH_INFO: `/v3/projects/3d6cd83adae743da8c9b23c22d78a04f/users/4ba52b6b14f74c7faf7bc89b60e6a1e1/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:31.416587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb2d54-7cb0-450b-a5ed-f670c1059308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6cd83adae743da8c9b23c22d78a04f, user_id=4ba52b6b14f74c7faf7bc89b60e6a1e1, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:31.419327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb2d54-7cb0-450b-a5ed-f670c1059308 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:31.435016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1257/2493] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:50:31 2022] PUT /identity/v3/projects/3d6cd83adae743da8c9b23c22d78a04f/users/4ba52b6b14f74c7faf7bc89b60e6a1e1/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:50:31.446614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89ec70-ed56-40b0-9735-4cb72fe8ec13 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:31.446918 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89ec70-ed56-40b0-9735-4cb72fe8ec13 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:31.447318 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89ec70-ed56-40b0-9735-4cb72fe8ec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:31.494109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-1b89ec70-ed56-40b0-9735-4cb72fe8ec13 None None] MFA Rules not processed for user `4ba52b6b14f74c7faf7bc89b60e6a1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:31.495497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1b89ec70-ed56-40b0-9735-4cb72fe8ec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:31.586702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1237/2494] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:31.599140 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb2d54-7cb0-450b-a5ed-f670c1059308 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:31.601119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-00eb2d54-7cb0-450b-a5ed-f670c1059308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:31.671483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb2d54-7cb0-450b-a5ed-f670c1059308 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:31.675753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0e47b-965b-400a-b204-91e18cd9fa76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:31.676395 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0e47b-965b-400a-b204-91e18cd9fa76 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:31.676672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0e47b-965b-400a-b204-91e18cd9fa76 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:31.676945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0e47b-965b-400a-b204-91e18cd9fa76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:31.688017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0e47b-965b-400a-b204-91e18cd9fa76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:31.690053 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0e47b-965b-400a-b204-91e18cd9fa76 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:31.700164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1258/2495] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:50:35.418199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179689-edc9-4cbd-a8a9-0d39b229a90d None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:35.418836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179689-edc9-4cbd-a8a9-0d39b229a90d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:35.418836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179689-edc9-4cbd-a8a9-0d39b229a90d None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:35.421362 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1238/2496] 10.222.0.73 () {54 vars in 921 bytes} [Wed May 4 13:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:50:35.431761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd801589-82f6-4875-94f1-672e89bf560c None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:35.432390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd801589-82f6-4875-94f1-672e89bf560c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:35.432533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd801589-82f6-4875-94f1-672e89bf560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:35.455094 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-cd801589-82f6-4875-94f1-672e89bf560c None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:35.457723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-cd801589-82f6-4875-94f1-672e89bf560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:35.588573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1259/2497] 10.222.0.73 () {58 vars in 1018 bytes} [Wed May 4 13:50:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:35.603594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179689-edc9-4cbd-a8a9-0d39b229a90d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:35.605533 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f2179689-edc9-4cbd-a8a9-0d39b229a90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:35.673026 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179689-edc9-4cbd-a8a9-0d39b229a90d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:35.677420 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a975a57-dd82-4165-83b8-0ce3fe2abb90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf2b88cc78d4defa7cefb7bf0ae6144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:35.678059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975a57-dd82-4165-83b8-0ce3fe2abb90 service glance] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:35.678336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975a57-dd82-4165-83b8-0ce3fe2abb90 service glance] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:35.678613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975a57-dd82-4165-83b8-0ce3fe2abb90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:35.688902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a975a57-dd82-4165-83b8-0ce3fe2abb90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:35.690620 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a975a57-dd82-4165-83b8-0ce3fe2abb90 service glance] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:35.700985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1239/2498] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:50:35.773982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0e9ef-b4a9-48d8-8923-ba0d761f379e None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:35.774392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0e9ef-b4a9-48d8-8923-ba0d761f379e None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:35.774707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0e9ef-b4a9-48d8-8923-ba0d761f379e None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:35.776470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1260/2499] 10.222.0.73 () {54 vars in 921 bytes} [Wed May 4 13:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:50:35.781639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b23ca-1422-4c22-a961-8ded03b60598 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:35.781934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b23ca-1422-4c22-a961-8ded03b60598 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:35.782214 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b23ca-1422-4c22-a961-8ded03b60598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:35.817329 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-bb5b23ca-1422-4c22-a961-8ded03b60598 None None] MFA Rules not processed for user `963a38e769674dbba95a231e47a7191f`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:35.818715 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bb5b23ca-1422-4c22-a961-8ded03b60598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:35.887787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1240/2500] 10.222.0.73 () {58 vars in 1018 bytes} [Wed May 4 13:50:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:35.900547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0e9ef-b4a9-48d8-8923-ba0d761f379e None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:35.902722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-71a0e9ef-b4a9-48d8-8923-ba0d761f379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:35.920393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0e9ef-b4a9-48d8-8923-ba0d761f379e None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:35.924620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c037a-5ea0-4bdd-8542-ede927807284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:35.925331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c037a-5ea0-4bdd-8542-ede927807284 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:35.925682 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c037a-5ea0-4bdd-8542-ede927807284 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:35.926066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c037a-5ea0-4bdd-8542-ede927807284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:35.936629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c037a-5ea0-4bdd-8542-ede927807284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:35.938172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c037a-5ea0-4bdd-8542-ede927807284 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:35.947811 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1261/2501] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:50:36.050898 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a8bc-8f68-42f1-ac8e-d68d5ddf562c None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:36.051172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a8bc-8f68-42f1-ac8e-d68d5ddf562c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:36.051495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a8bc-8f68-42f1-ac8e-d68d5ddf562c None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:36.052945 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1241/2502] 10.222.0.73 () {54 vars in 921 bytes} [Wed May 4 13:50:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:50:36.059238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae53965-115a-437b-baa8-91070c1792a5 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:36.059556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae53965-115a-437b-baa8-91070c1792a5 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:36.059832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae53965-115a-437b-baa8-91070c1792a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:36.120956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-0ae53965-115a-437b-baa8-91070c1792a5 None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:36.122474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0ae53965-115a-437b-baa8-91070c1792a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:36.135454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1262/2503] 10.222.0.73 () {58 vars in 1018 bytes} [Wed May 4 13:50:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:36.147601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a8bc-8f68-42f1-ac8e-d68d5ddf562c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:36.149975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ef17a8bc-8f68-42f1-ac8e-d68d5ddf562c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:36.176270 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a8bc-8f68-42f1-ac8e-d68d5ddf562c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:36.180535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c7190-846d-4283-98bb-abc61c0c91c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:36.181180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c7190-846d-4283-98bb-abc61c0c91c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:36.184149 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c7190-846d-4283-98bb-abc61c0c91c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:36.184469 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c7190-846d-4283-98bb-abc61c0c91c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:36.197326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c7190-846d-4283-98bb-abc61c0c91c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:36.198761 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c7190-846d-4283-98bb-abc61c0c91c3 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:36.210930 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1242/2504] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:50:39.360665 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae53965-115a-437b-baa8-91070c1792a5 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:39.444233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae53965-115a-437b-baa8-91070c1792a5 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:39.449030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:39.450297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:39.450740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:39.451167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] PATH_INFO: `/v3/users/4ba52b6b14f74c7faf7bc89b60e6a1e1` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:39.452577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba52b6b14f74c7faf7bc89b60e6a1e1)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:39.454502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:39.549078 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba52b6b14f74c7faf7bc89b60e6a1e1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:39.567385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba52b6b14f74c7faf7bc89b60e6a1e1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:39.568309 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba52b6b14f74c7faf7bc89b60e6a1e1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:39.579634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba52b6b14f74c7faf7bc89b60e6a1e1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:39.627463 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba52b6b14f74c7faf7bc89b60e6a1e1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:39.640748 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1263/2505] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:50:39 2022] DELETE /identity/v3/users/4ba52b6b14f74c7faf7bc89b60e6a1e1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:39.645614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35407e6f-87c7-4f56-b537-dac3dce38de9 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:39.646154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35407e6f-87c7-4f56-b537-dac3dce38de9 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:39.646154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35407e6f-87c7-4f56-b537-dac3dce38de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:39.677102 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-35407e6f-87c7-4f56-b537-dac3dce38de9 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:39.678323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-35407e6f-87c7-4f56-b537-dac3dce38de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:39.827258 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1243/2506] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:39.850034 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:39.852573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:39.933926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e339bd-93a3-4c42-857d-b744e14a737a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:39.944776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e568b3-9183-44fb-afdc-7983e97d9092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:39.945602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e568b3-9183-44fb-afdc-7983e97d9092 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:39.945952 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e568b3-9183-44fb-afdc-7983e97d9092 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:39.946232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e568b3-9183-44fb-afdc-7983e97d9092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:39.971788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e568b3-9183-44fb-afdc-7983e97d9092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:39.973220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e568b3-9183-44fb-afdc-7983e97d9092 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:39.984139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1264/2507] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:50:40.495989 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0264538-dbc4-46e4-8f6b-9df9df9fd92f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:40.496887 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0264538-dbc4-46e4-8f6b-9df9df9fd92f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:40.497370 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0264538-dbc4-46e4-8f6b-9df9df9fd92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:40.518793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-e0264538-dbc4-46e4-8f6b-9df9df9fd92f None None] MFA Rules not processed for user `30809c6c3edc4262b48ceb548ed18fce`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:40.520510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e0264538-dbc4-46e4-8f6b-9df9df9fd92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:40.612840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1244/2508] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:40.640522 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8adb39-4f33-419b-a818-d360dd9bcf0d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:40.641025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8adb39-4f33-419b-a818-d360dd9bcf0d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:40.641212 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8adb39-4f33-419b-a818-d360dd9bcf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:40.658625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-4d8adb39-4f33-419b-a818-d360dd9bcf0d None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:40.660023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4d8adb39-4f33-419b-a818-d360dd9bcf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:40.715893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1265/2509] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:50:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:40.728332 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0264538-dbc4-46e4-8f6b-9df9df9fd92f None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:40.729816 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e0264538-dbc4-46e4-8f6b-9df9df9fd92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:40.836874 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0264538-dbc4-46e4-8f6b-9df9df9fd92f None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:40.843535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cb1df-fdf2-4238-93a9-994b9135605b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:40.844380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cb1df-fdf2-4238-93a9-994b9135605b service swift] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:40.844663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cb1df-fdf2-4238-93a9-994b9135605b service swift] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:40.844939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cb1df-fdf2-4238-93a9-994b9135605b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:40.855577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cb1df-fdf2-4238-93a9-994b9135605b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:40.857640 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cb1df-fdf2-4238-93a9-994b9135605b service swift] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:40.858773 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8adb39-4f33-419b-a818-d360dd9bcf0d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:40.860216 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4d8adb39-4f33-419b-a818-d360dd9bcf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:40.868380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1245/2510] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:50:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 13:50:40.880516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8adb39-4f33-419b-a818-d360dd9bcf0d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:40.885540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdb263-7ba8-4b32-b536-7f580777f3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:40.887775 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdb263-7ba8-4b32-b536-7f580777f3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:40.889792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdb263-7ba8-4b32-b536-7f580777f3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:40.890230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdb263-7ba8-4b32-b536-7f580777f3dd admin admin] PATH_INFO: `/v3/projects/3d6cd83adae743da8c9b23c22d78a04f` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:40.891849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdb263-7ba8-4b32-b536-7f580777f3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6cd83adae743da8c9b23c22d78a04f)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:40.893794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdb263-7ba8-4b32-b536-7f580777f3dd admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:40.972876 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9cbdb263-7ba8-4b32-b536-7f580777f3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6cd83adae743da8c9b23c22d78a04f', 'request_id': 'req-9cbdb263-7ba8-4b32-b536-7f580777f3dd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:40.981015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9cbdb263-7ba8-4b32-b536-7f580777f3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6cd83adae743da8c9b23c22d78a04f', 'request_id': 'req-9cbdb263-7ba8-4b32-b536-7f580777f3dd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:40.996957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9cbdb263-7ba8-4b32-b536-7f580777f3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6cd83adae743da8c9b23c22d78a04f', 'request_id': 'req-9cbdb263-7ba8-4b32-b536-7f580777f3dd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:41.015928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9cbdb263-7ba8-4b32-b536-7f580777f3dd admin admin] The token cache is being invalidate because project 3d6cd83adae743da8c9b23c22d78a04f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:50:41.016488 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9cbdb263-7ba8-4b32-b536-7f580777f3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:41.018161 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-9cbdb263-7ba8-4b32-b536-7f580777f3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:41.020432 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1266/2511] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:50:40 2022] DELETE /identity/v3/projects/3d6cd83adae743da8c9b23c22d78a04f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:41.025940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897afb7-9c40-4e76-8354-1362fdb7d35a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:41.027607 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897afb7-9c40-4e76-8354-1362fdb7d35a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:41.027897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897afb7-9c40-4e76-8354-1362fdb7d35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:41.081972 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6897afb7-9c40-4e76-8354-1362fdb7d35a None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:41.083448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6897afb7-9c40-4e76-8354-1362fdb7d35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:41.231342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1246/2512] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:41.239608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36bc78-0e59-4b1f-8788-78ee5f761f74 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:41.240373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36bc78-0e59-4b1f-8788-78ee5f761f74 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:41.240853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36bc78-0e59-4b1f-8788-78ee5f761f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:41.280321 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-cd36bc78-0e59-4b1f-8788-78ee5f761f74 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:41.285571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-cd36bc78-0e59-4b1f-8788-78ee5f761f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:41.316475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1267/2513] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:41.320136 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897afb7-9c40-4e76-8354-1362fdb7d35a None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:41.337961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897afb7-9c40-4e76-8354-1362fdb7d35a None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:41.366355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc5b42-c2ff-4d5d-a45c-c728f068fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:41.369752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc5b42-c2ff-4d5d-a45c-c728f068fc76 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:41.370231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc5b42-c2ff-4d5d-a45c-c728f068fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:41.370685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc5b42-c2ff-4d5d-a45c-c728f068fc76 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:41.371627 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc5b42-c2ff-4d5d-a45c-c728f068fc76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:50:41.377972 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc5b42-c2ff-4d5d-a45c-c728f068fc76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:41.379862 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc5b42-c2ff-4d5d-a45c-c728f068fc76 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:41.397464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1247/2514] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:50:41.401954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36bc78-0e59-4b1f-8788-78ee5f761f74 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:41.419267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36bc78-0e59-4b1f-8788-78ee5f761f74 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:41.428108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e88b1-56ff-4ecd-8eee-85b69a4a9e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:41.429832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e88b1-56ff-4ecd-8eee-85b69a4a9e4f admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:41.430356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e88b1-56ff-4ecd-8eee-85b69a4a9e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:41.430919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e88b1-56ff-4ecd-8eee-85b69a4a9e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:41.431892 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e88b1-56ff-4ecd-8eee-85b69a4a9e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:41.434245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e88b1-56ff-4ecd-8eee-85b69a4a9e4f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:41.507882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1268/2515] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:50:41 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:50:41.512024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc5b42-c2ff-4d5d-a45c-c728f068fc76 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:41.526921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc5b42-c2ff-4d5d-a45c-c728f068fc76 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:41.649334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ed9a4-a63b-4cc8-a501-5f91e525aac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:41.650015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ed9a4-a63b-4cc8-a501-5f91e525aac8 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:41.650299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ed9a4-a63b-4cc8-a501-5f91e525aac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:41.650581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ed9a4-a63b-4cc8-a501-5f91e525aac8 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:41.651365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ed9a4-a63b-4cc8-a501-5f91e525aac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:41.660632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ed9a4-a63b-4cc8-a501-5f91e525aac8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:41.703905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1248/2516] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:50:41 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:50:41.708346 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e88b1-56ff-4ecd-8eee-85b69a4a9e4f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:41.723073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e88b1-56ff-4ecd-8eee-85b69a4a9e4f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:41.729560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a231038-9039-4830-8c70-e2379be7bdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:41.730507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a231038-9039-4830-8c70-e2379be7bdab admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:41.731004 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a231038-9039-4830-8c70-e2379be7bdab admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:41.731483 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a231038-9039-4830-8c70-e2379be7bdab admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:41.732571 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a231038-9039-4830-8c70-e2379be7bdab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:41.735520 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a231038-9039-4830-8c70-e2379be7bdab admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:41.752488 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1269/2517] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:50:41.757146 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ed9a4-a63b-4cc8-a501-5f91e525aac8 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:41.771959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ed9a4-a63b-4cc8-a501-5f91e525aac8 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:41.778272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e2eec-09b1-4428-834c-e5fc85207766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:41.779045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e2eec-09b1-4428-834c-e5fc85207766 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:41.779434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e2eec-09b1-4428-834c-e5fc85207766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:41.779794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e2eec-09b1-4428-834c-e5fc85207766 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:41.780653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e2eec-09b1-4428-834c-e5fc85207766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:41.782339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e2eec-09b1-4428-834c-e5fc85207766 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:41.805346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1249/2518] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:50:41.815237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a231038-9039-4830-8c70-e2379be7bdab admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:41.847901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a231038-9039-4830-8c70-e2379be7bdab admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:41.860113 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21917a50-7bbf-4796-a6ba-4678bc569887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:41.862953 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21917a50-7bbf-4796-a6ba-4678bc569887 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:41.864339 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21917a50-7bbf-4796-a6ba-4678bc569887 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:41.864983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21917a50-7bbf-4796-a6ba-4678bc569887 admin admin] PATH_INFO: `/v3/projects/3a581986e7304b35a1e08ebdd059c318/users/5267381c1521479d92a861283e9b31f4/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:41.899589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21917a50-7bbf-4796-a6ba-4678bc569887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a581986e7304b35a1e08ebdd059c318, user_id=5267381c1521479d92a861283e9b31f4, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:41.902789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21917a50-7bbf-4796-a6ba-4678bc569887 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:41.920753 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1270/2519] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:50:41 2022] PUT /identity/v3/projects/3a581986e7304b35a1e08ebdd059c318/users/5267381c1521479d92a861283e9b31f4/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:41.925729 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4c0e9-846e-4521-b745-9ac4e4c9ea76 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:41.926028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4c0e9-846e-4521-b745-9ac4e4c9ea76 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:41.926303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4c0e9-846e-4521-b745-9ac4e4c9ea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:41.969123 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b9a4c0e9-846e-4521-b745-9ac4e4c9ea76 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:41.976066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b9a4c0e9-846e-4521-b745-9ac4e4c9ea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:42.061485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1250/2520] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:42.072320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21917a50-7bbf-4796-a6ba-4678bc569887 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:42.074779 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-21917a50-7bbf-4796-a6ba-4678bc569887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:42.167521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21917a50-7bbf-4796-a6ba-4678bc569887 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:42.171239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629af01-85f0-4a2c-9449-559932598059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:42.172027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629af01-85f0-4a2c-9449-559932598059 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:42.172314 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629af01-85f0-4a2c-9449-559932598059 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:42.172700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629af01-85f0-4a2c-9449-559932598059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:42.182512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629af01-85f0-4a2c-9449-559932598059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:42.183980 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629af01-85f0-4a2c-9449-559932598059 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:42.199338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1271/2521] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:50:44.003785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4c0e9-846e-4521-b745-9ac4e4c9ea76 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:44.005783 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b9a4c0e9-846e-4521-b745-9ac4e4c9ea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:44.030457 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4c0e9-846e-4521-b745-9ac4e4c9ea76 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:44.036493 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:44.037574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:44.038033 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:44.038458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] PATH_INFO: `/v3/users/c3a52780187344c1844b3eab89d5737d` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:44.047441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a52780187344c1844b3eab89d5737d)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:44.049455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:44.170983 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a52780187344c1844b3eab89d5737d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:44.186323 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a52780187344c1844b3eab89d5737d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:44.200034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a52780187344c1844b3eab89d5737d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:44.201146 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a52780187344c1844b3eab89d5737d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:44.201978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a52780187344c1844b3eab89d5737d'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:44.243383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1251/2522] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:50:44 2022] DELETE /identity/v3/users/c3a52780187344c1844b3eab89d5737d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:44.247993 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ab55d-f056-490b-bfae-19c44ba282e4 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:44.249236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ab55d-f056-490b-bfae-19c44ba282e4 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:44.249988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ab55d-f056-490b-bfae-19c44ba282e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:44.279231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-2c1ab55d-f056-490b-bfae-19c44ba282e4 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:44.281758 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2c1ab55d-f056-490b-bfae-19c44ba282e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:44.420249 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1272/2523] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:50:44.433671 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:44.440194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:44.576800 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84a258-aa00-4030-9559-7e00f148707a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:44.586354 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282188d-f487-41e6-8678-6b6bae36d78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:44.587962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282188d-f487-41e6-8678-6b6bae36d78d service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:44.588990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282188d-f487-41e6-8678-6b6bae36d78d service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:44.589577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282188d-f487-41e6-8678-6b6bae36d78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:44.614098 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282188d-f487-41e6-8678-6b6bae36d78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:44.617421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282188d-f487-41e6-8678-6b6bae36d78d service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:44.643985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1252/2524] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:50:46.027257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ab55d-f056-490b-bfae-19c44ba282e4 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:46.029437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2c1ab55d-f056-490b-bfae-19c44ba282e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:46.053154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ab55d-f056-490b-bfae-19c44ba282e4 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:46.062348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:46.064023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:46.064476 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:46.067983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d admin admin] PATH_INFO: `/v3/projects/6fd7f04861924246a7ed18f50f1dc024` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:46.069466 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd7f04861924246a7ed18f50f1dc024)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:46.071642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:46.205553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd7f04861924246a7ed18f50f1dc024', 'request_id': 'req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:46.213781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd7f04861924246a7ed18f50f1dc024', 'request_id': 'req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:46.231833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd7f04861924246a7ed18f50f1dc024', 'request_id': 'req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:46.247041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d admin admin] The token cache is being invalidate because project 6fd7f04861924246a7ed18f50f1dc024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:50:46.247498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:46.248185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-7a28edab-4652-4c56-b8a3-e9a871d2ed4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:50:46.250529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1273/2525] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:50:46 2022] DELETE /identity/v3/projects/6fd7f04861924246a7ed18f50f1dc024 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:46.255613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fd4e5-6d9d-47c8-8fc1-0420dc73104d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:46.256197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fd4e5-6d9d-47c8-8fc1-0420dc73104d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:46.256350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fd4e5-6d9d-47c8-8fc1-0420dc73104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:46.290644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-cc5fd4e5-6d9d-47c8-8fc1-0420dc73104d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:46.292279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cc5fd4e5-6d9d-47c8-8fc1-0420dc73104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:46.467377 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1253/2526] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:46.475714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30476148-cef1-414a-b3fe-0437b000f3ff None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:46.476085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30476148-cef1-414a-b3fe-0437b000f3ff None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:46.476431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30476148-cef1-414a-b3fe-0437b000f3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:46.552888 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-30476148-cef1-414a-b3fe-0437b000f3ff None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:46.556437 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-30476148-cef1-414a-b3fe-0437b000f3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:46.570237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1274/2527] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:50:46.574200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fd4e5-6d9d-47c8-8fc1-0420dc73104d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:46.602126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fd4e5-6d9d-47c8-8fc1-0420dc73104d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:46.623875 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f7fa0-ad39-4909-bb81-3bce49180fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:46.624859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f7fa0-ad39-4909-bb81-3bce49180fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:46.631746 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f7fa0-ad39-4909-bb81-3bce49180fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:46.633527 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f7fa0-ad39-4909-bb81-3bce49180fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:46.634578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f7fa0-ad39-4909-bb81-3bce49180fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:50:46.635712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f7fa0-ad39-4909-bb81-3bce49180fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:46.638654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f7fa0-ad39-4909-bb81-3bce49180fc4 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:46.693429 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30476148-cef1-414a-b3fe-0437b000f3ff None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:46.698920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1254/2528] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:50:46.715223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30476148-cef1-414a-b3fe-0437b000f3ff None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:46.723020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e8b89-e0ed-4ceb-8c0e-8acba193a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:46.724350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e8b89-e0ed-4ceb-8c0e-8acba193a538 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:46.724817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e8b89-e0ed-4ceb-8c0e-8acba193a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:46.725241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e8b89-e0ed-4ceb-8c0e-8acba193a538 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:46.726640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e8b89-e0ed-4ceb-8c0e-8acba193a538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:46.732270 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e8b89-e0ed-4ceb-8c0e-8acba193a538 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:46.823107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1275/2529] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:50:46 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:50:46.824707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f7fa0-ad39-4909-bb81-3bce49180fc4 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:46.849865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f7fa0-ad39-4909-bb81-3bce49180fc4 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:47.026100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44022-1fee-4d6a-bf0c-dd32fe694fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:47.027176 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44022-1fee-4d6a-bf0c-dd32fe694fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:47.027829 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44022-1fee-4d6a-bf0c-dd32fe694fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:47.028712 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a44022-1fee-4d6a-bf0c-dd32fe694fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:47.030094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a44022-1fee-4d6a-bf0c-dd32fe694fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:47.032316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a44022-1fee-4d6a-bf0c-dd32fe694fe3 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:47.060995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1255/2530] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:50:46 2022] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:50:47.067149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e8b89-e0ed-4ceb-8c0e-8acba193a538 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:47.082220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e8b89-e0ed-4ceb-8c0e-8acba193a538 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:47.089860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926a993-2068-40b0-852e-723597a05d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:47.092508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926a993-2068-40b0-852e-723597a05d0c admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:47.093077 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926a993-2068-40b0-852e-723597a05d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:47.093800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926a993-2068-40b0-852e-723597a05d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:47.094860 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926a993-2068-40b0-852e-723597a05d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:47.098777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926a993-2068-40b0-852e-723597a05d0c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:47.114269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1276/2531] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:50:47.119365 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44022-1fee-4d6a-bf0c-dd32fe694fe3 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:47.143321 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a44022-1fee-4d6a-bf0c-dd32fe694fe3 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:47.160834 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb125e-a57e-4bf2-a482-c48cb13b0a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:47.161674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb125e-a57e-4bf2-a482-c48cb13b0a2c admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:47.162060 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb125e-a57e-4bf2-a482-c48cb13b0a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:47.162477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb125e-a57e-4bf2-a482-c48cb13b0a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:47.163327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb125e-a57e-4bf2-a482-c48cb13b0a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:47.165899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb125e-a57e-4bf2-a482-c48cb13b0a2c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:47.179275 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1256/2532] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:50:47.183122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926a993-2068-40b0-852e-723597a05d0c admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:47.199634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926a993-2068-40b0-852e-723597a05d0c admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:47.207323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b76e7-0cf1-4fe9-b2b6-96288f57f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:47.208277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b76e7-0cf1-4fe9-b2b6-96288f57f9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:47.208607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b76e7-0cf1-4fe9-b2b6-96288f57f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:47.208902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b76e7-0cf1-4fe9-b2b6-96288f57f9e3 admin admin] PATH_INFO: `/v3/projects/e7d7f59d1c6c47278b496d93acd0e61b/users/8ddcd89df89b4ff5a2d8f3ac1a83ba67/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:47.230591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b76e7-0cf1-4fe9-b2b6-96288f57f9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d7f59d1c6c47278b496d93acd0e61b, user_id=8ddcd89df89b4ff5a2d8f3ac1a83ba67, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:47.233809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b76e7-0cf1-4fe9-b2b6-96288f57f9e3 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:47.276217 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1277/2533] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:50:47 2022] PUT /identity/v3/projects/e7d7f59d1c6c47278b496d93acd0e61b/users/8ddcd89df89b4ff5a2d8f3ac1a83ba67/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:50:47.281409 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705103-102d-41d9-a49f-dbe946cc3ca5 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:47.281918 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705103-102d-41d9-a49f-dbe946cc3ca5 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:47.282180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32705103-102d-41d9-a49f-dbe946cc3ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:47.320047 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-32705103-102d-41d9-a49f-dbe946cc3ca5 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:47.321657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-32705103-102d-41d9-a49f-dbe946cc3ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:47.459256 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1257/2534] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:47.469214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b76e7-0cf1-4fe9-b2b6-96288f57f9e3 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:47.471250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6c6b76e7-0cf1-4fe9-b2b6-96288f57f9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:47.523363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdbcd3-dee4-4b78-854b-3fc856bfb204 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:47.523660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdbcd3-dee4-4b78-854b-3fc856bfb204 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:47.523939 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfdbcd3-dee4-4b78-854b-3fc856bfb204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:47.577054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-3dfdbcd3-dee4-4b78-854b-3fc856bfb204 None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:47.583041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3dfdbcd3-dee4-4b78-854b-3fc856bfb204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:47.686713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b76e7-0cf1-4fe9-b2b6-96288f57f9e3 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:47.709128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6cdd8-2c76-4dac-8890-be3df0e5812a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:47.709806 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6cdd8-2c76-4dac-8890-be3df0e5812a service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:47.710090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6cdd8-2c76-4dac-8890-be3df0e5812a service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:47.710516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6cdd8-2c76-4dac-8890-be3df0e5812a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:47.739306 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6cdd8-2c76-4dac-8890-be3df0e5812a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:47.739306 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6cdd8-2c76-4dac-8890-be3df0e5812a service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:47.741512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1258/2535] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:50:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:50:47.757078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdbcd3-dee4-4b78-854b-3fc856bfb204 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:47.758569 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3dfdbcd3-dee4-4b78-854b-3fc856bfb204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:47.764929 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1278/2536] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:50:47.925901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfdbcd3-dee4-4b78-854b-3fc856bfb204 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:47.937426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafbe37-4403-4faa-98e2-3a7a32018a87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:47.939633 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafbe37-4403-4faa-98e2-3a7a32018a87 service swift] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:47.939926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafbe37-4403-4faa-98e2-3a7a32018a87 service swift] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:47.940202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafbe37-4403-4faa-98e2-3a7a32018a87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:47.951135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafbe37-4403-4faa-98e2-3a7a32018a87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:47.953795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafbe37-4403-4faa-98e2-3a7a32018a87 service swift] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:47.969012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1259/2537] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:50:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 13:50:49.766389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860173d-2ded-416a-b3e7-40c40f40e70c None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:49.767338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860173d-2ded-416a-b3e7-40c40f40e70c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:49.767840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860173d-2ded-416a-b3e7-40c40f40e70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:49.809607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-f860173d-2ded-416a-b3e7-40c40f40e70c None None] MFA Rules not processed for user `8ddcd89df89b4ff5a2d8f3ac1a83ba67`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:49.811160 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f860173d-2ded-416a-b3e7-40c40f40e70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:49.924553 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1279/2538] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:49.941250 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafbe37-4403-4faa-98e2-3a7a32018a87 service swift] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:49.942835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-adafbe37-4403-4faa-98e2-3a7a32018a87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:50.122380 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafbe37-4403-4faa-98e2-3a7a32018a87 service swift] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:50.133208 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0074d-e05b-4950-a1e1-02a68b17dfba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:50.133887 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0074d-e05b-4950-a1e1-02a68b17dfba service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:50.134180 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0074d-e05b-4950-a1e1-02a68b17dfba service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:50.134442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0074d-e05b-4950-a1e1-02a68b17dfba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:50.149192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0074d-e05b-4950-a1e1-02a68b17dfba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:50.151287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0074d-e05b-4950-a1e1-02a68b17dfba service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:50.177420 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1260/2539] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:50:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:50:51.872861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc9a9b-e753-4316-bf76-a556d49fc14d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:51.875524 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc9a9b-e753-4316-bf76-a556d49fc14d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:51.876115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc9a9b-e753-4316-bf76-a556d49fc14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:51.909302 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-f2fc9a9b-e753-4316-bf76-a556d49fc14d None None] MFA Rules not processed for user `8ddcd89df89b4ff5a2d8f3ac1a83ba67`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:51.910816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f2fc9a9b-e753-4316-bf76-a556d49fc14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:51.919505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1280/2540] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:51.958854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731b90b-6d44-4fff-97f2-d15808687871 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:51.961471 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731b90b-6d44-4fff-97f2-d15808687871 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:51.964552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731b90b-6d44-4fff-97f2-d15808687871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:52.024734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6731b90b-6d44-4fff-97f2-d15808687871 None None] MFA Rules not processed for user `5267381c1521479d92a861283e9b31f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:50:52.027465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6731b90b-6d44-4fff-97f2-d15808687871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:52.196956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1261/2541] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:50:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:50:52.204275 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc9a9b-e753-4316-bf76-a556d49fc14d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:52.211482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f2fc9a9b-e753-4316-bf76-a556d49fc14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:50:52.255910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc9a9b-e753-4316-bf76-a556d49fc14d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:52.323055 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac515d-84f9-43c2-a712-127027fbbd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:52.325803 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac515d-84f9-43c2-a712-127027fbbd69 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:52.326781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac515d-84f9-43c2-a712-127027fbbd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:52.327791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac515d-84f9-43c2-a712-127027fbbd69 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:52.329088 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac515d-84f9-43c2-a712-127027fbbd69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:52.350222 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac515d-84f9-43c2-a712-127027fbbd69 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:52.395626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1281/2542] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:50:52 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:50:52.399716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731b90b-6d44-4fff-97f2-d15808687871 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:52.419041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731b90b-6d44-4fff-97f2-d15808687871 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:52.507094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432de7e-1a65-49fd-b263-4c03d894046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:52.508307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432de7e-1a65-49fd-b263-4c03d894046e admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:52.508799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432de7e-1a65-49fd-b263-4c03d894046e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:52.509248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432de7e-1a65-49fd-b263-4c03d894046e admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:52.510569 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432de7e-1a65-49fd-b263-4c03d894046e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:52.517486 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432de7e-1a65-49fd-b263-4c03d894046e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:52.551758 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1262/2543] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:50:52 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:50:52.555366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac515d-84f9-43c2-a712-127027fbbd69 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:52.573473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac515d-84f9-43c2-a712-127027fbbd69 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:52.580272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553efe2-6fae-49a3-9e9b-38d83462d254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:52.581517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553efe2-6fae-49a3-9e9b-38d83462d254 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:52.581608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553efe2-6fae-49a3-9e9b-38d83462d254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:52.581928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553efe2-6fae-49a3-9e9b-38d83462d254 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:52.582973 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553efe2-6fae-49a3-9e9b-38d83462d254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:52.585493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553efe2-6fae-49a3-9e9b-38d83462d254 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:52.604847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1282/2544] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:50:52.606034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432de7e-1a65-49fd-b263-4c03d894046e admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:52.627752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432de7e-1a65-49fd-b263-4c03d894046e admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:52.635705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee9550-f622-485b-94b2-9d541965d16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:52.636854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee9550-f622-485b-94b2-9d541965d16b admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:52.637293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee9550-f622-485b-94b2-9d541965d16b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:52.637737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee9550-f622-485b-94b2-9d541965d16b admin admin] PATH_INFO: `/v3/projects/2e92cfcc27444a759d88108e1d321f7a/users/c1947ba73a25442b97844d66b0bdade4/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:52.680552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee9550-f622-485b-94b2-9d541965d16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e92cfcc27444a759d88108e1d321f7a, user_id=c1947ba73a25442b97844d66b0bdade4, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:52.683332 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee9550-f622-485b-94b2-9d541965d16b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:52.721055 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1263/2545] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:50:52 2022] PUT /identity/v3/projects/2e92cfcc27444a759d88108e1d321f7a/users/c1947ba73a25442b97844d66b0bdade4/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:50:52.728357 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553efe2-6fae-49a3-9e9b-38d83462d254 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:52.752010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553efe2-6fae-49a3-9e9b-38d83462d254 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:52.874740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df52d8-c6cc-4fd6-805a-28b8a2561907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:52.877368 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df52d8-c6cc-4fd6-805a-28b8a2561907 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:52.877971 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df52d8-c6cc-4fd6-805a-28b8a2561907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:52.878926 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df52d8-c6cc-4fd6-805a-28b8a2561907 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:52.880682 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df52d8-c6cc-4fd6-805a-28b8a2561907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:52.882867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df52d8-c6cc-4fd6-805a-28b8a2561907 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:52.899711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1283/2546] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:50:52.903385 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee9550-f622-485b-94b2-9d541965d16b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:50:52.918877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee9550-f622-485b-94b2-9d541965d16b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:50:52.925987 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538db96-eec9-45de-bea8-3877c83b138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:50:52.927302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538db96-eec9-45de-bea8-3877c83b138b admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:50:52.927839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538db96-eec9-45de-bea8-3877c83b138b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:50:52.928487 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538db96-eec9-45de-bea8-3877c83b138b admin admin] PATH_INFO: `/v3/projects/2e92cfcc27444a759d88108e1d321f7a/users/c1947ba73a25442b97844d66b0bdade4/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:50:52.931542 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538db96-eec9-45de-bea8-3877c83b138b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e92cfcc27444a759d88108e1d321f7a, user_id=c1947ba73a25442b97844d66b0bdade4, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:50:52.935011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538db96-eec9-45de-bea8-3877c83b138b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:50:52.953774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1264/2547] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:50:52 2022] PUT /identity/v3/projects/2e92cfcc27444a759d88108e1d321f7a/users/c1947ba73a25442b97844d66b0bdade4/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:51:00.943646 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171aa15-aa28-488b-a498-6fa2bbfa60d4 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:00.944266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171aa15-aa28-488b-a498-6fa2bbfa60d4 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:00.944376 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171aa15-aa28-488b-a498-6fa2bbfa60d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:01.047814 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-2171aa15-aa28-488b-a498-6fa2bbfa60d4 None None] MFA Rules not processed for user `c1947ba73a25442b97844d66b0bdade4`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:51:01.049802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2171aa15-aa28-488b-a498-6fa2bbfa60d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:01.165253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1284/2548] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:51:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:51:01.222152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538db96-eec9-45de-bea8-3877c83b138b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:01.224666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0538db96-eec9-45de-bea8-3877c83b138b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:01.387568 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538db96-eec9-45de-bea8-3877c83b138b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:01.405714 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5709b20-f8ed-49eb-9476-cae53f9670ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:01.406381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5709b20-f8ed-49eb-9476-cae53f9670ad service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:01.406660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5709b20-f8ed-49eb-9476-cae53f9670ad service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:01.406932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5709b20-f8ed-49eb-9476-cae53f9670ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:01.616034 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5709b20-f8ed-49eb-9476-cae53f9670ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:01.617668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5709b20-f8ed-49eb-9476-cae53f9670ad service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:01.643707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1265/2549] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:51:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:51:12.688192 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffec447-a0c0-45d5-ad46-99de41b6bda6 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:12.689225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffec447-a0c0-45d5-ad46-99de41b6bda6 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:12.689414 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffec447-a0c0-45d5-ad46-99de41b6bda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:12.736325 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-3ffec447-a0c0-45d5-ad46-99de41b6bda6 None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:51:12.737438 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3ffec447-a0c0-45d5-ad46-99de41b6bda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:12.802540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1285/2550] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:51:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:51:12.825865 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5709b20-f8ed-49eb-9476-cae53f9670ad service nova] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:12.901704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5709b20-f8ed-49eb-9476-cae53f9670ad service nova] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:12.906836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8f28-e334-4483-92a5-8c1c68aac3e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:12.908011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8f28-e334-4483-92a5-8c1c68aac3e6 service swift] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:12.908295 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8f28-e334-4483-92a5-8c1c68aac3e6 service swift] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:12.908569 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8f28-e334-4483-92a5-8c1c68aac3e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:12.916613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f8f28-e334-4483-92a5-8c1c68aac3e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:12.918197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f8f28-e334-4483-92a5-8c1c68aac3e6 service swift] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:12.926575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1266/2551] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:51:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:51:18.830622 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e3527-bf9b-4512-8f65-ba6a5fd3cade None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:18.834204 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e3527-bf9b-4512-8f65-ba6a5fd3cade None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:18.834204 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e3527-bf9b-4512-8f65-ba6a5fd3cade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:18.868505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-511e3527-bf9b-4512-8f65-ba6a5fd3cade None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:51:18.869894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-511e3527-bf9b-4512-8f65-ba6a5fd3cade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:18.877962 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1286/2552] 10.222.0.73 () {58 vars in 967 bytes} [Wed May 4 13:51:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:51:18.898511 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8f28-e334-4483-92a5-8c1c68aac3e6 service swift] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:18.912478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8f28-e334-4483-92a5-8c1c68aac3e6 service swift] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:18.933694 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167811f7-4e66-4264-9bb9-eb21494dcd35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:18.934357 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167811f7-4e66-4264-9bb9-eb21494dcd35 service swift] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:18.934650 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167811f7-4e66-4264-9bb9-eb21494dcd35 service swift] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:18.934931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167811f7-4e66-4264-9bb9-eb21494dcd35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:18.964400 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167811f7-4e66-4264-9bb9-eb21494dcd35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:18.966135 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167811f7-4e66-4264-9bb9-eb21494dcd35 service swift] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:18.976667 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1267/2553] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:51:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:51:19.364996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e3527-bf9b-4512-8f65-ba6a5fd3cade None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:19.367335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-511e3527-bf9b-4512-8f65-ba6a5fd3cade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:19.524849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e3527-bf9b-4512-8f65-ba6a5fd3cade None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:19.542576 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab4d8-3c90-48ad-9aae-9c98ba0e69a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735744b9ea1f429399b914f3e00d166f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:19.543712 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab4d8-3c90-48ad-9aae-9c98ba0e69a2 service placement] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:19.544148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab4d8-3c90-48ad-9aae-9c98ba0e69a2 service placement] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:19.548449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ab4d8-3c90-48ad-9aae-9c98ba0e69a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:19.569101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-8d1ab4d8-3c90-48ad-9aae-9c98ba0e69a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:19.606780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ab4d8-3c90-48ad-9aae-9c98ba0e69a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:19.612827 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ab4d8-3c90-48ad-9aae-9c98ba0e69a2 service placement] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:19.641701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1287/2554] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:51:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:51:21.866764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf3205-8749-48b9-903f-a434521c7e99 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:21.867337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf3205-8749-48b9-903f-a434521c7e99 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:21.867337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf3205-8749-48b9-903f-a434521c7e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:21.888646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-89bf3205-8749-48b9-903f-a434521c7e99 None None] MFA Rules not processed for user `5267381c1521479d92a861283e9b31f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:51:21.889836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-89bf3205-8749-48b9-903f-a434521c7e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:21.915899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1268/2555] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:51:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:51:27.542982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab4d8-3c90-48ad-9aae-9c98ba0e69a2 service placement] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:27.545879 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-8d1ab4d8-3c90-48ad-9aae-9c98ba0e69a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:27.644120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ab4d8-3c90-48ad-9aae-9c98ba0e69a2 service placement] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:27.648751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9120d3-b232-455e-bd0c-46dfaff76410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:27.650060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9120d3-b232-455e-bd0c-46dfaff76410 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:27.650575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9120d3-b232-455e-bd0c-46dfaff76410 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:27.651073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9120d3-b232-455e-bd0c-46dfaff76410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:27.653191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1f9120d3-b232-455e-bd0c-46dfaff76410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:27.767040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9120d3-b232-455e-bd0c-46dfaff76410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:27.768758 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9120d3-b232-455e-bd0c-46dfaff76410 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:27.783412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1288/2556] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:51:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:51:36.822905 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaae29-6f00-49c4-b029-15f668be6e1e None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:36.823440 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaae29-6f00-49c4-b029-15f668be6e1e None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:36.823645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaae29-6f00-49c4-b029-15f668be6e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:36.840739 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-c2eaae29-6f00-49c4-b029-15f668be6e1e None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:51:36.841996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c2eaae29-6f00-49c4-b029-15f668be6e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:36.849174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1269/2557] 10.222.0.73 () {58 vars in 967 bytes} [Wed May 4 13:51:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:51:36.862190 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9120d3-b232-455e-bd0c-46dfaff76410 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:36.874002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9120d3-b232-455e-bd0c-46dfaff76410 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:36.879324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e25f-a016-48f7-80bb-1acb4c078f3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:36.879982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e25f-a016-48f7-80bb-1acb4c078f3f service swift] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:36.880258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e25f-a016-48f7-80bb-1acb4c078f3f service swift] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:36.880531 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336e25f-a016-48f7-80bb-1acb4c078f3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:36.889116 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e25f-a016-48f7-80bb-1acb4c078f3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:36.890673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336e25f-a016-48f7-80bb-1acb4c078f3f service swift] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:36.899161 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1289/2558] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:51:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:51:38.896644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaae29-6f00-49c4-b029-15f668be6e1e None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:38.898145 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c2eaae29-6f00-49c4-b029-15f668be6e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:38.968424 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaae29-6f00-49c4-b029-15f668be6e1e None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:38.973089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1630776-d759-474c-a50a-41dd3771fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:38.973956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1630776-d759-474c-a50a-41dd3771fa49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:38.974234 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1630776-d759-474c-a50a-41dd3771fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:38.974507 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1630776-d759-474c-a50a-41dd3771fa49 admin admin] PATH_INFO: `/v3/users/e9277fe48f24411299df2224a16ee823` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:38.975747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1630776-d759-474c-a50a-41dd3771fa49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9277fe48f24411299df2224a16ee823)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:38.977698 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1630776-d759-474c-a50a-41dd3771fa49 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:39.023226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e1630776-d759-474c-a50a-41dd3771fa49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9277fe48f24411299df2224a16ee823'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:51:39.029643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e1630776-d759-474c-a50a-41dd3771fa49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9277fe48f24411299df2224a16ee823'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:51:39.036468 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e1630776-d759-474c-a50a-41dd3771fa49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9277fe48f24411299df2224a16ee823'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:51:39.037094 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e1630776-d759-474c-a50a-41dd3771fa49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9277fe48f24411299df2224a16ee823'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:51:39.037686 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e1630776-d759-474c-a50a-41dd3771fa49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9277fe48f24411299df2224a16ee823'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:51:39.054773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1270/2559] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:51:38 2022] DELETE /identity/v3/users/e9277fe48f24411299df2224a16ee823 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:51:39.234736 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e25f-a016-48f7-80bb-1acb4c078f3f service swift] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:39.260969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336e25f-a016-48f7-80bb-1acb4c078f3f service swift] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:39.337927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227931f-8fe3-4146-bece-98c6e245d412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:39.339406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227931f-8fe3-4146-bece-98c6e245d412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:39.339943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227931f-8fe3-4146-bece-98c6e245d412 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:39.340671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227931f-8fe3-4146-bece-98c6e245d412 admin admin] PATH_INFO: `/v3/projects/3b247ac663df481cb07ef27e3759d6fe` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:39.342813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227931f-8fe3-4146-bece-98c6e245d412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b247ac663df481cb07ef27e3759d6fe)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:39.346244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227931f-8fe3-4146-bece-98c6e245d412 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:39.402261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1227931f-8fe3-4146-bece-98c6e245d412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b247ac663df481cb07ef27e3759d6fe', 'request_id': 'req-1227931f-8fe3-4146-bece-98c6e245d412'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:51:39.409482 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1227931f-8fe3-4146-bece-98c6e245d412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b247ac663df481cb07ef27e3759d6fe', 'request_id': 'req-1227931f-8fe3-4146-bece-98c6e245d412'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:51:39.418295 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1227931f-8fe3-4146-bece-98c6e245d412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b247ac663df481cb07ef27e3759d6fe', 'request_id': 'req-1227931f-8fe3-4146-bece-98c6e245d412'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:51:39.429636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1227931f-8fe3-4146-bece-98c6e245d412 admin admin] The token cache is being invalidate because project 3b247ac663df481cb07ef27e3759d6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:51:39.430014 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1227931f-8fe3-4146-bece-98c6e245d412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:51:39.430643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1227931f-8fe3-4146-bece-98c6e245d412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:51:39.432219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1290/2560] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:51:39 2022] DELETE /identity/v3/projects/3b247ac663df481cb07ef27e3759d6fe => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:51:39.436949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d7f5-9f2e-49be-b4a2-89cbbb6b2b3f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:39.437242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d7f5-9f2e-49be-b4a2-89cbbb6b2b3f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:39.437522 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d7f5-9f2e-49be-b4a2-89cbbb6b2b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:39.455472 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-a4b6d7f5-9f2e-49be-b4a2-89cbbb6b2b3f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:51:39.456677 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a4b6d7f5-9f2e-49be-b4a2-89cbbb6b2b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:39.514803 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1271/2561] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:51:39.522428 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd8d55-52a8-4e05-8e9d-deb6f32dc584 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:39.522788 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd8d55-52a8-4e05-8e9d-deb6f32dc584 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:39.523074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd8d55-52a8-4e05-8e9d-deb6f32dc584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:39.541996 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-8abd8d55-52a8-4e05-8e9d-deb6f32dc584 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:51:39.543164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-8abd8d55-52a8-4e05-8e9d-deb6f32dc584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:39.551988 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1291/2562] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:51:39.555797 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d7f5-9f2e-49be-b4a2-89cbbb6b2b3f None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:39.565709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d7f5-9f2e-49be-b4a2-89cbbb6b2b3f None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:39.570240 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b7707-677c-404d-8d53-cea49e21768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:39.570883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b7707-677c-404d-8d53-cea49e21768b admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:39.571163 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b7707-677c-404d-8d53-cea49e21768b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:39.571502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b7707-677c-404d-8d53-cea49e21768b admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:39.572255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b7707-677c-404d-8d53-cea49e21768b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:51:39.572563 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b7707-677c-404d-8d53-cea49e21768b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:39.574146 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b7707-677c-404d-8d53-cea49e21768b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:39.585285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1272/2563] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:51:39.589451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd8d55-52a8-4e05-8e9d-deb6f32dc584 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:39.599169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd8d55-52a8-4e05-8e9d-deb6f32dc584 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:39.604050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92201479-16f3-49d0-bcd2-e7f255dc76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:39.604694 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92201479-16f3-49d0-bcd2-e7f255dc76ac admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:39.604979 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92201479-16f3-49d0-bcd2-e7f255dc76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:39.605258 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92201479-16f3-49d0-bcd2-e7f255dc76ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:39.605958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92201479-16f3-49d0-bcd2-e7f255dc76ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:39.607914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92201479-16f3-49d0-bcd2-e7f255dc76ac admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:39.633305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1292/2564] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:51:39 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:51:39.637432 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b7707-677c-404d-8d53-cea49e21768b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:39.648509 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b7707-677c-404d-8d53-cea49e21768b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:39.710191 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf1d1e-c791-416a-8628-e6c956cc6dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:39.710862 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf1d1e-c791-416a-8628-e6c956cc6dfa admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:39.711620 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf1d1e-c791-416a-8628-e6c956cc6dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:39.711620 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf1d1e-c791-416a-8628-e6c956cc6dfa admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:39.712294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf1d1e-c791-416a-8628-e6c956cc6dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:39.714225 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf1d1e-c791-416a-8628-e6c956cc6dfa admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:39.735056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1273/2565] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:51:39 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:51:39.739300 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92201479-16f3-49d0-bcd2-e7f255dc76ac admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:39.749451 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92201479-16f3-49d0-bcd2-e7f255dc76ac admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:39.754026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb841e3-4a2c-430a-8c85-17d079ed4311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:39.754685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb841e3-4a2c-430a-8c85-17d079ed4311 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:39.754967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb841e3-4a2c-430a-8c85-17d079ed4311 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:39.755632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb841e3-4a2c-430a-8c85-17d079ed4311 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:39.756367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb841e3-4a2c-430a-8c85-17d079ed4311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:39.758104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb841e3-4a2c-430a-8c85-17d079ed4311 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:39.771672 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1293/2566] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:51:39.773475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf1d1e-c791-416a-8628-e6c956cc6dfa admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:39.784096 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf1d1e-c791-416a-8628-e6c956cc6dfa admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:39.788752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2006b-993a-4608-bec8-e79472a6e2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:39.789397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2006b-993a-4608-bec8-e79472a6e2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:39.789680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2006b-993a-4608-bec8-e79472a6e2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:39.789955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2006b-993a-4608-bec8-e79472a6e2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:39.790937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2006b-993a-4608-bec8-e79472a6e2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:39.793170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2006b-993a-4608-bec8-e79472a6e2f5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:39.806980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1274/2567] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:51:39.811104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb841e3-4a2c-430a-8c85-17d079ed4311 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:39.821432 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb841e3-4a2c-430a-8c85-17d079ed4311 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:39.826154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72589c-bfd1-4f90-9741-e3befff2b628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:39.827095 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72589c-bfd1-4f90-9741-e3befff2b628 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:39.827475 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72589c-bfd1-4f90-9741-e3befff2b628 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:39.827814 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72589c-bfd1-4f90-9741-e3befff2b628 admin admin] PATH_INFO: `/v3/projects/719cca62ad3b4c9c8572c4379b1d557d/users/e6c47ae035244c578aa82598582bd8ff/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:39.843305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e72589c-bfd1-4f90-9741-e3befff2b628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719cca62ad3b4c9c8572c4379b1d557d, user_id=e6c47ae035244c578aa82598582bd8ff, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:39.846616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e72589c-bfd1-4f90-9741-e3befff2b628 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:39.863150 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1294/2568] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:51:39 2022] PUT /identity/v3/projects/719cca62ad3b4c9c8572c4379b1d557d/users/e6c47ae035244c578aa82598582bd8ff/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:51:39.874130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ff99d-084b-4b21-a237-7a29ee4220d9 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:39.874418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ff99d-084b-4b21-a237-7a29ee4220d9 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:39.874693 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ff99d-084b-4b21-a237-7a29ee4220d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:39.901515 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-914ff99d-084b-4b21-a237-7a29ee4220d9 None None] MFA Rules not processed for user `e6c47ae035244c578aa82598582bd8ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:51:39.902757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-914ff99d-084b-4b21-a237-7a29ee4220d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:39.968344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1275/2569] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:51:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:51:39.980175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72589c-bfd1-4f90-9741-e3befff2b628 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:39.981812 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2e72589c-bfd1-4f90-9741-e3befff2b628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:40.056002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72589c-bfd1-4f90-9741-e3befff2b628 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:40.059518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c4cc6-cf4d-4ff7-a309-1bd1145ca51e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf2b88cc78d4defa7cefb7bf0ae6144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:40.060149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c4cc6-cf4d-4ff7-a309-1bd1145ca51e service glance] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:40.060427 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c4cc6-cf4d-4ff7-a309-1bd1145ca51e service glance] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:40.060695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c4cc6-cf4d-4ff7-a309-1bd1145ca51e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:40.069446 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c4cc6-cf4d-4ff7-a309-1bd1145ca51e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:40.071183 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c4cc6-cf4d-4ff7-a309-1bd1145ca51e service glance] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:40.080526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1295/2570] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:51:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:51:41.261037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ff99d-084b-4b21-a237-7a29ee4220d9 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:51:41.262405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-914ff99d-084b-4b21-a237-7a29ee4220d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:41.327646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ff99d-084b-4b21-a237-7a29ee4220d9 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:51:41.333547 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfedf2-921f-4fc8-937c-3c65c2b67acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:51:41.334355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfedf2-921f-4fc8-937c-3c65c2b67acd service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:41.335045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfedf2-921f-4fc8-937c-3c65c2b67acd service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:41.335717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfedf2-921f-4fc8-937c-3c65c2b67acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:41.338389 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cfbfedf2-921f-4fc8-937c-3c65c2b67acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:41.400929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfedf2-921f-4fc8-937c-3c65c2b67acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:51:41.402401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfedf2-921f-4fc8-937c-3c65c2b67acd service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:51:41.412643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1276/2571] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:51:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:51:48.107275 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776ddf-38ae-4aad-81c3-c18c74442b7b None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:51:48.107823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776ddf-38ae-4aad-81c3-c18c74442b7b None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:51:48.107823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776ddf-38ae-4aad-81c3-c18c74442b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:51:48.126244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-93776ddf-38ae-4aad-81c3-c18c74442b7b None None] MFA Rules not processed for user `a867bf12e73e40c0af1181241d659320`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:51:48.127468 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-93776ddf-38ae-4aad-81c3-c18c74442b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:51:48.182080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1296/2572] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:51:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:52:27.716128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a18e80-7c32-4b96-82d9-624a37b86b72 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:27.716707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a18e80-7c32-4b96-82d9-624a37b86b72 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:27.716837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a18e80-7c32-4b96-82d9-624a37b86b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:27.733875 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-52a18e80-7c32-4b96-82d9-624a37b86b72 None None] MFA Rules not processed for user `8ddcd89df89b4ff5a2d8f3ac1a83ba67`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:52:27.735068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-52a18e80-7c32-4b96-82d9-624a37b86b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:27.793808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1277/2573] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:52:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:52:27.933272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93776ddf-38ae-4aad-81c3-c18c74442b7b None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:27.993425 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93776ddf-38ae-4aad-81c3-c18c74442b7b None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:27.997875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:27.998747 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:27.999028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:27.999330 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] PATH_INFO: `/v3/users/e6c47ae035244c578aa82598582bd8ff` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:28.000516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c47ae035244c578aa82598582bd8ff)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:28.003043 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:28.058328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c47ae035244c578aa82598582bd8ff'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:52:28.066170 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c47ae035244c578aa82598582bd8ff'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:52:28.066810 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c47ae035244c578aa82598582bd8ff'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:52:28.073566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c47ae035244c578aa82598582bd8ff'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:52:28.085192 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c47ae035244c578aa82598582bd8ff'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:52:28.091158 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1297/2574] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:52:27 2022] DELETE /identity/v3/users/e6c47ae035244c578aa82598582bd8ff => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:52:28.096347 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab7e55-cea7-41b3-9b1c-e4107d985403 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:28.096709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab7e55-cea7-41b3-9b1c-e4107d985403 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:28.097056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab7e55-cea7-41b3-9b1c-e4107d985403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:28.115544 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b7ab7e55-cea7-41b3-9b1c-e4107d985403 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:52:28.116660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b7ab7e55-cea7-41b3-9b1c-e4107d985403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:28.173456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1278/2575] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:52:28.183085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:28.184640 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:28.241517 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55067c43-27ba-40ed-ae92-800308a34c1d admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:28.245109 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bfaa8-b8a6-4876-a2bf-b8fff1fecd67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:28.245743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bfaa8-b8a6-4876-a2bf-b8fff1fecd67 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:28.246049 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bfaa8-b8a6-4876-a2bf-b8fff1fecd67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:28.246317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bfaa8-b8a6-4876-a2bf-b8fff1fecd67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:28.255650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bfaa8-b8a6-4876-a2bf-b8fff1fecd67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:28.257052 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bfaa8-b8a6-4876-a2bf-b8fff1fecd67 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:28.267901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1298/2576] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:52:28.557856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab7e55-cea7-41b3-9b1c-e4107d985403 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:28.559662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b7ab7e55-cea7-41b3-9b1c-e4107d985403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:28.573752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab7e55-cea7-41b3-9b1c-e4107d985403 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:28.598355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b130317-e0ec-47f4-b765-92021ba98415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:28.599470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b130317-e0ec-47f4-b765-92021ba98415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:28.599845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b130317-e0ec-47f4-b765-92021ba98415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:28.600286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b130317-e0ec-47f4-b765-92021ba98415 admin admin] PATH_INFO: `/v3/projects/719cca62ad3b4c9c8572c4379b1d557d` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:28.604116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b130317-e0ec-47f4-b765-92021ba98415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=719cca62ad3b4c9c8572c4379b1d557d)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:28.606047 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b130317-e0ec-47f4-b765-92021ba98415 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:28.654769 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8b130317-e0ec-47f4-b765-92021ba98415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719cca62ad3b4c9c8572c4379b1d557d', 'request_id': 'req-8b130317-e0ec-47f4-b765-92021ba98415'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:52:28.662304 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8b130317-e0ec-47f4-b765-92021ba98415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719cca62ad3b4c9c8572c4379b1d557d', 'request_id': 'req-8b130317-e0ec-47f4-b765-92021ba98415'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:52:28.671070 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8b130317-e0ec-47f4-b765-92021ba98415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719cca62ad3b4c9c8572c4379b1d557d', 'request_id': 'req-8b130317-e0ec-47f4-b765-92021ba98415'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:52:28.686611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8b130317-e0ec-47f4-b765-92021ba98415 admin admin] The token cache is being invalidate because project 719cca62ad3b4c9c8572c4379b1d557d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:52:28.686892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8b130317-e0ec-47f4-b765-92021ba98415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:52:28.689334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8b130317-e0ec-47f4-b765-92021ba98415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:52:28.690200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1279/2577] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:52:28 2022] DELETE /identity/v3/projects/719cca62ad3b4c9c8572c4379b1d557d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:52:28.695542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83082d3a-7bd5-40db-a5f7-2eecfcff2bd8 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:28.696027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83082d3a-7bd5-40db-a5f7-2eecfcff2bd8 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:28.696523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83082d3a-7bd5-40db-a5f7-2eecfcff2bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:28.716967 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-83082d3a-7bd5-40db-a5f7-2eecfcff2bd8 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:52:28.718182 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-83082d3a-7bd5-40db-a5f7-2eecfcff2bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:28.777898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1299/2578] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:52:28.787331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c4a03-57d1-4052-9ec2-bb77c83fcaff None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:28.787814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c4a03-57d1-4052-9ec2-bb77c83fcaff None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:28.787933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c4a03-57d1-4052-9ec2-bb77c83fcaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:28.809301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-467c4a03-57d1-4052-9ec2-bb77c83fcaff None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:52:28.810493 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-467c4a03-57d1-4052-9ec2-bb77c83fcaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:28.818526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1280/2579] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:52:28.822727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83082d3a-7bd5-40db-a5f7-2eecfcff2bd8 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:28.832479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83082d3a-7bd5-40db-a5f7-2eecfcff2bd8 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:28.837217 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc0e10-56f8-4c0d-a0ca-614ac8638c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:28.837877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc0e10-56f8-4c0d-a0ca-614ac8638c51 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:28.838159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc0e10-56f8-4c0d-a0ca-614ac8638c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:28.838433 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc0e10-56f8-4c0d-a0ca-614ac8638c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:28.839163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc0e10-56f8-4c0d-a0ca-614ac8638c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:52:28.839500 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc0e10-56f8-4c0d-a0ca-614ac8638c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:28.841076 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc0e10-56f8-4c0d-a0ca-614ac8638c51 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:28.853274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1300/2580] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:52:28.857391 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c4a03-57d1-4052-9ec2-bb77c83fcaff None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:28.867483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c4a03-57d1-4052-9ec2-bb77c83fcaff None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:28.872382 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97324882-98fa-42d6-b981-2d79eb331179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:28.873031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97324882-98fa-42d6-b981-2d79eb331179 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:28.873312 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97324882-98fa-42d6-b981-2d79eb331179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:28.873584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97324882-98fa-42d6-b981-2d79eb331179 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:28.874274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97324882-98fa-42d6-b981-2d79eb331179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:28.876209 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97324882-98fa-42d6-b981-2d79eb331179 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:28.901066 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1281/2581] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:52:28 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:52:28.905069 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc0e10-56f8-4c0d-a0ca-614ac8638c51 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:28.916159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc0e10-56f8-4c0d-a0ca-614ac8638c51 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:28.969563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a47d5f-9aad-496b-a47b-46c1c2de5567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:28.970853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a47d5f-9aad-496b-a47b-46c1c2de5567 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:28.971137 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a47d5f-9aad-496b-a47b-46c1c2de5567 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:28.971612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a47d5f-9aad-496b-a47b-46c1c2de5567 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:28.972289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a47d5f-9aad-496b-a47b-46c1c2de5567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:28.974168 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a47d5f-9aad-496b-a47b-46c1c2de5567 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:28.993748 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1301/2582] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:52:28 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:52:28.997814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97324882-98fa-42d6-b981-2d79eb331179 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:29.008008 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97324882-98fa-42d6-b981-2d79eb331179 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:29.012631 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9bb14-d0f5-4dc2-8b97-7fbc231ef9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:29.013283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9bb14-d0f5-4dc2-8b97-7fbc231ef9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:29.013581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9bb14-d0f5-4dc2-8b97-7fbc231ef9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:29.013856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9bb14-d0f5-4dc2-8b97-7fbc231ef9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:29.014580 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9bb14-d0f5-4dc2-8b97-7fbc231ef9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:29.016431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9bb14-d0f5-4dc2-8b97-7fbc231ef9e5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:29.027807 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1282/2583] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:52:29.032099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a47d5f-9aad-496b-a47b-46c1c2de5567 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:29.042626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a47d5f-9aad-496b-a47b-46c1c2de5567 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:29.047356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbe009-2eaa-43cd-89be-0a42f9ff0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:29.048022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe009-2eaa-43cd-89be-0a42f9ff0f60 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:29.048849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe009-2eaa-43cd-89be-0a42f9ff0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:29.049120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe009-2eaa-43cd-89be-0a42f9ff0f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:29.049834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbe009-2eaa-43cd-89be-0a42f9ff0f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:29.051422 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbe009-2eaa-43cd-89be-0a42f9ff0f60 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:29.060972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1302/2584] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:52:29.064929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9bb14-d0f5-4dc2-8b97-7fbc231ef9e5 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:29.074884 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9bb14-d0f5-4dc2-8b97-7fbc231ef9e5 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:29.079572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9d77c-3443-4e75-923a-1657c2e4d059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:29.080431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9d77c-3443-4e75-923a-1657c2e4d059 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:29.080707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9d77c-3443-4e75-923a-1657c2e4d059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:29.080977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9d77c-3443-4e75-923a-1657c2e4d059 admin admin] PATH_INFO: `/v3/projects/e954f6233f084ff0a0972369ec806b34/users/025715e81fde4ed8b8d62f900cfd3f45/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:29.094772 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9d77c-3443-4e75-923a-1657c2e4d059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e954f6233f084ff0a0972369ec806b34, user_id=025715e81fde4ed8b8d62f900cfd3f45, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:29.098112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9d77c-3443-4e75-923a-1657c2e4d059 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:29.111160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1283/2585] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:52:29 2022] PUT /identity/v3/projects/e954f6233f084ff0a0972369ec806b34/users/025715e81fde4ed8b8d62f900cfd3f45/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:52:29.116114 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe231956-a5c5-40e6-bfda-09e4fc14fd62 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:29.116408 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe231956-a5c5-40e6-bfda-09e4fc14fd62 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:29.116733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe231956-a5c5-40e6-bfda-09e4fc14fd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:29.133856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-fe231956-a5c5-40e6-bfda-09e4fc14fd62 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:52:29.135028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fe231956-a5c5-40e6-bfda-09e4fc14fd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:29.190462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1303/2586] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:52:29.200268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9d77c-3443-4e75-923a-1657c2e4d059 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:29.201957 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4ba9d77c-3443-4e75-923a-1657c2e4d059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:29.258384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9d77c-3443-4e75-923a-1657c2e4d059 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:29.262093 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456e54d-fb6d-43e3-b5fb-da4a10d2edf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:29.262736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456e54d-fb6d-43e3-b5fb-da4a10d2edf6 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:29.263019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456e54d-fb6d-43e3-b5fb-da4a10d2edf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:29.263384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456e54d-fb6d-43e3-b5fb-da4a10d2edf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:29.272892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456e54d-fb6d-43e3-b5fb-da4a10d2edf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:29.274325 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456e54d-fb6d-43e3-b5fb-da4a10d2edf6 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:29.285660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1284/2587] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:52:33.882898 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b539e-34f7-4690-8949-44cea47ae985 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:33.883720 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b539e-34f7-4690-8949-44cea47ae985 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:33.883720 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b539e-34f7-4690-8949-44cea47ae985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:33.918306 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-3c0b539e-34f7-4690-8949-44cea47ae985 None None] MFA Rules not processed for user `025715e81fde4ed8b8d62f900cfd3f45`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:52:33.920030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-3c0b539e-34f7-4690-8949-44cea47ae985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:34.003245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1304/2588] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:52:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:52:34.007153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456e54d-fb6d-43e3-b5fb-da4a10d2edf6 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:34.020456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456e54d-fb6d-43e3-b5fb-da4a10d2edf6 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:34.025551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e78fef-c4f3-41b1-93f9-5526529cc615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:34.026405 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78fef-c4f3-41b1-93f9-5526529cc615 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:34.026872 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78fef-c4f3-41b1-93f9-5526529cc615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:34.027359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e78fef-c4f3-41b1-93f9-5526529cc615 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:34.028217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e78fef-c4f3-41b1-93f9-5526529cc615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:34.030331 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e78fef-c4f3-41b1-93f9-5526529cc615 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:34.062897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1285/2589] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:52:34 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:52:34.065895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b539e-34f7-4690-8949-44cea47ae985 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:34.080736 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b539e-34f7-4690-8949-44cea47ae985 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:34.148034 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364d7d6-c61a-4aa3-a39a-6f0bef740d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:34.148951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364d7d6-c61a-4aa3-a39a-6f0bef740d52 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:34.149384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364d7d6-c61a-4aa3-a39a-6f0bef740d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:34.149824 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364d7d6-c61a-4aa3-a39a-6f0bef740d52 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:34.150806 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364d7d6-c61a-4aa3-a39a-6f0bef740d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:34.152759 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364d7d6-c61a-4aa3-a39a-6f0bef740d52 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:34.176082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1305/2590] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:52:34 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:52:34.179992 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e78fef-c4f3-41b1-93f9-5526529cc615 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:34.191433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e78fef-c4f3-41b1-93f9-5526529cc615 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:34.196401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b622ff3-b52c-40e5-afb1-c296f06587c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:34.197232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b622ff3-b52c-40e5-afb1-c296f06587c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:34.198215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b622ff3-b52c-40e5-afb1-c296f06587c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:34.198502 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b622ff3-b52c-40e5-afb1-c296f06587c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:34.199300 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b622ff3-b52c-40e5-afb1-c296f06587c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:34.201357 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b622ff3-b52c-40e5-afb1-c296f06587c5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:34.214159 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1286/2591] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:52:34.218239 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364d7d6-c61a-4aa3-a39a-6f0bef740d52 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:34.231246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364d7d6-c61a-4aa3-a39a-6f0bef740d52 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:34.237566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d678e-4641-4397-819c-611c1b9c1d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:34.238575 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d678e-4641-4397-819c-611c1b9c1d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:34.238914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d678e-4641-4397-819c-611c1b9c1d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:34.239184 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d678e-4641-4397-819c-611c1b9c1d82 admin admin] PATH_INFO: `/v3/projects/a57584c2eb7f41b1ad25b26cb9ff3c24/users/ad62203e91064d24943acdbfe2a177ce/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:34.257077 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d678e-4641-4397-819c-611c1b9c1d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57584c2eb7f41b1ad25b26cb9ff3c24, user_id=ad62203e91064d24943acdbfe2a177ce, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:34.259844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d678e-4641-4397-819c-611c1b9c1d82 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:34.274740 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1306/2592] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:52:34 2022] PUT /identity/v3/projects/a57584c2eb7f41b1ad25b26cb9ff3c24/users/ad62203e91064d24943acdbfe2a177ce/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:52:34.278825 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b622ff3-b52c-40e5-afb1-c296f06587c5 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:34.290068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b622ff3-b52c-40e5-afb1-c296f06587c5 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:34.346355 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca67942-7f04-4b83-bed9-22d21ff2eb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:34.347018 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca67942-7f04-4b83-bed9-22d21ff2eb0c admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:34.347332 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca67942-7f04-4b83-bed9-22d21ff2eb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:34.347608 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca67942-7f04-4b83-bed9-22d21ff2eb0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:34.348327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca67942-7f04-4b83-bed9-22d21ff2eb0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:34.349903 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca67942-7f04-4b83-bed9-22d21ff2eb0c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:34.359296 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1287/2593] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:52:34.367103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d678e-4641-4397-819c-611c1b9c1d82 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:34.377297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d678e-4641-4397-819c-611c1b9c1d82 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:34.381843 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebaf55-15e8-41a4-b46b-0ac06c90b919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:34.382708 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebaf55-15e8-41a4-b46b-0ac06c90b919 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:34.382983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebaf55-15e8-41a4-b46b-0ac06c90b919 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:34.383303 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebaf55-15e8-41a4-b46b-0ac06c90b919 admin admin] PATH_INFO: `/v3/projects/a57584c2eb7f41b1ad25b26cb9ff3c24/users/ad62203e91064d24943acdbfe2a177ce/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:34.385216 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebaf55-15e8-41a4-b46b-0ac06c90b919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57584c2eb7f41b1ad25b26cb9ff3c24, user_id=ad62203e91064d24943acdbfe2a177ce, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:34.387851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebaf55-15e8-41a4-b46b-0ac06c90b919 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:34.398205 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1307/2594] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:52:34 2022] PUT /identity/v3/projects/a57584c2eb7f41b1ad25b26cb9ff3c24/users/ad62203e91064d24943acdbfe2a177ce/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:52:41.705036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc395-1ba9-4b4c-bf0b-889a961c56da None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:41.705597 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc395-1ba9-4b4c-bf0b-889a961c56da None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:41.705685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc395-1ba9-4b4c-bf0b-889a961c56da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:41.751766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-feedc395-1ba9-4b4c-bf0b-889a961c56da None None] MFA Rules not processed for user `ad62203e91064d24943acdbfe2a177ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:52:41.753181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-feedc395-1ba9-4b4c-bf0b-889a961c56da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:41.891373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1288/2595] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:52:41.902784 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebaf55-15e8-41a4-b46b-0ac06c90b919 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:52:41.904782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-cfebaf55-15e8-41a4-b46b-0ac06c90b919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:42.079044 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebaf55-15e8-41a4-b46b-0ac06c90b919 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:52:42.107669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd51901-5916-4c17-991e-616aa96626f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:52:42.108362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd51901-5916-4c17-991e-616aa96626f7 service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:42.108648 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd51901-5916-4c17-991e-616aa96626f7 service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:42.108922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd51901-5916-4c17-991e-616aa96626f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:42.246317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd51901-5916-4c17-991e-616aa96626f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:52:42.249434 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd51901-5916-4c17-991e-616aa96626f7 service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:52:42.272197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1308/2596] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:52:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:52:43.811170 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a25a23-5fe0-4e28-b7f6-b31e78c16df0 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:43.813053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a25a23-5fe0-4e28-b7f6-b31e78c16df0 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:43.813708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a25a23-5fe0-4e28-b7f6-b31e78c16df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:43.847790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f2a25a23-5fe0-4e28-b7f6-b31e78c16df0 None None] MFA Rules not processed for user `6eb5d685612446d9ab48768c32759bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:52:43.849363 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f2a25a23-5fe0-4e28-b7f6-b31e78c16df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:43.947273 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1289/2597] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:52:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:52:44.104901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31a2b6-dba9-435f-b3a3-4fda9cfd9255 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:52:44.105552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31a2b6-dba9-435f-b3a3-4fda9cfd9255 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:52:44.105552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31a2b6-dba9-435f-b3a3-4fda9cfd9255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:52:44.134906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ef31a2b6-dba9-435f-b3a3-4fda9cfd9255 None None] MFA Rules not processed for user `025715e81fde4ed8b8d62f900cfd3f45`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:52:44.136486 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ef31a2b6-dba9-435f-b3a3-4fda9cfd9255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:52:44.146284 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1309/2598] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:52:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:53:16.528093 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a25a23-5fe0-4e28-b7f6-b31e78c16df0 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:53:16.582574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a25a23-5fe0-4e28-b7f6-b31e78c16df0 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:53:16.586087 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71e2b9-4496-4f0d-b5e7-b29625c931f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:53:16.586720 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71e2b9-4496-4f0d-b5e7-b29625c931f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:53:16.586999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71e2b9-4496-4f0d-b5e7-b29625c931f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:53:16.587314 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71e2b9-4496-4f0d-b5e7-b29625c931f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:53:16.589184 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-5a71e2b9-4496-4f0d-b5e7-b29625c931f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:53:16.602574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71e2b9-4496-4f0d-b5e7-b29625c931f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:53:16.604015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71e2b9-4496-4f0d-b5e7-b29625c931f0 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:53:16.613882 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31a2b6-dba9-435f-b3a3-4fda9cfd9255 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:53:16.615378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1290/2599] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:53:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:53:16.623480 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31a2b6-dba9-435f-b3a3-4fda9cfd9255 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:53:16.627586 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6df771-2090-46f0-944b-c82893683d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:53:16.628243 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6df771-2090-46f0-944b-c82893683d92 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:53:16.628522 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6df771-2090-46f0-944b-c82893683d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:53:16.628791 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6df771-2090-46f0-944b-c82893683d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:53:16.630572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-eb6df771-2090-46f0-944b-c82893683d92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:53:16.644335 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6df771-2090-46f0-944b-c82893683d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:53:16.645781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6df771-2090-46f0-944b-c82893683d92 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:53:16.656726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1310/2600] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:53:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:53:26.803990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71e2b9-4496-4f0d-b5e7-b29625c931f0 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:53:26.812372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71e2b9-4496-4f0d-b5e7-b29625c931f0 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:53:26.816227 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665440-631a-42c7-a87e-ab2adecad3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:53:26.817444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665440-631a-42c7-a87e-ab2adecad3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:53:26.817444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665440-631a-42c7-a87e-ab2adecad3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:53:26.817444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5665440-631a-42c7-a87e-ab2adecad3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:53:26.825965 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5665440-631a-42c7-a87e-ab2adecad3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:53:26.827443 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5665440-631a-42c7-a87e-ab2adecad3c4 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:53:26.837240 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1291/2601] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:53:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:53:29.196944 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93aef8-01be-4d6c-a211-170282fbf193 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:53:29.198503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93aef8-01be-4d6c-a211-170282fbf193 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:53:29.199002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93aef8-01be-4d6c-a211-170282fbf193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:53:29.216970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-5f93aef8-01be-4d6c-a211-170282fbf193 None None] MFA Rules not processed for user `a867bf12e73e40c0af1181241d659320`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:53:29.218401 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5f93aef8-01be-4d6c-a211-170282fbf193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:53:29.279465 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1311/2602] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:53:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:53:32.560787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665440-631a-42c7-a87e-ab2adecad3c4 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:53:32.562239 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f5665440-631a-42c7-a87e-ab2adecad3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:53:32.632514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5665440-631a-42c7-a87e-ab2adecad3c4 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:53:32.637015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:53:32.637875 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:53:32.638161 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:53:32.638438 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] PATH_INFO: `/v3/users/8ddcd89df89b4ff5a2d8f3ac1a83ba67` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:53:32.639654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddcd89df89b4ff5a2d8f3ac1a83ba67)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:53:32.641553 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:53:32.686470 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddcd89df89b4ff5a2d8f3ac1a83ba67'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:53:32.693667 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddcd89df89b4ff5a2d8f3ac1a83ba67'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:53:32.700326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddcd89df89b4ff5a2d8f3ac1a83ba67'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:53:32.700956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddcd89df89b4ff5a2d8f3ac1a83ba67'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:53:32.701581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddcd89df89b4ff5a2d8f3ac1a83ba67'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:53:32.717852 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1292/2603] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:53:32 2022] DELETE /identity/v3/users/8ddcd89df89b4ff5a2d8f3ac1a83ba67 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:53:32.889303 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93aef8-01be-4d6c-a211-170282fbf193 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:53:32.903038 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93aef8-01be-4d6c-a211-170282fbf193 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:53:32.958473 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:53:32.959368 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:53:32.959654 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:53:32.959911 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] PATH_INFO: `/v3/projects/e7d7f59d1c6c47278b496d93acd0e61b` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:53:32.961058 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d7f59d1c6c47278b496d93acd0e61b)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:53:32.962918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:53:33.007954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d7f59d1c6c47278b496d93acd0e61b', 'request_id': 'req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:53:33.014010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d7f59d1c6c47278b496d93acd0e61b', 'request_id': 'req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:53:33.022428 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d7f59d1c6c47278b496d93acd0e61b', 'request_id': 'req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:53:33.032852 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] The token cache is being invalidate because project e7d7f59d1c6c47278b496d93acd0e61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:53:33.033217 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:53:33.033855 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:53:33.036277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1312/2604] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:53:32 2022] DELETE /identity/v3/projects/e7d7f59d1c6c47278b496d93acd0e61b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:53:34.242673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:53:34.244241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:53:34.300871 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb792d-c061-4580-8e8f-6867798c8b9f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:53:34.352705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc412d8-8c1a-4295-b8ee-c19fe1e75ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:53:34.353359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc412d8-8c1a-4295-b8ee-c19fe1e75ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:53:34.353641 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc412d8-8c1a-4295-b8ee-c19fe1e75ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:53:34.353915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc412d8-8c1a-4295-b8ee-c19fe1e75ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:53:34.355727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1cc412d8-8c1a-4295-b8ee-c19fe1e75ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:53:34.365351 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc412d8-8c1a-4295-b8ee-c19fe1e75ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:53:34.366788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc412d8-8c1a-4295-b8ee-c19fe1e75ac1 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:53:34.374947 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1293/2605] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:53:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:53:42.204625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:53:42.206742 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:53:42.276521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0777a-3c6c-4e7a-99b9-36bec2e0f30a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:53:42.281863 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f27379-870b-4829-8c2b-899485356b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:53:42.282497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f27379-870b-4829-8c2b-899485356b8c service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:53:42.282777 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f27379-870b-4829-8c2b-899485356b8c service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:53:42.283054 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f27379-870b-4829-8c2b-899485356b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:53:42.284821 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-72f27379-870b-4829-8c2b-899485356b8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:53:42.341606 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f27379-870b-4829-8c2b-899485356b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:53:42.343167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f27379-870b-4829-8c2b-899485356b8c service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:53:42.352132 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1313/2606] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:53:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:53:55.931775 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc412d8-8c1a-4295-b8ee-c19fe1e75ac1 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:53:55.933195 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1cc412d8-8c1a-4295-b8ee-c19fe1e75ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:53:55.949249 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc412d8-8c1a-4295-b8ee-c19fe1e75ac1 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:53:55.955120 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acf499-0f79-4e70-b238-f9711af604be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:53:55.955884 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acf499-0f79-4e70-b238-f9711af604be service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:53:55.956166 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acf499-0f79-4e70-b238-f9711af604be service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:53:55.956440 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acf499-0f79-4e70-b238-f9711af604be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:53:55.958175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c9acf499-0f79-4e70-b238-f9711af604be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:53:55.970167 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acf499-0f79-4e70-b238-f9711af604be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:53:55.972326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acf499-0f79-4e70-b238-f9711af604be service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:53:55.982603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1294/2607] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:53:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:53:57.010763 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01015f47-45f4-41b6-9279-87419e5ed480 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:53:57.011244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01015f47-45f4-41b6-9279-87419e5ed480 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:53:57.011354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01015f47-45f4-41b6-9279-87419e5ed480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:53:57.028046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-01015f47-45f4-41b6-9279-87419e5ed480 None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:53:57.029214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-01015f47-45f4-41b6-9279-87419e5ed480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:53:57.082859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1314/2608] 10.222.0.73 () {58 vars in 967 bytes} [Wed May 4 13:53:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:53:57.128471 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acf499-0f79-4e70-b238-f9711af604be service nova] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:53:57.129868 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c9acf499-0f79-4e70-b238-f9711af604be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:53:57.205619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acf499-0f79-4e70-b238-f9711af604be service nova] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:53:57.210418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3d2c9-fea4-498a-93ca-0445675dfd54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:53:57.211048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3d2c9-fea4-498a-93ca-0445675dfd54 service swift] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:53:57.211364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3d2c9-fea4-498a-93ca-0445675dfd54 service swift] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:53:57.211642 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3d2c9-fea4-498a-93ca-0445675dfd54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:53:57.219340 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3d2c9-fea4-498a-93ca-0445675dfd54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:53:57.220912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3d2c9-fea4-498a-93ca-0445675dfd54 service swift] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:53:57.229120 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1295/2609] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:53:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:54:03.904750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61b76d-4417-4541-bc56-7681b353b06f None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:03.905348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61b76d-4417-4541-bc56-7681b353b06f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:03.905348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61b76d-4417-4541-bc56-7681b353b06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:03.928514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-2b61b76d-4417-4541-bc56-7681b353b06f None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:03.929743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2b61b76d-4417-4541-bc56-7681b353b06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:03.937445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1315/2610] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:54:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:03.951133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3d2c9-fea4-498a-93ca-0445675dfd54 service swift] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:03.962428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3d2c9-fea4-498a-93ca-0445675dfd54 service swift] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:03.968412 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250cc15-dda6-4599-9e58-7c55206449f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:03.969327 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250cc15-dda6-4599-9e58-7c55206449f0 service swift] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:03.969801 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250cc15-dda6-4599-9e58-7c55206449f0 service swift] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:03.970264 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250cc15-dda6-4599-9e58-7c55206449f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:03.981536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250cc15-dda6-4599-9e58-7c55206449f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:03.983288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250cc15-dda6-4599-9e58-7c55206449f0 service swift] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:04.001673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1296/2611] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:54:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 13:54:04.595060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61b76d-4417-4541-bc56-7681b353b06f None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:04.597177 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2b61b76d-4417-4541-bc56-7681b353b06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:04.727312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61b76d-4417-4541-bc56-7681b353b06f None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:04.733976 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:04.734804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:04.735087 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:04.735393 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] PATH_INFO: `/v3/users/30809c6c3edc4262b48ceb548ed18fce` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:04.736722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30809c6c3edc4262b48ceb548ed18fce)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:04.739579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:04.792597 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30809c6c3edc4262b48ceb548ed18fce'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:04.804165 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30809c6c3edc4262b48ceb548ed18fce'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:04.804943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30809c6c3edc4262b48ceb548ed18fce'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:04.815244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30809c6c3edc4262b48ceb548ed18fce'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:04.830905 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30809c6c3edc4262b48ceb548ed18fce'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:04.837269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1316/2612] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:54:04 2022] DELETE /identity/v3/users/30809c6c3edc4262b48ceb548ed18fce => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:54:05.100685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250cc15-dda6-4599-9e58-7c55206449f0 service swift] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:05.121900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250cc15-dda6-4599-9e58-7c55206449f0 service swift] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:05.216826 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:05.218039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:05.218420 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:05.218798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] PATH_INFO: `/v3/projects/05f64d63ad6d44dca07315ac8fd865e5` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:05.220165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f64d63ad6d44dca07315ac8fd865e5)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:05.222782 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:05.280268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f64d63ad6d44dca07315ac8fd865e5', 'request_id': 'req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.288937 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f64d63ad6d44dca07315ac8fd865e5', 'request_id': 'req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.302623 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f64d63ad6d44dca07315ac8fd865e5', 'request_id': 'req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.313817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] The token cache is being invalidate because project 05f64d63ad6d44dca07315ac8fd865e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:54:05.314108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.314762 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.316674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1297/2613] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:54:05 2022] DELETE /identity/v3/projects/05f64d63ad6d44dca07315ac8fd865e5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:54:05.320558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:05.322169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:05.335945 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb93fb-efeb-4c97-ada3-5b051c0359f2 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:05.401106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:05.402019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:05.402301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:05.402580 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] PATH_INFO: `/v3/users/17d5ea0e077d4ffeaca1ca85adc0d8b4` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:05.403811 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d5ea0e077d4ffeaca1ca85adc0d8b4)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:05.405693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:05.462502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d5ea0e077d4ffeaca1ca85adc0d8b4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.474325 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d5ea0e077d4ffeaca1ca85adc0d8b4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.475155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d5ea0e077d4ffeaca1ca85adc0d8b4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.483061 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d5ea0e077d4ffeaca1ca85adc0d8b4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.506133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d5ea0e077d4ffeaca1ca85adc0d8b4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.514914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1317/2614] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:54:05 2022] DELETE /identity/v3/users/17d5ea0e077d4ffeaca1ca85adc0d8b4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:54:05.746518 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:05.748108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:05.773635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895bf8a-47c3-4af0-b98a-077bbb2c8ea1 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:05.855624 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bb90d-2374-4bf7-8349-2b6dec62d36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:05.856755 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bb90d-2374-4bf7-8349-2b6dec62d36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:05.857228 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bb90d-2374-4bf7-8349-2b6dec62d36a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:05.857657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bb90d-2374-4bf7-8349-2b6dec62d36a admin admin] PATH_INFO: `/v3/projects/1c2f56d4b9c842568c5fc12f85dd0d3f` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:05.859016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bb90d-2374-4bf7-8349-2b6dec62d36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c2f56d4b9c842568c5fc12f85dd0d3f)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:05.861198 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bb90d-2374-4bf7-8349-2b6dec62d36a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:05.889404 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:05.891308 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:05.927123 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-081bb90d-2374-4bf7-8349-2b6dec62d36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c2f56d4b9c842568c5fc12f85dd0d3f', 'request_id': 'req-081bb90d-2374-4bf7-8349-2b6dec62d36a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.938804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-081bb90d-2374-4bf7-8349-2b6dec62d36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c2f56d4b9c842568c5fc12f85dd0d3f', 'request_id': 'req-081bb90d-2374-4bf7-8349-2b6dec62d36a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.957834 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-081bb90d-2374-4bf7-8349-2b6dec62d36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c2f56d4b9c842568c5fc12f85dd0d3f', 'request_id': 'req-081bb90d-2374-4bf7-8349-2b6dec62d36a'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.982804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-081bb90d-2374-4bf7-8349-2b6dec62d36a admin admin] The token cache is being invalidate because project 1c2f56d4b9c842568c5fc12f85dd0d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:54:05.983102 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-081bb90d-2374-4bf7-8349-2b6dec62d36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.983444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883527dc-5ec5-4a1e-ab97-85feebc7dd25 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:05.983859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-081bb90d-2374-4bf7-8349-2b6dec62d36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:05.985573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1298/2615] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:54:05 2022] DELETE /identity/v3/projects/1c2f56d4b9c842568c5fc12f85dd0d3f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:54:06.061847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea478f-01dc-4963-901d-012e3d99cdb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:06.062899 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea478f-01dc-4963-901d-012e3d99cdb3 service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:06.063411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea478f-01dc-4963-901d-012e3d99cdb3 service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:06.063877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea478f-01dc-4963-901d-012e3d99cdb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:06.067054 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1aea478f-01dc-4963-901d-012e3d99cdb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:06.080764 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea478f-01dc-4963-901d-012e3d99cdb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:06.082928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea478f-01dc-4963-901d-012e3d99cdb3 service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:06.105877 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1318/2616] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:54:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:09.919751 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1e76e-e67c-4257-87e1-e1b7e5084111 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:09.920261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1e76e-e67c-4257-87e1-e1b7e5084111 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:09.923497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1e76e-e67c-4257-87e1-e1b7e5084111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:09.944122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-9ae1e76e-e67c-4257-87e1-e1b7e5084111 None None] MFA Rules not processed for user `5267381c1521479d92a861283e9b31f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:09.946366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9ae1e76e-e67c-4257-87e1-e1b7e5084111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:10.008121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1299/2617] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:54:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:10.380636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea478f-01dc-4963-901d-012e3d99cdb3 service nova] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:10.382218 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1aea478f-01dc-4963-901d-012e3d99cdb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:10.440208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea478f-01dc-4963-901d-012e3d99cdb3 service nova] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:10.444841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf800c2-a270-4f9e-8fca-90b8da2c4fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:10.445686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf800c2-a270-4f9e-8fca-90b8da2c4fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:10.446130 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf800c2-a270-4f9e-8fca-90b8da2c4fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:10.446572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf800c2-a270-4f9e-8fca-90b8da2c4fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:10.448809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-adf800c2-a270-4f9e-8fca-90b8da2c4fb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:10.460334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf800c2-a270-4f9e-8fca-90b8da2c4fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:10.461917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf800c2-a270-4f9e-8fca-90b8da2c4fb4 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:10.470598 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1319/2618] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:54:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:10.946875 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1e76e-e67c-4257-87e1-e1b7e5084111 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:10.948649 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9ae1e76e-e67c-4257-87e1-e1b7e5084111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:11.044378 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1e76e-e67c-4257-87e1-e1b7e5084111 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:11.050396 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66663a-cdaf-4eb9-8e9b-0ab08cfd5930 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735744b9ea1f429399b914f3e00d166f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:11.051181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66663a-cdaf-4eb9-8e9b-0ab08cfd5930 service placement] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:11.051497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66663a-cdaf-4eb9-8e9b-0ab08cfd5930 service placement] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:11.051770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66663a-cdaf-4eb9-8e9b-0ab08cfd5930 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:11.053562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bf66663a-cdaf-4eb9-8e9b-0ab08cfd5930 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:11.066805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66663a-cdaf-4eb9-8e9b-0ab08cfd5930 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:11.068412 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66663a-cdaf-4eb9-8e9b-0ab08cfd5930 service placement] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:11.078741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1300/2619] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:54:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:19.200676 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e962656-4ecb-48ce-99df-ec11b892291f None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:19.201361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e962656-4ecb-48ce-99df-ec11b892291f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:19.201924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e962656-4ecb-48ce-99df-ec11b892291f None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:19.203497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1320/2620] 10.222.0.73 () {54 vars in 921 bytes} [Wed May 4 13:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:19.209460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7cf5c-73d6-4fa1-9ddd-53a505b1fab2 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:19.209981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7cf5c-73d6-4fa1-9ddd-53a505b1fab2 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:19.210772 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7cf5c-73d6-4fa1-9ddd-53a505b1fab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:19.251901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-cde7cf5c-73d6-4fa1-9ddd-53a505b1fab2 None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:19.253203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cde7cf5c-73d6-4fa1-9ddd-53a505b1fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:19.262725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1301/2621] 10.222.0.73 () {58 vars in 1018 bytes} [Wed May 4 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:54:19.274284 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e962656-4ecb-48ce-99df-ec11b892291f None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:19.276065 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0e962656-4ecb-48ce-99df-ec11b892291f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:19.335155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e962656-4ecb-48ce-99df-ec11b892291f None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:19.338787 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df495f7-5476-4121-89f5-906905a409a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf2b88cc78d4defa7cefb7bf0ae6144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:19.339461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df495f7-5476-4121-89f5-906905a409a4 service glance] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:19.339743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df495f7-5476-4121-89f5-906905a409a4 service glance] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:19.340013 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df495f7-5476-4121-89f5-906905a409a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:19.350436 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df495f7-5476-4121-89f5-906905a409a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:19.351879 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df495f7-5476-4121-89f5-906905a409a4 service glance] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:19.362128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1321/2622] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:54:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:54:19.425879 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404d6b-e623-4609-8c3f-39f503c091ba None None] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:19.426168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404d6b-e623-4609-8c3f-39f503c091ba None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:19.426446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404d6b-e623-4609-8c3f-39f503c091ba None None] PATH_INFO: `/` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:19.427850 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1302/2623] 10.222.0.73 () {54 vars in 921 bytes} [Wed May 4 13:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:19.432597 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1505aa9-ed9a-4847-8642-5f29e3e88e47 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:19.432886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1505aa9-ed9a-4847-8642-5f29e3e88e47 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:19.433224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1505aa9-ed9a-4847-8642-5f29e3e88e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:19.451409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d1505aa9-ed9a-4847-8642-5f29e3e88e47 None None] MFA Rules not processed for user `963a38e769674dbba95a231e47a7191f`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:19.452585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d1505aa9-ed9a-4847-8642-5f29e3e88e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:19.459467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1322/2624] 10.222.0.73 () {58 vars in 1018 bytes} [Wed May 4 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:19.470831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df404d6b-e623-4609-8c3f-39f503c091ba None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:19.481948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df404d6b-e623-4609-8c3f-39f503c091ba None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:19.485655 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec69dc6-1c73-409e-a38c-745c51335209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:19.486311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec69dc6-1c73-409e-a38c-745c51335209 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:19.486598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec69dc6-1c73-409e-a38c-745c51335209 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:19.486897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec69dc6-1c73-409e-a38c-745c51335209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:19.493989 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec69dc6-1c73-409e-a38c-745c51335209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:19.495559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec69dc6-1c73-409e-a38c-745c51335209 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:19.503190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1303/2625] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:54:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:19.582785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d205d03-2d89-4f5e-8675-37e711df9039 None None] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:19.583075 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d205d03-2d89-4f5e-8675-37e711df9039 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:19.583384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d205d03-2d89-4f5e-8675-37e711df9039 None None] PATH_INFO: `/` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:19.584765 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1323/2626] 10.222.0.73 () {54 vars in 921 bytes} [Wed May 4 13:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 13:54:19.589692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8db045-d1c6-4a5f-9e1a-48fc686a47cf None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:19.589994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8db045-d1c6-4a5f-9e1a-48fc686a47cf None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:19.590271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8db045-d1c6-4a5f-9e1a-48fc686a47cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:19.609926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-6e8db045-d1c6-4a5f-9e1a-48fc686a47cf None None] MFA Rules not processed for user `10d07b370370461a90cab0b182938292`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:19.611114 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6e8db045-d1c6-4a5f-9e1a-48fc686a47cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:19.620259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1304/2627] 10.222.0.73 () {58 vars in 1018 bytes} [Wed May 4 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:19.630686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d205d03-2d89-4f5e-8675-37e711df9039 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:19.632504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1d205d03-2d89-4f5e-8675-37e711df9039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:19.645838 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d205d03-2d89-4f5e-8675-37e711df9039 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:19.649374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f29b3d-1f23-4852-b8dc-d51d4f0e914c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:19.649999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f29b3d-1f23-4852-b8dc-d51d4f0e914c service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:19.650283 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f29b3d-1f23-4852-b8dc-d51d4f0e914c service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:19.650555 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f29b3d-1f23-4852-b8dc-d51d4f0e914c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:19.661374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f29b3d-1f23-4852-b8dc-d51d4f0e914c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:19.662776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f29b3d-1f23-4852-b8dc-d51d4f0e914c service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:19.673226 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1324/2628] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:54:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:24.889773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700fe99-9c0e-4fcf-816f-e7c300a8a3cc None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:24.890232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700fe99-9c0e-4fcf-816f-e7c300a8a3cc None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:24.890336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700fe99-9c0e-4fcf-816f-e7c300a8a3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:24.908122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-a700fe99-9c0e-4fcf-816f-e7c300a8a3cc None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:24.909335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a700fe99-9c0e-4fcf-816f-e7c300a8a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:24.987339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1305/2629] 10.222.0.73 () {58 vars in 1009 bytes} [Wed May 4 13:54:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:25.002641 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f29b3d-1f23-4852-b8dc-d51d4f0e914c service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:25.004193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d4f29b3d-1f23-4852-b8dc-d51d4f0e914c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:25.080142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f29b3d-1f23-4852-b8dc-d51d4f0e914c service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:25.086337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40611ecb-d9c3-4896-87fc-63580bc7e588 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:25.086994 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40611ecb-d9c3-4896-87fc-63580bc7e588 service swift] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:25.087440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40611ecb-d9c3-4896-87fc-63580bc7e588 service swift] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:25.087832 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40611ecb-d9c3-4896-87fc-63580bc7e588 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:25.096844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40611ecb-d9c3-4896-87fc-63580bc7e588 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:25.098449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40611ecb-d9c3-4896-87fc-63580bc7e588 service swift] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:25.109318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1325/2630] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:54:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 13:54:36.946009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700fe99-9c0e-4fcf-816f-e7c300a8a3cc None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:36.947456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a700fe99-9c0e-4fcf-816f-e7c300a8a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:37.029946 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700fe99-9c0e-4fcf-816f-e7c300a8a3cc None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:37.034015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d45ca-65b8-4d79-ac92-4e2b01e376a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:37.034685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d45ca-65b8-4d79-ac92-4e2b01e376a0 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:37.034963 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d45ca-65b8-4d79-ac92-4e2b01e376a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:37.035260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d45ca-65b8-4d79-ac92-4e2b01e376a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:37.037008 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-889d45ca-65b8-4d79-ac92-4e2b01e376a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:37.093573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d45ca-65b8-4d79-ac92-4e2b01e376a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:37.095000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d45ca-65b8-4d79-ac92-4e2b01e376a0 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:37.104303 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1306/2631] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:54:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:41.953291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aab14-5285-4aaa-9b19-84b000a36e94 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:41.953820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aab14-5285-4aaa-9b19-84b000a36e94 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:41.953820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aab14-5285-4aaa-9b19-84b000a36e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:41.974697 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-a13aab14-5285-4aaa-9b19-84b000a36e94 None None] MFA Rules not processed for user `631d619317354b76bf1535550a207b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:41.976099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a13aab14-5285-4aaa-9b19-84b000a36e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:41.989542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1326/2632] 10.222.0.73 () {58 vars in 967 bytes} [Wed May 4 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:41.998085 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d45ca-65b8-4d79-ac92-4e2b01e376a0 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:42.013236 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d45ca-65b8-4d79-ac92-4e2b01e376a0 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:42.018463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb52569-e146-418c-8736-d5ff568694d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a01334f8a41d4bf94c5aa205d70ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:42.019175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb52569-e146-418c-8736-d5ff568694d3 service swift] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:42.019437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb52569-e146-418c-8736-d5ff568694d3 service swift] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:42.019919 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb52569-e146-418c-8736-d5ff568694d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:42.031954 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb52569-e146-418c-8736-d5ff568694d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:42.035844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb52569-e146-418c-8736-d5ff568694d3 service swift] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:42.045707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1307/2633] 10.222.0.73 () {60 vars in 1384 bytes} [Wed May 4 13:54:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 13:54:46.865581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13aab14-5285-4aaa-9b19-84b000a36e94 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:46.867963 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-a13aab14-5285-4aaa-9b19-84b000a36e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:46.886457 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13aab14-5285-4aaa-9b19-84b000a36e94 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:46.893574 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8c83f-fc14-41cb-a43b-261dc9c5664d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:46.894353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8c83f-fc14-41cb-a43b-261dc9c5664d service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:46.894653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8c83f-fc14-41cb-a43b-261dc9c5664d service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:46.894928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8c83f-fc14-41cb-a43b-261dc9c5664d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:46.896716 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-48b8c83f-fc14-41cb-a43b-261dc9c5664d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:46.910148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8c83f-fc14-41cb-a43b-261dc9c5664d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:46.911855 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8c83f-fc14-41cb-a43b-261dc9c5664d service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:46.922198 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1327/2634] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:54:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:47.887414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb52569-e146-418c-8736-d5ff568694d3 service swift] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:47.896551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb52569-e146-418c-8736-d5ff568694d3 service swift] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:47.900176 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84873a57-3425-4413-8b9a-19549714a0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:47.900805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84873a57-3425-4413-8b9a-19549714a0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:47.901091 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84873a57-3425-4413-8b9a-19549714a0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:47.901373 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84873a57-3425-4413-8b9a-19549714a0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:47.903124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-84873a57-3425-4413-8b9a-19549714a0b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:47.963535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84873a57-3425-4413-8b9a-19549714a0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:47.964901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84873a57-3425-4413-8b9a-19549714a0b3 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:47.974260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1308/2635] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:51.089286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8c83f-fc14-41cb-a43b-261dc9c5664d service nova] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:51.090841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-48b8c83f-fc14-41cb-a43b-261dc9c5664d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:51.103959 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8c83f-fc14-41cb-a43b-261dc9c5664d service nova] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:51.108412 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcdb32-75cc-4de3-aaa2-0406b42fedd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:51.109271 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcdb32-75cc-4de3-aaa2-0406b42fedd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:51.109550 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcdb32-75cc-4de3-aaa2-0406b42fedd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:51.109824 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcdb32-75cc-4de3-aaa2-0406b42fedd0 admin admin] PATH_INFO: `/v3/users/a867bf12e73e40c0af1181241d659320` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:51.111023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcdb32-75cc-4de3-aaa2-0406b42fedd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a867bf12e73e40c0af1181241d659320)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:51.113453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcdb32-75cc-4de3-aaa2-0406b42fedd0 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:51.157607 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a9fcdb32-75cc-4de3-aaa2-0406b42fedd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a867bf12e73e40c0af1181241d659320'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:51.164900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a9fcdb32-75cc-4de3-aaa2-0406b42fedd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a867bf12e73e40c0af1181241d659320'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:51.165723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a9fcdb32-75cc-4de3-aaa2-0406b42fedd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a867bf12e73e40c0af1181241d659320'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:51.172749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a9fcdb32-75cc-4de3-aaa2-0406b42fedd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a867bf12e73e40c0af1181241d659320'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:51.185665 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-a9fcdb32-75cc-4de3-aaa2-0406b42fedd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a867bf12e73e40c0af1181241d659320'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:51.192384 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1328/2636] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:54:51 2022] DELETE /identity/v3/users/a867bf12e73e40c0af1181241d659320 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:54:51.360497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84873a57-3425-4413-8b9a-19549714a0b3 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:51.371604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84873a57-3425-4413-8b9a-19549714a0b3 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:51.426529 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:51.427336 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:51.427618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:51.427889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09 admin admin] PATH_INFO: `/v3/projects/9c15593c7d8143d08f5f72fb3689266a` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:51.429041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c15593c7d8143d08f5f72fb3689266a)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:51.430904 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:51.475632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c15593c7d8143d08f5f72fb3689266a', 'request_id': 'req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:51.481523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c15593c7d8143d08f5f72fb3689266a', 'request_id': 'req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:51.491991 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c15593c7d8143d08f5f72fb3689266a', 'request_id': 'req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:51.510390 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09 admin admin] The token cache is being invalidate because project 9c15593c7d8143d08f5f72fb3689266a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:54:51.510680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:51.512003 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ef775d90-c316-49e8-bdf9-bbd4d3aaff09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:54:51.513548 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1309/2637] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:54:51 2022] DELETE /identity/v3/projects/9c15593c7d8143d08f5f72fb3689266a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:54:51.518518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0222ffa-304b-4c61-a6e0-8a5763a77fc3 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:51.518807 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0222ffa-304b-4c61-a6e0-8a5763a77fc3 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:51.519085 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0222ffa-304b-4c61-a6e0-8a5763a77fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:51.537231 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b0222ffa-304b-4c61-a6e0-8a5763a77fc3 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:51.538411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b0222ffa-304b-4c61-a6e0-8a5763a77fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:51.595400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1329/2638] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:54:51.603706 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe882430-4800-4d7c-8bba-eaa180a80930 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:51.603999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe882430-4800-4d7c-8bba-eaa180a80930 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:51.604284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe882430-4800-4d7c-8bba-eaa180a80930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:51.621933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-fe882430-4800-4d7c-8bba-eaa180a80930 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:51.623115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-fe882430-4800-4d7c-8bba-eaa180a80930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:51.630954 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1310/2639] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:51.635119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0222ffa-304b-4c61-a6e0-8a5763a77fc3 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:51.645221 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0222ffa-304b-4c61-a6e0-8a5763a77fc3 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:51.649721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc556f26-7711-4c4c-9b30-42641258597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:51.650361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc556f26-7711-4c4c-9b30-42641258597f admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:51.650642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc556f26-7711-4c4c-9b30-42641258597f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:51.650917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc556f26-7711-4c4c-9b30-42641258597f admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:51.651674 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc556f26-7711-4c4c-9b30-42641258597f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:54:51.651977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc556f26-7711-4c4c-9b30-42641258597f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:51.653556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc556f26-7711-4c4c-9b30-42641258597f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:51.665254 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1330/2640] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:54:51.669559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe882430-4800-4d7c-8bba-eaa180a80930 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:51.679272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe882430-4800-4d7c-8bba-eaa180a80930 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:51.683821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b7fec-a545-404c-a119-00f379efe3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:51.684466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7fec-a545-404c-a119-00f379efe3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:51.684752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7fec-a545-404c-a119-00f379efe3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:51.685031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b7fec-a545-404c-a119-00f379efe3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:51.685729 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b7fec-a545-404c-a119-00f379efe3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:51.687693 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b7fec-a545-404c-a119-00f379efe3c3 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:51.724798 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1311/2641] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:54:51 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:54:51.727611 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc556f26-7711-4c4c-9b30-42641258597f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:51.738015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc556f26-7711-4c4c-9b30-42641258597f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:51.795726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546871d-9112-4e3e-98a3-c6037348df4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:51.796362 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546871d-9112-4e3e-98a3-c6037348df4f admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:51.796533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546871d-9112-4e3e-98a3-c6037348df4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:51.796809 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546871d-9112-4e3e-98a3-c6037348df4f admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:51.797560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546871d-9112-4e3e-98a3-c6037348df4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:51.799512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546871d-9112-4e3e-98a3-c6037348df4f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:51.819854 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1331/2642] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:54:51 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:54:51.824293 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b7fec-a545-404c-a119-00f379efe3c3 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:51.835283 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b7fec-a545-404c-a119-00f379efe3c3 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:51.840676 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35e98a-005c-4f39-9f41-422bc90f8d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:51.841335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35e98a-005c-4f39-9f41-422bc90f8d82 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:51.841646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35e98a-005c-4f39-9f41-422bc90f8d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:51.841917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35e98a-005c-4f39-9f41-422bc90f8d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:51.842645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35e98a-005c-4f39-9f41-422bc90f8d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:51.844287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35e98a-005c-4f39-9f41-422bc90f8d82 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:51.855649 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1312/2643] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:54:51.859673 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546871d-9112-4e3e-98a3-c6037348df4f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:51.869557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546871d-9112-4e3e-98a3-c6037348df4f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:51.874768 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a74042-abfd-4603-9df7-1575dab6c464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:51.875454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a74042-abfd-4603-9df7-1575dab6c464 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:51.875735 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a74042-abfd-4603-9df7-1575dab6c464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:51.876010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a74042-abfd-4603-9df7-1575dab6c464 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:51.876733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a74042-abfd-4603-9df7-1575dab6c464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:51.878310 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a74042-abfd-4603-9df7-1575dab6c464 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:51.888257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1332/2644] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:54:51.892297 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35e98a-005c-4f39-9f41-422bc90f8d82 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:51.902533 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35e98a-005c-4f39-9f41-422bc90f8d82 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:51.907362 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c7056-633a-4db7-83aa-1da59701a085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:51.908284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7056-633a-4db7-83aa-1da59701a085 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:51.909081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7056-633a-4db7-83aa-1da59701a085 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:51.909354 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7056-633a-4db7-83aa-1da59701a085 admin admin] PATH_INFO: `/v3/projects/6333cfd15a5149a885d2904e86172a52/users/e199af656b654fb9b6738ad597339e01/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:51.923344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c7056-633a-4db7-83aa-1da59701a085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6333cfd15a5149a885d2904e86172a52, user_id=e199af656b654fb9b6738ad597339e01, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:51.925973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c7056-633a-4db7-83aa-1da59701a085 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:51.938194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1313/2645] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:54:51 2022] PUT /identity/v3/projects/6333cfd15a5149a885d2904e86172a52/users/e199af656b654fb9b6738ad597339e01/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:54:51.943958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff896-dc01-4177-b702-6b4d9bad8e16 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:51.944272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff896-dc01-4177-b702-6b4d9bad8e16 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:51.944546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff896-dc01-4177-b702-6b4d9bad8e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:51.962276 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-814ff896-dc01-4177-b702-6b4d9bad8e16 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:51.963642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-814ff896-dc01-4177-b702-6b4d9bad8e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:52.020184 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1333/2646] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:52.029588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c7056-633a-4db7-83aa-1da59701a085 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:52.031268 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-071c7056-633a-4db7-83aa-1da59701a085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:52.086543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c7056-633a-4db7-83aa-1da59701a085 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:52.090130 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a8c21-acbc-40f4-a7ec-d86d8b8221f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:52.090757 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8c21-acbc-40f4-a7ec-d86d8b8221f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:52.091039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8c21-acbc-40f4-a7ec-d86d8b8221f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:52.091356 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8c21-acbc-40f4-a7ec-d86d8b8221f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:52.100044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a8c21-acbc-40f4-a7ec-d86d8b8221f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:52.101467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a8c21-acbc-40f4-a7ec-d86d8b8221f9 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:52.110604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1314/2647] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:56.137659 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee15b-6a25-47c5-a4bc-883605537b1d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:56.138173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee15b-6a25-47c5-a4bc-883605537b1d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:56.138454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee15b-6a25-47c5-a4bc-883605537b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:56.170557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-f34ee15b-6a25-47c5-a4bc-883605537b1d None None] MFA Rules not processed for user `e199af656b654fb9b6738ad597339e01`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:56.172587 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f34ee15b-6a25-47c5-a4bc-883605537b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:56.247200 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1334/2648] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:54:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:54:56.260600 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a8c21-acbc-40f4-a7ec-d86d8b8221f9 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:54:56.262475 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ca7a8c21-acbc-40f4-a7ec-d86d8b8221f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:56.337944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a8c21-acbc-40f4-a7ec-d86d8b8221f9 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:54:56.343520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae0d9e-448c-49f1-9bb8-f5401d367a81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:54:56.344154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae0d9e-448c-49f1-9bb8-f5401d367a81 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:56.344432 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae0d9e-448c-49f1-9bb8-f5401d367a81 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:56.344703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae0d9e-448c-49f1-9bb8-f5401d367a81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:56.353150 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae0d9e-448c-49f1-9bb8-f5401d367a81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:54:56.354760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae0d9e-448c-49f1-9bb8-f5401d367a81 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:54:56.364823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1315/2649] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:54:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:54:57.694559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69dcd3-a7d8-4526-9836-3e09cf0fb8bb None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:54:57.695060 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69dcd3-a7d8-4526-9836-3e09cf0fb8bb None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:54:57.695161 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69dcd3-a7d8-4526-9836-3e09cf0fb8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:54:57.712415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-cc69dcd3-a7d8-4526-9836-3e09cf0fb8bb None None] MFA Rules not processed for user `e199af656b654fb9b6738ad597339e01`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:54:57.713593 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-cc69dcd3-a7d8-4526-9836-3e09cf0fb8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:54:57.720897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1335/2650] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:54:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:23.085394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae0d9e-448c-49f1-9bb8-f5401d367a81 service nova] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:23.094491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae0d9e-448c-49f1-9bb8-f5401d367a81 service nova] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:23.098667 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d96413-214f-43e6-b72b-bae8727d1c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:23.099404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d96413-214f-43e6-b72b-bae8727d1c78 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:23.099690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d96413-214f-43e6-b72b-bae8727d1c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:23.099966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d96413-214f-43e6-b72b-bae8727d1c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:23.101698 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a0d96413-214f-43e6-b72b-bae8727d1c78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:23.113637 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d96413-214f-43e6-b72b-bae8727d1c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:23.115036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d96413-214f-43e6-b72b-bae8727d1c78 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:23.124346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1316/2651] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:26.355032 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69dcd3-a7d8-4526-9836-3e09cf0fb8bb None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:26.357149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-cc69dcd3-a7d8-4526-9836-3e09cf0fb8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:26.373291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69dcd3-a7d8-4526-9836-3e09cf0fb8bb None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:26.379330 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c94010-88ce-4fc9-9a7f-05cd83398624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:26.380232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c94010-88ce-4fc9-9a7f-05cd83398624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:26.380540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c94010-88ce-4fc9-9a7f-05cd83398624 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:26.380813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c94010-88ce-4fc9-9a7f-05cd83398624 admin admin] PATH_INFO: `/v3/users/6eb5d685612446d9ab48768c32759bcd` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:26.382027 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c94010-88ce-4fc9-9a7f-05cd83398624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb5d685612446d9ab48768c32759bcd)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:26.383969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c94010-88ce-4fc9-9a7f-05cd83398624 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:26.433992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-b4c94010-88ce-4fc9-9a7f-05cd83398624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb5d685612446d9ab48768c32759bcd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:26.441727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-b4c94010-88ce-4fc9-9a7f-05cd83398624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb5d685612446d9ab48768c32759bcd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:26.442538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-b4c94010-88ce-4fc9-9a7f-05cd83398624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb5d685612446d9ab48768c32759bcd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:26.449276 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-b4c94010-88ce-4fc9-9a7f-05cd83398624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb5d685612446d9ab48768c32759bcd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:26.461206 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-b4c94010-88ce-4fc9-9a7f-05cd83398624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb5d685612446d9ab48768c32759bcd'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:26.466904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1336/2652] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:55:26 2022] DELETE /identity/v3/users/6eb5d685612446d9ab48768c32759bcd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:26.634791 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d96413-214f-43e6-b72b-bae8727d1c78 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:26.645926 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d96413-214f-43e6-b72b-bae8727d1c78 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:26.704597 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103fa49-1461-4b9c-ad2d-a538f6d92159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:26.706107 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103fa49-1461-4b9c-ad2d-a538f6d92159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:26.706385 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103fa49-1461-4b9c-ad2d-a538f6d92159 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:26.706657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103fa49-1461-4b9c-ad2d-a538f6d92159 admin admin] PATH_INFO: `/v3/projects/817ff3e189a443a7b1f11e9a016832cc` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:26.707906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103fa49-1461-4b9c-ad2d-a538f6d92159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=817ff3e189a443a7b1f11e9a016832cc)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:26.709831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103fa49-1461-4b9c-ad2d-a538f6d92159 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:26.758862 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7103fa49-1461-4b9c-ad2d-a538f6d92159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817ff3e189a443a7b1f11e9a016832cc', 'request_id': 'req-7103fa49-1461-4b9c-ad2d-a538f6d92159'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:26.764959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7103fa49-1461-4b9c-ad2d-a538f6d92159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817ff3e189a443a7b1f11e9a016832cc', 'request_id': 'req-7103fa49-1461-4b9c-ad2d-a538f6d92159'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:26.773592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7103fa49-1461-4b9c-ad2d-a538f6d92159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817ff3e189a443a7b1f11e9a016832cc', 'request_id': 'req-7103fa49-1461-4b9c-ad2d-a538f6d92159'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:26.784490 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7103fa49-1461-4b9c-ad2d-a538f6d92159 admin admin] The token cache is being invalidate because project 817ff3e189a443a7b1f11e9a016832cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:55:26.784785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7103fa49-1461-4b9c-ad2d-a538f6d92159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:26.785537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7103fa49-1461-4b9c-ad2d-a538f6d92159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:26.787100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1317/2653] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:55:26 2022] DELETE /identity/v3/projects/817ff3e189a443a7b1f11e9a016832cc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:26.792115 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afa67d-f86a-4b29-ae0d-16d0adffd185 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:26.792410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afa67d-f86a-4b29-ae0d-16d0adffd185 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:26.792689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afa67d-f86a-4b29-ae0d-16d0adffd185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:26.811558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-09afa67d-f86a-4b29-ae0d-16d0adffd185 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:26.812866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-09afa67d-f86a-4b29-ae0d-16d0adffd185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:26.870526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1337/2654] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:26.878278 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81f2ff-43b5-4c52-b475-1d1dd33508ce None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:26.878572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81f2ff-43b5-4c52-b475-1d1dd33508ce None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:26.878856 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81f2ff-43b5-4c52-b475-1d1dd33508ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:26.897207 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-1f81f2ff-43b5-4c52-b475-1d1dd33508ce None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:26.898381 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1f81f2ff-43b5-4c52-b475-1d1dd33508ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:26.906445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1318/2655] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:26.910995 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afa67d-f86a-4b29-ae0d-16d0adffd185 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:26.920534 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afa67d-f86a-4b29-ae0d-16d0adffd185 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:26.925050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e393-8297-401b-97db-2951224f660c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:26.925693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e393-8297-401b-97db-2951224f660c admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:26.925975 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e393-8297-401b-97db-2951224f660c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:26.926250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e393-8297-401b-97db-2951224f660c admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:26.927026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716e393-8297-401b-97db-2951224f660c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:55:26.927366 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716e393-8297-401b-97db-2951224f660c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:26.928946 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716e393-8297-401b-97db-2951224f660c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:26.940389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1338/2656] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 13:55:26.944773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81f2ff-43b5-4c52-b475-1d1dd33508ce None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:26.953741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81f2ff-43b5-4c52-b475-1d1dd33508ce None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:26.958897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292334d7-a5df-4a53-9606-5e170bae1827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:26.959560 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292334d7-a5df-4a53-9606-5e170bae1827 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:26.959846 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292334d7-a5df-4a53-9606-5e170bae1827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:26.960125 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292334d7-a5df-4a53-9606-5e170bae1827 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:26.960819 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292334d7-a5df-4a53-9606-5e170bae1827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:26.962703 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292334d7-a5df-4a53-9606-5e170bae1827 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:26.987583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1319/2657] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:55:26 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:55:26.991493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e393-8297-401b-97db-2951224f660c admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:27.001101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e393-8297-401b-97db-2951224f660c admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:27.055199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dfbad-7f7e-49d9-b9a9-ef162b7bf54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:27.055887 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dfbad-7f7e-49d9-b9a9-ef162b7bf54b admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:27.056175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dfbad-7f7e-49d9-b9a9-ef162b7bf54b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:27.056452 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dfbad-7f7e-49d9-b9a9-ef162b7bf54b admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:27.057142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dfbad-7f7e-49d9-b9a9-ef162b7bf54b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:27.059041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dfbad-7f7e-49d9-b9a9-ef162b7bf54b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:27.081355 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1339/2658] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:55:26 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:27.082727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292334d7-a5df-4a53-9606-5e170bae1827 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:27.092657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292334d7-a5df-4a53-9606-5e170bae1827 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:27.097716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd102ea-732b-4a6e-aab3-ba34180a3a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:27.098353 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd102ea-732b-4a6e-aab3-ba34180a3a8b admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:27.098629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd102ea-732b-4a6e-aab3-ba34180a3a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:27.098899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd102ea-732b-4a6e-aab3-ba34180a3a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:27.099684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd102ea-732b-4a6e-aab3-ba34180a3a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:27.101286 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd102ea-732b-4a6e-aab3-ba34180a3a8b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:27.111223 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1320/2659] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:27.114938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dfbad-7f7e-49d9-b9a9-ef162b7bf54b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:27.124942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dfbad-7f7e-49d9-b9a9-ef162b7bf54b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:27.129487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ddc22-71c6-4196-95c2-a0ab9e3e3e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:27.130136 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ddc22-71c6-4196-95c2-a0ab9e3e3e35 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:27.130421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ddc22-71c6-4196-95c2-a0ab9e3e3e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:27.130698 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ddc22-71c6-4196-95c2-a0ab9e3e3e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:27.131470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ddc22-71c6-4196-95c2-a0ab9e3e3e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:27.133035 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ddc22-71c6-4196-95c2-a0ab9e3e3e35 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:27.143219 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1340/2660] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:27.146907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd102ea-732b-4a6e-aab3-ba34180a3a8b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:27.156394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd102ea-732b-4a6e-aab3-ba34180a3a8b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:27.161537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020fe1-adc4-4966-a617-a47a17de8230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:27.162393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020fe1-adc4-4966-a617-a47a17de8230 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:27.162681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020fe1-adc4-4966-a617-a47a17de8230 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:27.162955 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8020fe1-adc4-4966-a617-a47a17de8230 admin admin] PATH_INFO: `/v3/projects/6c6b334a6ef14b94bfee50b2c004b7f9/users/765b417183a348a78601e1d7901eb5e7/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:27.176774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8020fe1-adc4-4966-a617-a47a17de8230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6b334a6ef14b94bfee50b2c004b7f9, user_id=765b417183a348a78601e1d7901eb5e7, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:27.179481 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8020fe1-adc4-4966-a617-a47a17de8230 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:27.193463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1321/2661] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:27 2022] PUT /identity/v3/projects/6c6b334a6ef14b94bfee50b2c004b7f9/users/765b417183a348a78601e1d7901eb5e7/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:27.206664 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354d5e7-52e4-4656-b423-1ae7b2430643 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:27.206954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354d5e7-52e4-4656-b423-1ae7b2430643 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:27.207257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354d5e7-52e4-4656-b423-1ae7b2430643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:27.232645 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-7354d5e7-52e4-4656-b423-1ae7b2430643 None None] MFA Rules not processed for user `765b417183a348a78601e1d7901eb5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:27.233824 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7354d5e7-52e4-4656-b423-1ae7b2430643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:27.293974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1341/2662] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:27.304916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020fe1-adc4-4966-a617-a47a17de8230 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:27.306583 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c8020fe1-adc4-4966-a617-a47a17de8230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:27.377738 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8020fe1-adc4-4966-a617-a47a17de8230 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:27.383246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11d2d1-4505-4b33-a3b7-7594601565b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:27.383880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11d2d1-4505-4b33-a3b7-7594601565b1 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:27.384160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11d2d1-4505-4b33-a3b7-7594601565b1 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:27.384440 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11d2d1-4505-4b33-a3b7-7594601565b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:27.393101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11d2d1-4505-4b33-a3b7-7594601565b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:27.394683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11d2d1-4505-4b33-a3b7-7594601565b1 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:27.403449 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1322/2663] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:27.576697 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354d5e7-52e4-4656-b423-1ae7b2430643 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:27.637519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354d5e7-52e4-4656-b423-1ae7b2430643 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:27.641938 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:27.642800 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:27.643080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:27.643403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] PATH_INFO: `/v3/users/765b417183a348a78601e1d7901eb5e7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:27.644565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765b417183a348a78601e1d7901eb5e7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:27.646460 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:27.693032 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765b417183a348a78601e1d7901eb5e7'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:27.699889 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765b417183a348a78601e1d7901eb5e7'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:27.700472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765b417183a348a78601e1d7901eb5e7'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:27.707172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765b417183a348a78601e1d7901eb5e7'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:27.719614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765b417183a348a78601e1d7901eb5e7'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:27.725454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1342/2664] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:55:27 2022] DELETE /identity/v3/users/765b417183a348a78601e1d7901eb5e7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:27.730092 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8090a5f-8194-495d-aebb-4d76e6320e35 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:27.730506 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8090a5f-8194-495d-aebb-4d76e6320e35 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:27.730725 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8090a5f-8194-495d-aebb-4d76e6320e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:27.748885 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-d8090a5f-8194-495d-aebb-4d76e6320e35 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:27.750164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d8090a5f-8194-495d-aebb-4d76e6320e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:27.810536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1323/2665] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:27.822268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:27.823714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:27.879798 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a7a2f-e7c8-416d-b658-ea58e41ebff8 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:27.883392 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81defa4d-49f4-44a7-b3a8-0875113b2c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:27.884037 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81defa4d-49f4-44a7-b3a8-0875113b2c57 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:27.884315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81defa4d-49f4-44a7-b3a8-0875113b2c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:27.884585 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81defa4d-49f4-44a7-b3a8-0875113b2c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:27.893254 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81defa4d-49f4-44a7-b3a8-0875113b2c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:27.894579 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81defa4d-49f4-44a7-b3a8-0875113b2c57 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:27.903638 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1343/2666] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:28.168591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8090a5f-8194-495d-aebb-4d76e6320e35 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:28.170020 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d8090a5f-8194-495d-aebb-4d76e6320e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:28.182554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8090a5f-8194-495d-aebb-4d76e6320e35 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:28.187089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cf8e3-75ee-407d-b7fe-c3a4a8193377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:28.187975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cf8e3-75ee-407d-b7fe-c3a4a8193377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.188255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cf8e3-75ee-407d-b7fe-c3a4a8193377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.188524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cf8e3-75ee-407d-b7fe-c3a4a8193377 admin admin] PATH_INFO: `/v3/projects/6c6b334a6ef14b94bfee50b2c004b7f9` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.190202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cf8e3-75ee-407d-b7fe-c3a4a8193377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6b334a6ef14b94bfee50b2c004b7f9)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:28.192383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cf8e3-75ee-407d-b7fe-c3a4a8193377 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:28.237508 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-089cf8e3-75ee-407d-b7fe-c3a4a8193377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6b334a6ef14b94bfee50b2c004b7f9', 'request_id': 'req-089cf8e3-75ee-407d-b7fe-c3a4a8193377'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:28.243421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-089cf8e3-75ee-407d-b7fe-c3a4a8193377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6b334a6ef14b94bfee50b2c004b7f9', 'request_id': 'req-089cf8e3-75ee-407d-b7fe-c3a4a8193377'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:28.250337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-089cf8e3-75ee-407d-b7fe-c3a4a8193377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6b334a6ef14b94bfee50b2c004b7f9', 'request_id': 'req-089cf8e3-75ee-407d-b7fe-c3a4a8193377'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:28.260555 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-089cf8e3-75ee-407d-b7fe-c3a4a8193377 admin admin] The token cache is being invalidate because project 6c6b334a6ef14b94bfee50b2c004b7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:55:28.260838 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-089cf8e3-75ee-407d-b7fe-c3a4a8193377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:28.261454 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-089cf8e3-75ee-407d-b7fe-c3a4a8193377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:28.262975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1324/2667] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:55:28 2022] DELETE /identity/v3/projects/6c6b334a6ef14b94bfee50b2c004b7f9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:28.268456 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba20e32-c85d-4268-a8d6-65ea21fbce59 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.268746 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba20e32-c85d-4268-a8d6-65ea21fbce59 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.269023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba20e32-c85d-4268-a8d6-65ea21fbce59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.286290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-1ba20e32-c85d-4268-a8d6-65ea21fbce59 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:28.287502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1ba20e32-c85d-4268-a8d6-65ea21fbce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:28.345330 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1344/2668] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:28.353492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140cb65-5636-4d45-b0ca-55fcbcea0e59 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.353781 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140cb65-5636-4d45-b0ca-55fcbcea0e59 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.354059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140cb65-5636-4d45-b0ca-55fcbcea0e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.372267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-7140cb65-5636-4d45-b0ca-55fcbcea0e59 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:28.373446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7140cb65-5636-4d45-b0ca-55fcbcea0e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:28.381933 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1325/2669] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:28.385943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba20e32-c85d-4268-a8d6-65ea21fbce59 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:28.395358 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba20e32-c85d-4268-a8d6-65ea21fbce59 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:28.399803 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244725a0-f33f-424a-82c0-9ce7aecd2def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:28.400449 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244725a0-f33f-424a-82c0-9ce7aecd2def admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.400725 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244725a0-f33f-424a-82c0-9ce7aecd2def admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.400994 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244725a0-f33f-424a-82c0-9ce7aecd2def admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.401713 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244725a0-f33f-424a-82c0-9ce7aecd2def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:55:28.402018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244725a0-f33f-424a-82c0-9ce7aecd2def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:28.403878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244725a0-f33f-424a-82c0-9ce7aecd2def admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:28.418070 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1345/2670] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:55:28.422420 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140cb65-5636-4d45-b0ca-55fcbcea0e59 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:28.432271 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140cb65-5636-4d45-b0ca-55fcbcea0e59 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:28.436913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79ea9b-ce10-4a58-885b-7db54b191fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:28.437551 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79ea9b-ce10-4a58-885b-7db54b191fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.437831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79ea9b-ce10-4a58-885b-7db54b191fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.438104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79ea9b-ce10-4a58-885b-7db54b191fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.438795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79ea9b-ce10-4a58-885b-7db54b191fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:28.441695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79ea9b-ce10-4a58-885b-7db54b191fb5 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:28.467460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1326/2671] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:55:28 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:28.471722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244725a0-f33f-424a-82c0-9ce7aecd2def admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:28.481503 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244725a0-f33f-424a-82c0-9ce7aecd2def admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:28.535116 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69f2cb-e87d-4b18-98f6-c3f283f43a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:28.535789 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69f2cb-e87d-4b18-98f6-c3f283f43a16 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.536067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69f2cb-e87d-4b18-98f6-c3f283f43a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.536340 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69f2cb-e87d-4b18-98f6-c3f283f43a16 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.537021 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69f2cb-e87d-4b18-98f6-c3f283f43a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:28.538908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69f2cb-e87d-4b18-98f6-c3f283f43a16 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:28.558532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1346/2672] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:55:28 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:28.562658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79ea9b-ce10-4a58-885b-7db54b191fb5 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:28.573552 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79ea9b-ce10-4a58-885b-7db54b191fb5 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:28.578185 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ea3b1-9639-4df3-bc37-a2dc27b202c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:28.578832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ea3b1-9639-4df3-bc37-a2dc27b202c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.579108 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ea3b1-9639-4df3-bc37-a2dc27b202c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.579404 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ea3b1-9639-4df3-bc37-a2dc27b202c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.580189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ea3b1-9639-4df3-bc37-a2dc27b202c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:28.581759 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ea3b1-9639-4df3-bc37-a2dc27b202c3 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:28.591737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1327/2673] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:28.595542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69f2cb-e87d-4b18-98f6-c3f283f43a16 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:28.605323 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69f2cb-e87d-4b18-98f6-c3f283f43a16 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:28.609886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fc3a9-a0c4-4493-a848-942502957d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:28.610532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fc3a9-a0c4-4493-a848-942502957d26 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.610813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fc3a9-a0c4-4493-a848-942502957d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.611629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fc3a9-a0c4-4493-a848-942502957d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.612348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fc3a9-a0c4-4493-a848-942502957d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:28.614315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fc3a9-a0c4-4493-a848-942502957d26 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:28.623979 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1347/2674] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:28.628559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ea3b1-9639-4df3-bc37-a2dc27b202c3 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:28.638510 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ea3b1-9639-4df3-bc37-a2dc27b202c3 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:28.643147 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45ba99-d6ad-4397-8c14-f7425558c5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:28.644048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45ba99-d6ad-4397-8c14-f7425558c5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.644328 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45ba99-d6ad-4397-8c14-f7425558c5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.644601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45ba99-d6ad-4397-8c14-f7425558c5d6 admin admin] PATH_INFO: `/v3/projects/1d672f2539314576a8a34a067bbb1775/users/f78c5db6a66a4579ae8140d9a3b6f269/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.658294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45ba99-d6ad-4397-8c14-f7425558c5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d672f2539314576a8a34a067bbb1775, user_id=f78c5db6a66a4579ae8140d9a3b6f269, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:28.660944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45ba99-d6ad-4397-8c14-f7425558c5d6 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:28.674523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1328/2675] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:28 2022] PUT /identity/v3/projects/1d672f2539314576a8a34a067bbb1775/users/f78c5db6a66a4579ae8140d9a3b6f269/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:28.686119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997ef1a-cd3a-4057-bef1-c06b98f8c847 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.686410 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997ef1a-cd3a-4057-bef1-c06b98f8c847 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.686687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997ef1a-cd3a-4057-bef1-c06b98f8c847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.714635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b997ef1a-cd3a-4057-bef1-c06b98f8c847 None None] MFA Rules not processed for user `f78c5db6a66a4579ae8140d9a3b6f269`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:28.715856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b997ef1a-cd3a-4057-bef1-c06b98f8c847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:28.777623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1348/2676] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:28.782279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45ba99-d6ad-4397-8c14-f7425558c5d6 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:28.845521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45ba99-d6ad-4397-8c14-f7425558c5d6 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:28.850109 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b893c-c629-4967-b6b5-376b1d4f6fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:28.850759 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b893c-c629-4967-b6b5-376b1d4f6fbf admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.851042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b893c-c629-4967-b6b5-376b1d4f6fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.851346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b893c-c629-4967-b6b5-376b1d4f6fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.852044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b893c-c629-4967-b6b5-376b1d4f6fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:28.853946 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b893c-c629-4967-b6b5-376b1d4f6fbf admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:28.878067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1329/2677] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:55:28 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:28.882149 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997ef1a-cd3a-4057-bef1-c06b98f8c847 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:28.893022 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997ef1a-cd3a-4057-bef1-c06b98f8c847 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:28.946636 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1fd82-361a-4bff-ba08-a697856fe43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:28.947253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1fd82-361a-4bff-ba08-a697856fe43d admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.947541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1fd82-361a-4bff-ba08-a697856fe43d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.947817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1fd82-361a-4bff-ba08-a697856fe43d admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.948504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1fd82-361a-4bff-ba08-a697856fe43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:28.950467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1fd82-361a-4bff-ba08-a697856fe43d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:28.971537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1349/2678] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:55:28 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:55:28.973950 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b893c-c629-4967-b6b5-376b1d4f6fbf admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:28.984064 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b893c-c629-4967-b6b5-376b1d4f6fbf admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:28.988603 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d3119-3891-4e2f-8ef9-3d7e5ac434d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:28.989248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d3119-3891-4e2f-8ef9-3d7e5ac434d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:28.989530 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d3119-3891-4e2f-8ef9-3d7e5ac434d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:28.989805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d3119-3891-4e2f-8ef9-3d7e5ac434d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:28.990550 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d3119-3891-4e2f-8ef9-3d7e5ac434d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:28.992157 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d3119-3891-4e2f-8ef9-3d7e5ac434d6 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:29.002700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1330/2679] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:29.006563 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1fd82-361a-4bff-ba08-a697856fe43d admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:29.016389 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1fd82-361a-4bff-ba08-a697856fe43d admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:29.021537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b2ad-4e61-4f45-b36b-fef3cfd0bf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:29.022409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b2ad-4e61-4f45-b36b-fef3cfd0bf1f admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:29.022693 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b2ad-4e61-4f45-b36b-fef3cfd0bf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:29.022972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b2ad-4e61-4f45-b36b-fef3cfd0bf1f admin admin] PATH_INFO: `/v3/projects/f625e8fd426241fcb1def1c12902a3f0/users/6868503025ba4be6bc7742d13f47b9eb/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:29.037018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3b2ad-4e61-4f45-b36b-fef3cfd0bf1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f625e8fd426241fcb1def1c12902a3f0, user_id=6868503025ba4be6bc7742d13f47b9eb, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:29.039689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3b2ad-4e61-4f45-b36b-fef3cfd0bf1f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:29.052234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1350/2680] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:29 2022] PUT /identity/v3/projects/f625e8fd426241fcb1def1c12902a3f0/users/6868503025ba4be6bc7742d13f47b9eb/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:55:29.056179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d3119-3891-4e2f-8ef9-3d7e5ac434d6 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:29.066752 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d3119-3891-4e2f-8ef9-3d7e5ac434d6 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:29.120038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2ef44-5c6d-4403-b522-3fdeed75bef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:29.120692 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2ef44-5c6d-4403-b522-3fdeed75bef6 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:29.120977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2ef44-5c6d-4403-b522-3fdeed75bef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:29.121254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2ef44-5c6d-4403-b522-3fdeed75bef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:29.121976 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2ef44-5c6d-4403-b522-3fdeed75bef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:29.123661 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2ef44-5c6d-4403-b522-3fdeed75bef6 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:29.133546 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1331/2681] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:29.137771 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b2ad-4e61-4f45-b36b-fef3cfd0bf1f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:29.148498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b2ad-4e61-4f45-b36b-fef3cfd0bf1f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:29.153072 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c29be-2081-4749-8def-5084fea8ba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:29.154000 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c29be-2081-4749-8def-5084fea8ba8f admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:29.154280 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c29be-2081-4749-8def-5084fea8ba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:29.154557 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c29be-2081-4749-8def-5084fea8ba8f admin admin] PATH_INFO: `/v3/projects/f625e8fd426241fcb1def1c12902a3f0/users/6868503025ba4be6bc7742d13f47b9eb/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:29.156546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c29be-2081-4749-8def-5084fea8ba8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f625e8fd426241fcb1def1c12902a3f0, user_id=6868503025ba4be6bc7742d13f47b9eb, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:29.159769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c29be-2081-4749-8def-5084fea8ba8f admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:29.169564 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1351/2682] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:29 2022] PUT /identity/v3/projects/f625e8fd426241fcb1def1c12902a3f0/users/6868503025ba4be6bc7742d13f47b9eb/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:29.179519 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65f64c-0e02-44c1-ac7d-474c2413c1aa None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:29.179797 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65f64c-0e02-44c1-ac7d-474c2413c1aa None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:29.180081 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65f64c-0e02-44c1-ac7d-474c2413c1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:29.210383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-cf65f64c-0e02-44c1-ac7d-474c2413c1aa None None] MFA Rules not processed for user `6868503025ba4be6bc7742d13f47b9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:29.211578 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-cf65f64c-0e02-44c1-ac7d-474c2413c1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:29.275869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1332/2683] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:29.287604 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c29be-2081-4749-8def-5084fea8ba8f admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:29.289292 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6c2c29be-2081-4749-8def-5084fea8ba8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:29.344950 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c29be-2081-4749-8def-5084fea8ba8f admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:29.349179 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfcab9-d366-4366-a859-a0b6d27189ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:29.349816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfcab9-d366-4366-a859-a0b6d27189ce service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:29.350102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfcab9-d366-4366-a859-a0b6d27189ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:29.350379 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfcab9-d366-4366-a859-a0b6d27189ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:29.359079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfcab9-d366-4366-a859-a0b6d27189ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:29.360527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfcab9-d366-4366-a859-a0b6d27189ce service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:29.369842 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1352/2684] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:29.439896 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65f64c-0e02-44c1-ac7d-474c2413c1aa None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:29.449476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65f64c-0e02-44c1-ac7d-474c2413c1aa None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:29.452994 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2f35e-c743-4bb8-ad98-b106aea0b5c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:29.453634 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f35e-c743-4bb8-ad98-b106aea0b5c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:29.453911 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f35e-c743-4bb8-ad98-b106aea0b5c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:29.454186 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f35e-c743-4bb8-ad98-b106aea0b5c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:29.527335 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2f35e-c743-4bb8-ad98-b106aea0b5c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:29.529675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2f35e-c743-4bb8-ad98-b106aea0b5c6 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:29.540734 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1333/2685] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:38.257512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfcab9-d366-4366-a859-a0b6d27189ce service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:38.316951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfcab9-d366-4366-a859-a0b6d27189ce service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:38.321492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:38.322354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:38.322634 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:38.322905 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] PATH_INFO: `/v3/users/f78c5db6a66a4579ae8140d9a3b6f269` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:38.324119 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f78c5db6a66a4579ae8140d9a3b6f269)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:38.326010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:38.372139 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f78c5db6a66a4579ae8140d9a3b6f269'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:38.379016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f78c5db6a66a4579ae8140d9a3b6f269'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:38.379643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f78c5db6a66a4579ae8140d9a3b6f269'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:38.389062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f78c5db6a66a4579ae8140d9a3b6f269'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:38.398822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f78c5db6a66a4579ae8140d9a3b6f269'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:38.404795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1353/2686] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:55:38 2022] DELETE /identity/v3/users/f78c5db6a66a4579ae8140d9a3b6f269 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:38.409813 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a2e07-95d1-4508-b60b-1f5fc0618e14 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:38.410307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a2e07-95d1-4508-b60b-1f5fc0618e14 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:38.410416 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a2e07-95d1-4508-b60b-1f5fc0618e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:38.426836 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-543a2e07-95d1-4508-b60b-1f5fc0618e14 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:38.428041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-543a2e07-95d1-4508-b60b-1f5fc0618e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:38.484215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1334/2687] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:38.493612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:38.494983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:38.549291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b25c8-0d0c-4bb5-bc0d-62579aa6b2ba admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:38.552917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e97ba-7c7a-4d59-bbd0-c5a53ba6605c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:38.553546 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e97ba-7c7a-4d59-bbd0-c5a53ba6605c service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:38.553828 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e97ba-7c7a-4d59-bbd0-c5a53ba6605c service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:38.554102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e97ba-7c7a-4d59-bbd0-c5a53ba6605c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:38.562922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e97ba-7c7a-4d59-bbd0-c5a53ba6605c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:38.564861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e97ba-7c7a-4d59-bbd0-c5a53ba6605c service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:38.574267 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1354/2688] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:38.836192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a2e07-95d1-4508-b60b-1f5fc0618e14 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:38.837575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-543a2e07-95d1-4508-b60b-1f5fc0618e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:38.849605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a2e07-95d1-4508-b60b-1f5fc0618e14 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:38.854736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:38.855727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:38.856005 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:38.856276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] PATH_INFO: `/v3/projects/1d672f2539314576a8a34a067bbb1775` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:38.857467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d672f2539314576a8a34a067bbb1775)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:38.859372 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:38.909574 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d672f2539314576a8a34a067bbb1775', 'request_id': 'req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:38.916202 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d672f2539314576a8a34a067bbb1775', 'request_id': 'req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:38.923906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d672f2539314576a8a34a067bbb1775', 'request_id': 'req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:38.934160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] The token cache is being invalidate because project 1d672f2539314576a8a34a067bbb1775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:55:38.934444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:38.935060 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:38.936640 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1335/2689] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:55:38 2022] DELETE /identity/v3/projects/1d672f2539314576a8a34a067bbb1775 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:38.941068 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e97ba-7c7a-4d59-bbd0-c5a53ba6605c service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:38.950829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e97ba-7c7a-4d59-bbd0-c5a53ba6605c service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:39.005813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cab85-72d6-4b23-9369-f7ba046a539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:39.006690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cab85-72d6-4b23-9369-f7ba046a539d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:39.006994 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cab85-72d6-4b23-9369-f7ba046a539d admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:39.007823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cab85-72d6-4b23-9369-f7ba046a539d admin admin] PATH_INFO: `/v3/users/6868503025ba4be6bc7742d13f47b9eb` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:39.008470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cab85-72d6-4b23-9369-f7ba046a539d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6868503025ba4be6bc7742d13f47b9eb)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:39.010365 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cab85-72d6-4b23-9369-f7ba046a539d admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:39.052819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ed0cab85-72d6-4b23-9369-f7ba046a539d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6868503025ba4be6bc7742d13f47b9eb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:39.059558 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ed0cab85-72d6-4b23-9369-f7ba046a539d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6868503025ba4be6bc7742d13f47b9eb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:39.060194 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ed0cab85-72d6-4b23-9369-f7ba046a539d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6868503025ba4be6bc7742d13f47b9eb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:39.067783 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ed0cab85-72d6-4b23-9369-f7ba046a539d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6868503025ba4be6bc7742d13f47b9eb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:39.078830 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ed0cab85-72d6-4b23-9369-f7ba046a539d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6868503025ba4be6bc7742d13f47b9eb'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:39.084642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1355/2690] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:55:38 2022] DELETE /identity/v3/users/6868503025ba4be6bc7742d13f47b9eb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:55:39.346675 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:39.348189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:39.363387 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a073c27-c92b-4f4d-be1e-979d1e10bfa3 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:39.417940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:39.418802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:39.419084 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:39.419394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0 admin admin] PATH_INFO: `/v3/projects/f625e8fd426241fcb1def1c12902a3f0` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:39.420561 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f625e8fd426241fcb1def1c12902a3f0)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:39.422492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:39.465722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f625e8fd426241fcb1def1c12902a3f0', 'request_id': 'req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:39.472069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f625e8fd426241fcb1def1c12902a3f0', 'request_id': 'req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:39.479057 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f625e8fd426241fcb1def1c12902a3f0', 'request_id': 'req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:39.489496 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0 admin admin] The token cache is being invalidate because project f625e8fd426241fcb1def1c12902a3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:55:39.489779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:39.490393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-4b629598-a4dc-4af3-a9bf-18a3cfe2cfb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:39.491940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1336/2691] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:55:39 2022] DELETE /identity/v3/projects/f625e8fd426241fcb1def1c12902a3f0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:39.496782 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de188776-86fc-4590-87b4-a842cb60373f None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:39.497244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de188776-86fc-4590-87b4-a842cb60373f None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:39.497361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de188776-86fc-4590-87b4-a842cb60373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:39.514824 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-de188776-86fc-4590-87b4-a842cb60373f None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:39.516110 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-de188776-86fc-4590-87b4-a842cb60373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:39.571844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1356/2692] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:39.579411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f8940-884d-4cae-91d0-dbbec2c71313 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:39.580203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f8940-884d-4cae-91d0-dbbec2c71313 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:39.580484 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f8940-884d-4cae-91d0-dbbec2c71313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:39.598615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-d00f8940-884d-4cae-91d0-dbbec2c71313 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:39.599817 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d00f8940-884d-4cae-91d0-dbbec2c71313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:39.607537 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1337/2693] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:39.611481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de188776-86fc-4590-87b4-a842cb60373f None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:39.620813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de188776-86fc-4590-87b4-a842cb60373f None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:39.625306 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0e083-bf2c-4ca1-9d2e-caddb90aa4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:39.625949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0e083-bf2c-4ca1-9d2e-caddb90aa4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:39.626229 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0e083-bf2c-4ca1-9d2e-caddb90aa4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:39.626527 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0e083-bf2c-4ca1-9d2e-caddb90aa4a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:39.627264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0e083-bf2c-4ca1-9d2e-caddb90aa4a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:55:39.627572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0e083-bf2c-4ca1-9d2e-caddb90aa4a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:39.629129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0e083-bf2c-4ca1-9d2e-caddb90aa4a4 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:39.640040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1357/2694] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:55:39.644632 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f8940-884d-4cae-91d0-dbbec2c71313 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:39.653677 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f8940-884d-4cae-91d0-dbbec2c71313 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:39.658971 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbac0e3-36ea-400a-b738-8e58ba2e891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:39.659649 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbac0e3-36ea-400a-b738-8e58ba2e891c admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:39.659936 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbac0e3-36ea-400a-b738-8e58ba2e891c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:39.660215 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbac0e3-36ea-400a-b738-8e58ba2e891c admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:39.660912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbac0e3-36ea-400a-b738-8e58ba2e891c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:39.662818 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbac0e3-36ea-400a-b738-8e58ba2e891c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:39.687051 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1338/2695] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:55:39 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:39.691025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0e083-bf2c-4ca1-9d2e-caddb90aa4a4 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:39.700837 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0e083-bf2c-4ca1-9d2e-caddb90aa4a4 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:39.755098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31b0a2-3cd4-4a43-b3f9-39e8e3c74014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:39.755815 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31b0a2-3cd4-4a43-b3f9-39e8e3c74014 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:39.756097 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31b0a2-3cd4-4a43-b3f9-39e8e3c74014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:39.756374 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31b0a2-3cd4-4a43-b3f9-39e8e3c74014 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:39.757056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31b0a2-3cd4-4a43-b3f9-39e8e3c74014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:39.758954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31b0a2-3cd4-4a43-b3f9-39e8e3c74014 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:39.778501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1358/2696] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:55:39 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:39.782688 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbac0e3-36ea-400a-b738-8e58ba2e891c admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:39.793174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbac0e3-36ea-400a-b738-8e58ba2e891c admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:39.797899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add89e9-dffe-4b31-ba94-2fcdb5bc3678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:39.798573 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add89e9-dffe-4b31-ba94-2fcdb5bc3678 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:39.798873 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add89e9-dffe-4b31-ba94-2fcdb5bc3678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:39.799133 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add89e9-dffe-4b31-ba94-2fcdb5bc3678 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:39.799886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add89e9-dffe-4b31-ba94-2fcdb5bc3678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:39.801478 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add89e9-dffe-4b31-ba94-2fcdb5bc3678 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:39.811704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1339/2697] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:39.815501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31b0a2-3cd4-4a43-b3f9-39e8e3c74014 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:39.825458 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31b0a2-3cd4-4a43-b3f9-39e8e3c74014 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:39.830621 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3061d-94f8-499d-a0c4-c2867ffeb861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:39.831296 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3061d-94f8-499d-a0c4-c2867ffeb861 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:39.831577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3061d-94f8-499d-a0c4-c2867ffeb861 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:39.831849 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3061d-94f8-499d-a0c4-c2867ffeb861 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:39.832567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3061d-94f8-499d-a0c4-c2867ffeb861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:39.834122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3061d-94f8-499d-a0c4-c2867ffeb861 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:39.843628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1359/2698] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:39.848153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add89e9-dffe-4b31-ba94-2fcdb5bc3678 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:39.857814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add89e9-dffe-4b31-ba94-2fcdb5bc3678 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:39.862316 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6759d6-866f-4704-bb62-37f63f81c3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:39.863257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6759d6-866f-4704-bb62-37f63f81c3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:39.863507 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6759d6-866f-4704-bb62-37f63f81c3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:39.863780 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6759d6-866f-4704-bb62-37f63f81c3bd admin admin] PATH_INFO: `/v3/projects/f5a8677dfcac492e9eb9a36b6d6b185e/users/655ec42abcbe43859743729f9911ca79/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:39.880442 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6759d6-866f-4704-bb62-37f63f81c3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a8677dfcac492e9eb9a36b6d6b185e, user_id=655ec42abcbe43859743729f9911ca79, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:39.883100 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6759d6-866f-4704-bb62-37f63f81c3bd admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:39.896934 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1340/2699] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:39 2022] PUT /identity/v3/projects/f5a8677dfcac492e9eb9a36b6d6b185e/users/655ec42abcbe43859743729f9911ca79/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:39.908443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83027f8-1ee6-44f1-bc57-a84ab8c122db None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:39.908762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83027f8-1ee6-44f1-bc57-a84ab8c122db None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:39.909040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83027f8-1ee6-44f1-bc57-a84ab8c122db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:39.934901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-c83027f8-1ee6-44f1-bc57-a84ab8c122db None None] MFA Rules not processed for user `655ec42abcbe43859743729f9911ca79`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:39.936133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c83027f8-1ee6-44f1-bc57-a84ab8c122db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:39.997699 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1360/2700] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:40.002620 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6759d6-866f-4704-bb62-37f63f81c3bd admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:40.061954 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6759d6-866f-4704-bb62-37f63f81c3bd admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:40.067432 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36823b8-6999-49f3-bfc7-a1d5fb2504f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:40.068084 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36823b8-6999-49f3-bfc7-a1d5fb2504f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:40.068375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36823b8-6999-49f3-bfc7-a1d5fb2504f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:40.068652 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36823b8-6999-49f3-bfc7-a1d5fb2504f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:40.069349 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36823b8-6999-49f3-bfc7-a1d5fb2504f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:40.071317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36823b8-6999-49f3-bfc7-a1d5fb2504f9 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:40.097061 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1341/2701] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:55:40 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:40.100421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83027f8-1ee6-44f1-bc57-a84ab8c122db None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:40.110838 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83027f8-1ee6-44f1-bc57-a84ab8c122db None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:40.165915 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a1f03-32a5-4dba-a6f3-c053a644c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:40.166591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a1f03-32a5-4dba-a6f3-c053a644c793 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:40.166876 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a1f03-32a5-4dba-a6f3-c053a644c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:40.167155 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a1f03-32a5-4dba-a6f3-c053a644c793 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:40.167900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a1f03-32a5-4dba-a6f3-c053a644c793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:40.169843 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a1f03-32a5-4dba-a6f3-c053a644c793 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:40.190255 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1361/2702] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:55:40 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:40.194274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36823b8-6999-49f3-bfc7-a1d5fb2504f9 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:40.204251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36823b8-6999-49f3-bfc7-a1d5fb2504f9 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:40.208754 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e17a0d-9a24-4544-89da-47f346c7b71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:40.209395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e17a0d-9a24-4544-89da-47f346c7b71f admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:40.209673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e17a0d-9a24-4544-89da-47f346c7b71f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:40.209940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e17a0d-9a24-4544-89da-47f346c7b71f admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:40.210651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e17a0d-9a24-4544-89da-47f346c7b71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:40.212257 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e17a0d-9a24-4544-89da-47f346c7b71f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:40.222792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1342/2703] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:40.226544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a1f03-32a5-4dba-a6f3-c053a644c793 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:40.237504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a1f03-32a5-4dba-a6f3-c053a644c793 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:40.242138 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff57bc-88cf-4b14-a195-b675d39fc1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:40.243008 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff57bc-88cf-4b14-a195-b675d39fc1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:40.243324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff57bc-88cf-4b14-a195-b675d39fc1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:40.243600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff57bc-88cf-4b14-a195-b675d39fc1c8 admin admin] PATH_INFO: `/v3/projects/e1ea50dbac3b485eabcbc73c46b629a5/users/0fae6a60277247e4a474316aa84c0f21/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:40.257695 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff57bc-88cf-4b14-a195-b675d39fc1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ea50dbac3b485eabcbc73c46b629a5, user_id=0fae6a60277247e4a474316aa84c0f21, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:40.260269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff57bc-88cf-4b14-a195-b675d39fc1c8 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:40.272264 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1362/2704] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:40 2022] PUT /identity/v3/projects/e1ea50dbac3b485eabcbc73c46b629a5/users/0fae6a60277247e4a474316aa84c0f21/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:40.276104 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e17a0d-9a24-4544-89da-47f346c7b71f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:40.286041 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e17a0d-9a24-4544-89da-47f346c7b71f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:40.340848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ef675-156c-422b-bd41-bc5645ab887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:40.341512 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ef675-156c-422b-bd41-bc5645ab887a admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:40.341795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ef675-156c-422b-bd41-bc5645ab887a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:40.342069 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ef675-156c-422b-bd41-bc5645ab887a admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:40.342785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ef675-156c-422b-bd41-bc5645ab887a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:40.344395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ef675-156c-422b-bd41-bc5645ab887a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:40.354276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1343/2705] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:40.358513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff57bc-88cf-4b14-a195-b675d39fc1c8 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:40.368590 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff57bc-88cf-4b14-a195-b675d39fc1c8 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:40.373241 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a39a1c-aa91-4074-b70c-be66de59d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:40.374112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a39a1c-aa91-4074-b70c-be66de59d229 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:40.374399 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a39a1c-aa91-4074-b70c-be66de59d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:40.374670 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a39a1c-aa91-4074-b70c-be66de59d229 admin admin] PATH_INFO: `/v3/projects/e1ea50dbac3b485eabcbc73c46b629a5/users/0fae6a60277247e4a474316aa84c0f21/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:40.376685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a39a1c-aa91-4074-b70c-be66de59d229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ea50dbac3b485eabcbc73c46b629a5, user_id=0fae6a60277247e4a474316aa84c0f21, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:40.379322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a39a1c-aa91-4074-b70c-be66de59d229 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:40.389357 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1363/2706] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:40 2022] PUT /identity/v3/projects/e1ea50dbac3b485eabcbc73c46b629a5/users/0fae6a60277247e4a474316aa84c0f21/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:40.399716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a715b-80e3-4757-bf99-2c6421ea12c4 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:40.400012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a715b-80e3-4757-bf99-2c6421ea12c4 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:40.400341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a715b-80e3-4757-bf99-2c6421ea12c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:40.426480 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-c99a715b-80e3-4757-bf99-2c6421ea12c4 None None] MFA Rules not processed for user `0fae6a60277247e4a474316aa84c0f21`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:40.427700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c99a715b-80e3-4757-bf99-2c6421ea12c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:40.492326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1344/2707] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:40.503628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a39a1c-aa91-4074-b70c-be66de59d229 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:40.505331 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-77a39a1c-aa91-4074-b70c-be66de59d229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:40.561714 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a39a1c-aa91-4074-b70c-be66de59d229 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:40.565291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723c7a5-6368-4ce6-8cb9-a417496e556a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:40.565928 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723c7a5-6368-4ce6-8cb9-a417496e556a service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:40.566471 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723c7a5-6368-4ce6-8cb9-a417496e556a service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:40.566749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723c7a5-6368-4ce6-8cb9-a417496e556a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:40.575794 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723c7a5-6368-4ce6-8cb9-a417496e556a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:40.577201 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723c7a5-6368-4ce6-8cb9-a417496e556a service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:40.586814 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1364/2708] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:40.968352 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a715b-80e3-4757-bf99-2c6421ea12c4 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:41.028142 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a715b-80e3-4757-bf99-2c6421ea12c4 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:41.032624 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:41.033488 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:41.033774 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:41.034053 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] PATH_INFO: `/v3/users/655ec42abcbe43859743729f9911ca79` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:41.035232 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=655ec42abcbe43859743729f9911ca79)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:41.037138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:41.081716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655ec42abcbe43859743729f9911ca79'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.088804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655ec42abcbe43859743729f9911ca79'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.095554 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655ec42abcbe43859743729f9911ca79'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.096197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655ec42abcbe43859743729f9911ca79'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.096794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655ec42abcbe43859743729f9911ca79'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.113302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1345/2709] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:55:40 2022] DELETE /identity/v3/users/655ec42abcbe43859743729f9911ca79 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:55:41.117981 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3020e-cfb5-48c3-8931-3029f0dfc343 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:41.118279 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3020e-cfb5-48c3-8931-3029f0dfc343 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:41.118559 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3020e-cfb5-48c3-8931-3029f0dfc343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:41.135906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-82d3020e-cfb5-48c3-8931-3029f0dfc343 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:41.137088 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-82d3020e-cfb5-48c3-8931-3029f0dfc343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:41.201351 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1365/2710] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:41.210987 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:41.212491 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:41.271085 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b3f6a-a298-4fd0-ac4b-a97cfbbd3861 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:41.274795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1cc48-23c8-4ae3-9618-38e49521619f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:41.275466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1cc48-23c8-4ae3-9618-38e49521619f service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:41.275747 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1cc48-23c8-4ae3-9618-38e49521619f service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:41.276021 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1cc48-23c8-4ae3-9618-38e49521619f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:41.285545 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1cc48-23c8-4ae3-9618-38e49521619f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:41.286968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1cc48-23c8-4ae3-9618-38e49521619f service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:41.297538 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1346/2711] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:41.592253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3020e-cfb5-48c3-8931-3029f0dfc343 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:41.593732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-82d3020e-cfb5-48c3-8931-3029f0dfc343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:41.605334 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3020e-cfb5-48c3-8931-3029f0dfc343 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:41.609886 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:41.610829 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:41.611028 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:41.611330 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] PATH_INFO: `/v3/projects/f5a8677dfcac492e9eb9a36b6d6b185e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:41.612499 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a8677dfcac492e9eb9a36b6d6b185e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:41.614397 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:41.660157 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a8677dfcac492e9eb9a36b6d6b185e', 'request_id': 'req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.666031 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a8677dfcac492e9eb9a36b6d6b185e', 'request_id': 'req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.673009 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a8677dfcac492e9eb9a36b6d6b185e', 'request_id': 'req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.682999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] The token cache is being invalidate because project f5a8677dfcac492e9eb9a36b6d6b185e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:55:41.683317 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.683969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.685536 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1366/2712] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:55:41 2022] DELETE /identity/v3/projects/f5a8677dfcac492e9eb9a36b6d6b185e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:41.690212 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1cc48-23c8-4ae3-9618-38e49521619f service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:41.700604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1cc48-23c8-4ae3-9618-38e49521619f service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:41.754635 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d267d-1cd9-46a7-aa5f-7c2de54c28df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:41.755541 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d267d-1cd9-46a7-aa5f-7c2de54c28df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:41.755828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d267d-1cd9-46a7-aa5f-7c2de54c28df admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:41.756107 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d267d-1cd9-46a7-aa5f-7c2de54c28df admin admin] PATH_INFO: `/v3/users/0fae6a60277247e4a474316aa84c0f21` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:41.757280 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d267d-1cd9-46a7-aa5f-7c2de54c28df admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fae6a60277247e4a474316aa84c0f21)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:41.759243 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d267d-1cd9-46a7-aa5f-7c2de54c28df admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:41.801466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a50d267d-1cd9-46a7-aa5f-7c2de54c28df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fae6a60277247e4a474316aa84c0f21'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.808027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a50d267d-1cd9-46a7-aa5f-7c2de54c28df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fae6a60277247e4a474316aa84c0f21'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.817576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a50d267d-1cd9-46a7-aa5f-7c2de54c28df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fae6a60277247e4a474316aa84c0f21'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.818838 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a50d267d-1cd9-46a7-aa5f-7c2de54c28df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fae6a60277247e4a474316aa84c0f21'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.819492 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-a50d267d-1cd9-46a7-aa5f-7c2de54c28df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fae6a60277247e4a474316aa84c0f21'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:41.836940 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1347/2713] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:55:41 2022] DELETE /identity/v3/users/0fae6a60277247e4a474316aa84c0f21 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:42.094203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:42.095823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:42.110565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bd53d-96f1-46a8-a707-bba264e8b6d1 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:42.164701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e9375-b300-4475-8272-3de9e6266f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:42.165560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e9375-b300-4475-8272-3de9e6266f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.165841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e9375-b300-4475-8272-3de9e6266f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.166117 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e9375-b300-4475-8272-3de9e6266f5b admin admin] PATH_INFO: `/v3/projects/e1ea50dbac3b485eabcbc73c46b629a5` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.167297 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e9375-b300-4475-8272-3de9e6266f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ea50dbac3b485eabcbc73c46b629a5)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:42.169162 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e9375-b300-4475-8272-3de9e6266f5b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:42.213204 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bd9e9375-b300-4475-8272-3de9e6266f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ea50dbac3b485eabcbc73c46b629a5', 'request_id': 'req-bd9e9375-b300-4475-8272-3de9e6266f5b'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:42.218989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bd9e9375-b300-4475-8272-3de9e6266f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ea50dbac3b485eabcbc73c46b629a5', 'request_id': 'req-bd9e9375-b300-4475-8272-3de9e6266f5b'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:42.227033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bd9e9375-b300-4475-8272-3de9e6266f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ea50dbac3b485eabcbc73c46b629a5', 'request_id': 'req-bd9e9375-b300-4475-8272-3de9e6266f5b'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:42.236944 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bd9e9375-b300-4475-8272-3de9e6266f5b admin admin] The token cache is being invalidate because project e1ea50dbac3b485eabcbc73c46b629a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:55:42.237214 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bd9e9375-b300-4475-8272-3de9e6266f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:42.237834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-bd9e9375-b300-4475-8272-3de9e6266f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:42.239360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1367/2714] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:55:42 2022] DELETE /identity/v3/projects/e1ea50dbac3b485eabcbc73c46b629a5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:42.244228 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba406c-c3a6-4750-9bbe-3ef34e18e947 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.244519 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba406c-c3a6-4750-9bbe-3ef34e18e947 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.244793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba406c-c3a6-4750-9bbe-3ef34e18e947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.262737 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-a9ba406c-c3a6-4750-9bbe-3ef34e18e947 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:42.263973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a9ba406c-c3a6-4750-9bbe-3ef34e18e947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:42.321779 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1348/2715] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:42.329403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ade99b-521b-489c-937f-495e11e098a2 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.330238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ade99b-521b-489c-937f-495e11e098a2 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.330514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ade99b-521b-489c-937f-495e11e098a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.348512 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-53ade99b-521b-489c-937f-495e11e098a2 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:42.349678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-53ade99b-521b-489c-937f-495e11e098a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:42.357327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1368/2716] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:42.361458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba406c-c3a6-4750-9bbe-3ef34e18e947 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:42.370812 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba406c-c3a6-4750-9bbe-3ef34e18e947 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:42.375342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4e316-5234-4878-bc25-612499f1e762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:42.375985 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4e316-5234-4878-bc25-612499f1e762 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.376266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4e316-5234-4878-bc25-612499f1e762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.377048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4e316-5234-4878-bc25-612499f1e762 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.377762 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4e316-5234-4878-bc25-612499f1e762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:55:42.378068 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4e316-5234-4878-bc25-612499f1e762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:42.379669 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4e316-5234-4878-bc25-612499f1e762 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:42.395001 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1349/2717] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:55:42.396096 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ade99b-521b-489c-937f-495e11e098a2 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:42.405066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ade99b-521b-489c-937f-495e11e098a2 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:42.409612 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4999e-46a5-461c-a39d-ee6f85ed864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:42.410256 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4999e-46a5-461c-a39d-ee6f85ed864a admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.410540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4999e-46a5-461c-a39d-ee6f85ed864a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.410814 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4999e-46a5-461c-a39d-ee6f85ed864a admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.411533 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4999e-46a5-461c-a39d-ee6f85ed864a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:42.413440 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4999e-46a5-461c-a39d-ee6f85ed864a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:42.441704 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1369/2718] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:55:42 2022] POST /identity/v3/projects => generated 365 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:55:42.442925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4e316-5234-4878-bc25-612499f1e762 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:42.452620 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4e316-5234-4878-bc25-612499f1e762 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:42.507485 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0685c69-cd77-40e8-b8af-4361c662ff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:42.508154 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685c69-cd77-40e8-b8af-4361c662ff84 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.508433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685c69-cd77-40e8-b8af-4361c662ff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.508706 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0685c69-cd77-40e8-b8af-4361c662ff84 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.509383 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0685c69-cd77-40e8-b8af-4361c662ff84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:42.511317 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0685c69-cd77-40e8-b8af-4361c662ff84 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:42.532259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1350/2719] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:55:42 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:42.536337 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4999e-46a5-461c-a39d-ee6f85ed864a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:42.546497 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4999e-46a5-461c-a39d-ee6f85ed864a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:42.551577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1b7be-e280-400f-9a9c-a7495f9a8996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:42.552254 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1b7be-e280-400f-9a9c-a7495f9a8996 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.552532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1b7be-e280-400f-9a9c-a7495f9a8996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.552831 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1b7be-e280-400f-9a9c-a7495f9a8996 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.553562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1b7be-e280-400f-9a9c-a7495f9a8996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:42.555120 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1b7be-e280-400f-9a9c-a7495f9a8996 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:42.565911 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1370/2720] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:55:42.569942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0685c69-cd77-40e8-b8af-4361c662ff84 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:42.579653 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0685c69-cd77-40e8-b8af-4361c662ff84 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:42.584112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22d0c7-e04f-4a05-92d2-ec96c69f872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:42.584751 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22d0c7-e04f-4a05-92d2-ec96c69f872e admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.585029 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22d0c7-e04f-4a05-92d2-ec96c69f872e admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.585302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22d0c7-e04f-4a05-92d2-ec96c69f872e admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.586016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22d0c7-e04f-4a05-92d2-ec96c69f872e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:42.587694 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22d0c7-e04f-4a05-92d2-ec96c69f872e admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:42.597290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1351/2721] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:42.600958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1b7be-e280-400f-9a9c-a7495f9a8996 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:42.610359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1b7be-e280-400f-9a9c-a7495f9a8996 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:42.615324 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c289e-d491-4ba6-93c3-c75a6e8c2e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:42.616176 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c289e-d491-4ba6-93c3-c75a6e8c2e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.616450 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c289e-d491-4ba6-93c3-c75a6e8c2e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.616719 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c289e-d491-4ba6-93c3-c75a6e8c2e25 admin admin] PATH_INFO: `/v3/projects/15fc6b6d38d84ed19047c5b87d9312e2/users/e85392ebfafa4327840401d16fe5b664/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.631367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c289e-d491-4ba6-93c3-c75a6e8c2e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15fc6b6d38d84ed19047c5b87d9312e2, user_id=e85392ebfafa4327840401d16fe5b664, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:42.633985 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c289e-d491-4ba6-93c3-c75a6e8c2e25 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:42.646623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1371/2722] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:42 2022] PUT /identity/v3/projects/15fc6b6d38d84ed19047c5b87d9312e2/users/e85392ebfafa4327840401d16fe5b664/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:55:42.657390 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d5c8a-ab3a-4dfa-add3-bccbbf812237 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.657717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d5c8a-ab3a-4dfa-add3-bccbbf812237 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.658016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d5c8a-ab3a-4dfa-add3-bccbbf812237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.684067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-9e4d5c8a-ab3a-4dfa-add3-bccbbf812237 None None] MFA Rules not processed for user `e85392ebfafa4327840401d16fe5b664`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:42.685242 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-9e4d5c8a-ab3a-4dfa-add3-bccbbf812237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:42.745805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1352/2723] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:42.750184 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c289e-d491-4ba6-93c3-c75a6e8c2e25 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:42.809135 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c289e-d491-4ba6-93c3-c75a6e8c2e25 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:42.814603 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50029354-aa92-4850-8c89-53a4771a69d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:42.815305 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50029354-aa92-4850-8c89-53a4771a69d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.815588 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50029354-aa92-4850-8c89-53a4771a69d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.815864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50029354-aa92-4850-8c89-53a4771a69d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.816802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50029354-aa92-4850-8c89-53a4771a69d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:42.818683 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50029354-aa92-4850-8c89-53a4771a69d5 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:42.842839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1372/2724] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:55:42 2022] POST /identity/v3/projects => generated 361 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:55:42.846847 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d5c8a-ab3a-4dfa-add3-bccbbf812237 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:42.857260 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d5c8a-ab3a-4dfa-add3-bccbbf812237 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:42.910016 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b82fe-8d72-4e49-8550-201dcd2fde6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:42.910674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b82fe-8d72-4e49-8550-201dcd2fde6f admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.910956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b82fe-8d72-4e49-8550-201dcd2fde6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.911254 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b82fe-8d72-4e49-8550-201dcd2fde6f admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.911932 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b82fe-8d72-4e49-8550-201dcd2fde6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:42.913838 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b82fe-8d72-4e49-8550-201dcd2fde6f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:42.933129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1353/2725] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:55:42 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:42.936943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50029354-aa92-4850-8c89-53a4771a69d5 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:42.947711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50029354-aa92-4850-8c89-53a4771a69d5 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:42.952418 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c811e-13d7-41bb-b50f-a2b984fb788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:42.953073 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c811e-13d7-41bb-b50f-a2b984fb788e admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.953356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c811e-13d7-41bb-b50f-a2b984fb788e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.953633 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c811e-13d7-41bb-b50f-a2b984fb788e admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:42.954356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c811e-13d7-41bb-b50f-a2b984fb788e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:42.956020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c811e-13d7-41bb-b50f-a2b984fb788e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:42.966274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1373/2726] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:42.969996 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b82fe-8d72-4e49-8550-201dcd2fde6f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:42.981039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b82fe-8d72-4e49-8550-201dcd2fde6f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:42.985559 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacc3db-4cc3-4bbe-a69c-e8550c6e95c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:42.986991 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacc3db-4cc3-4bbe-a69c-e8550c6e95c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:42.987305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacc3db-4cc3-4bbe-a69c-e8550c6e95c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:42.987581 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacc3db-4cc3-4bbe-a69c-e8550c6e95c8 admin admin] PATH_INFO: `/v3/projects/ad9443beeb3d4ac489994e07c99eccda/users/4f01c1472c8146da804145e91853a375/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:43.001680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacc3db-4cc3-4bbe-a69c-e8550c6e95c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9443beeb3d4ac489994e07c99eccda, user_id=4f01c1472c8146da804145e91853a375, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:43.004305 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacc3db-4cc3-4bbe-a69c-e8550c6e95c8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:43.016613 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1354/2727] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:42 2022] PUT /identity/v3/projects/ad9443beeb3d4ac489994e07c99eccda/users/4f01c1472c8146da804145e91853a375/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:43.020462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c811e-13d7-41bb-b50f-a2b984fb788e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:43.030349 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c811e-13d7-41bb-b50f-a2b984fb788e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:43.085924 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b0b13-6adf-4412-930b-0ce30d76ded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:43.086574 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b0b13-6adf-4412-930b-0ce30d76ded3 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:43.086855 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b0b13-6adf-4412-930b-0ce30d76ded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:43.087127 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b0b13-6adf-4412-930b-0ce30d76ded3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:43.087870 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b0b13-6adf-4412-930b-0ce30d76ded3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:43.089454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b0b13-6adf-4412-930b-0ce30d76ded3 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:43.099230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1374/2728] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 13:55:43.103299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacc3db-4cc3-4bbe-a69c-e8550c6e95c8 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:43.113823 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacc3db-4cc3-4bbe-a69c-e8550c6e95c8 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:43.121721 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a9f9c-4770-44ea-ada9-d9a241a6a408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:43.122601 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9f9c-4770-44ea-ada9-d9a241a6a408 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:43.122882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9f9c-4770-44ea-ada9-d9a241a6a408 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:43.123155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a9f9c-4770-44ea-ada9-d9a241a6a408 admin admin] PATH_INFO: `/v3/projects/ad9443beeb3d4ac489994e07c99eccda/users/4f01c1472c8146da804145e91853a375/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:43.126809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a9f9c-4770-44ea-ada9-d9a241a6a408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9443beeb3d4ac489994e07c99eccda, user_id=4f01c1472c8146da804145e91853a375, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:43.127861 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a9f9c-4770-44ea-ada9-d9a241a6a408 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:43.142883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1355/2729] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:43 2022] PUT /identity/v3/projects/ad9443beeb3d4ac489994e07c99eccda/users/4f01c1472c8146da804145e91853a375/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:43.157346 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ad72-32a7-4497-9a7c-bcc4ddce1ec2 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:43.158240 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ad72-32a7-4497-9a7c-bcc4ddce1ec2 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:43.158516 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ad72-32a7-4497-9a7c-bcc4ddce1ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:43.184819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-6899ad72-32a7-4497-9a7c-bcc4ddce1ec2 None None] MFA Rules not processed for user `4f01c1472c8146da804145e91853a375`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:43.186024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6899ad72-32a7-4497-9a7c-bcc4ddce1ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:43.252390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1375/2730] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:43 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:43.263276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a9f9c-4770-44ea-ada9-d9a241a6a408 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:43.264925 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4a9a9f9c-4770-44ea-ada9-d9a241a6a408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:43.320654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a9f9c-4770-44ea-ada9-d9a241a6a408 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:43.324314 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea84a7f-3f45-4510-98fc-9705d8c2e7b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:43.324956 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea84a7f-3f45-4510-98fc-9705d8c2e7b8 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:43.325244 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea84a7f-3f45-4510-98fc-9705d8c2e7b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:43.325626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea84a7f-3f45-4510-98fc-9705d8c2e7b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:43.334875 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea84a7f-3f45-4510-98fc-9705d8c2e7b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:43.336341 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea84a7f-3f45-4510-98fc-9705d8c2e7b8 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:43.346048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1356/2731] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:43 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:43.414986 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ad72-32a7-4497-9a7c-bcc4ddce1ec2 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:43.424470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ad72-32a7-4497-9a7c-bcc4ddce1ec2 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:43.428046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f9faf-89f3-47f6-9fae-33004de48013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:43.428675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f9faf-89f3-47f6-9fae-33004de48013 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:43.428957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f9faf-89f3-47f6-9fae-33004de48013 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:43.429230 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f9faf-89f3-47f6-9fae-33004de48013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:43.494233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f9faf-89f3-47f6-9fae-33004de48013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:43.495729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f9faf-89f3-47f6-9fae-33004de48013 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:43.506361 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1376/2732] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:52.560395 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea84a7f-3f45-4510-98fc-9705d8c2e7b8 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:52.623198 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea84a7f-3f45-4510-98fc-9705d8c2e7b8 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:52.628176 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:52.629040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:52.629348 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:52.629618 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] PATH_INFO: `/v3/users/e85392ebfafa4327840401d16fe5b664` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:52.630788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85392ebfafa4327840401d16fe5b664)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:52.632709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:52.679172 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85392ebfafa4327840401d16fe5b664'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:52.686639 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85392ebfafa4327840401d16fe5b664'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:52.694408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85392ebfafa4327840401d16fe5b664'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:52.695054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85392ebfafa4327840401d16fe5b664'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:52.695695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85392ebfafa4327840401d16fe5b664'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:52.712727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1357/2733] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:55:52 2022] DELETE /identity/v3/users/e85392ebfafa4327840401d16fe5b664 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:55:52.717129 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53476-2ca8-4dee-b037-c1401a6c7b76 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:52.717626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53476-2ca8-4dee-b037-c1401a6c7b76 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:52.717803 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53476-2ca8-4dee-b037-c1401a6c7b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:52.734910 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-66a53476-2ca8-4dee-b037-c1401a6c7b76 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:52.736690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-66a53476-2ca8-4dee-b037-c1401a6c7b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:52.792987 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1377/2734] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:52.802920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:52.804346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:52.867259 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf70b4-43d5-4b4d-972e-5c0bbc6078e2 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:52.870843 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ba500-0c4b-467f-85b0-cbf504354744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:52.871651 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ba500-0c4b-467f-85b0-cbf504354744 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:52.871961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ba500-0c4b-467f-85b0-cbf504354744 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:52.872359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ba500-0c4b-467f-85b0-cbf504354744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:52.882244 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ba500-0c4b-467f-85b0-cbf504354744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:52.883764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ba500-0c4b-467f-85b0-cbf504354744 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:52.893768 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1358/2735] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:53.154987 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a53476-2ca8-4dee-b037-c1401a6c7b76 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:53.156290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-66a53476-2ca8-4dee-b037-c1401a6c7b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:53.168556 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a53476-2ca8-4dee-b037-c1401a6c7b76 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:53.174529 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:53.175500 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:53.175844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:53.176301 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] PATH_INFO: `/v3/projects/15fc6b6d38d84ed19047c5b87d9312e2` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:53.177591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15fc6b6d38d84ed19047c5b87d9312e2)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:53.179595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:53.226123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15fc6b6d38d84ed19047c5b87d9312e2', 'request_id': 'req-d8a53c67-1145-465e-985a-d8ff36cc126a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.232273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15fc6b6d38d84ed19047c5b87d9312e2', 'request_id': 'req-d8a53c67-1145-465e-985a-d8ff36cc126a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.240453 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15fc6b6d38d84ed19047c5b87d9312e2', 'request_id': 'req-d8a53c67-1145-465e-985a-d8ff36cc126a'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.250700 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] The token cache is being invalidate because project 15fc6b6d38d84ed19047c5b87d9312e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:55:53.251274 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.252480 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.254106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1378/2736] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:55:53 2022] DELETE /identity/v3/projects/15fc6b6d38d84ed19047c5b87d9312e2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:53.258105 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ba500-0c4b-467f-85b0-cbf504354744 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:53.268083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ba500-0c4b-467f-85b0-cbf504354744 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:53.327564 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8b8a7-78c5-428d-b4ae-2e72c419172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:53.328434 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8b8a7-78c5-428d-b4ae-2e72c419172a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:53.328740 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8b8a7-78c5-428d-b4ae-2e72c419172a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:53.329014 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8b8a7-78c5-428d-b4ae-2e72c419172a admin admin] PATH_INFO: `/v3/users/4f01c1472c8146da804145e91853a375` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:53.330194 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8b8a7-78c5-428d-b4ae-2e72c419172a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f01c1472c8146da804145e91853a375)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:53.332222 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8b8a7-78c5-428d-b4ae-2e72c419172a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:53.377773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-72e8b8a7-78c5-428d-b4ae-2e72c419172a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f01c1472c8146da804145e91853a375'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.384814 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-72e8b8a7-78c5-428d-b4ae-2e72c419172a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f01c1472c8146da804145e91853a375'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.391412 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-72e8b8a7-78c5-428d-b4ae-2e72c419172a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f01c1472c8146da804145e91853a375'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.392037 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-72e8b8a7-78c5-428d-b4ae-2e72c419172a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f01c1472c8146da804145e91853a375'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.392669 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-72e8b8a7-78c5-428d-b4ae-2e72c419172a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f01c1472c8146da804145e91853a375'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.408931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1359/2737] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:55:53 2022] DELETE /identity/v3/users/4f01c1472c8146da804145e91853a375 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:53.674424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:53.676250 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:53.690146 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a53c67-1145-465e-985a-d8ff36cc126a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:53.772726 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a7936-23e6-4c4a-a8cd-2659c4fc2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:53.773696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a7936-23e6-4c4a-a8cd-2659c4fc2637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:53.773871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a7936-23e6-4c4a-a8cd-2659c4fc2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:53.774187 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a7936-23e6-4c4a-a8cd-2659c4fc2637 admin admin] PATH_INFO: `/v3/projects/ad9443beeb3d4ac489994e07c99eccda` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:53.775447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a7936-23e6-4c4a-a8cd-2659c4fc2637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9443beeb3d4ac489994e07c99eccda)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:53.777525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a7936-23e6-4c4a-a8cd-2659c4fc2637 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:53.860238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-043a7936-23e6-4c4a-a8cd-2659c4fc2637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9443beeb3d4ac489994e07c99eccda', 'request_id': 'req-043a7936-23e6-4c4a-a8cd-2659c4fc2637'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.867498 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-043a7936-23e6-4c4a-a8cd-2659c4fc2637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9443beeb3d4ac489994e07c99eccda', 'request_id': 'req-043a7936-23e6-4c4a-a8cd-2659c4fc2637'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.877778 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-043a7936-23e6-4c4a-a8cd-2659c4fc2637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9443beeb3d4ac489994e07c99eccda', 'request_id': 'req-043a7936-23e6-4c4a-a8cd-2659c4fc2637'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.889701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-043a7936-23e6-4c4a-a8cd-2659c4fc2637 admin admin] The token cache is being invalidate because project ad9443beeb3d4ac489994e07c99eccda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:55:53.890056 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-043a7936-23e6-4c4a-a8cd-2659c4fc2637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.890715 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-043a7936-23e6-4c4a-a8cd-2659c4fc2637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:55:53.892885 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1379/2738] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:55:53 2022] DELETE /identity/v3/projects/ad9443beeb3d4ac489994e07c99eccda => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:53.898009 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de1f95-30d8-4a88-a29b-775a1426a167 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:53.898489 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de1f95-30d8-4a88-a29b-775a1426a167 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:53.898751 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de1f95-30d8-4a88-a29b-775a1426a167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:53.918954 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-c0de1f95-30d8-4a88-a29b-775a1426a167 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:53.920730 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-c0de1f95-30d8-4a88-a29b-775a1426a167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:53.984615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1360/2739] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:53.993739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822bbe3-4b3b-4edd-ad25-64c99e4febd7 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:53.994036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822bbe3-4b3b-4edd-ad25-64c99e4febd7 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:53.994318 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822bbe3-4b3b-4edd-ad25-64c99e4febd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.012944 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b822bbe3-4b3b-4edd-ad25-64c99e4febd7 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:54.014127 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b822bbe3-4b3b-4edd-ad25-64c99e4febd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:54.022447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1380/2740] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 13:55:54.026645 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de1f95-30d8-4a88-a29b-775a1426a167 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.036674 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de1f95-30d8-4a88-a29b-775a1426a167 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.041163 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81d76e-3480-49b4-8c91-3962d6f30b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.041806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81d76e-3480-49b4-8c91-3962d6f30b40 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.042086 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81d76e-3480-49b4-8c91-3962d6f30b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.042362 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81d76e-3480-49b4-8c91-3962d6f30b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.043076 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81d76e-3480-49b4-8c91-3962d6f30b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:55:54.043429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81d76e-3480-49b4-8c91-3962d6f30b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.045011 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81d76e-3480-49b4-8c91-3962d6f30b40 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.056073 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1361/2741] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:55:54.060169 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822bbe3-4b3b-4edd-ad25-64c99e4febd7 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.069506 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822bbe3-4b3b-4edd-ad25-64c99e4febd7 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.073999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc7f4-8350-490d-ac67-4ad71bd4698e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.074629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc7f4-8350-490d-ac67-4ad71bd4698e admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.074908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc7f4-8350-490d-ac67-4ad71bd4698e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.075184 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc7f4-8350-490d-ac67-4ad71bd4698e admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.075963 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bc7f4-8350-490d-ac67-4ad71bd4698e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.077818 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bc7f4-8350-490d-ac67-4ad71bd4698e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.103542 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1381/2742] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:55:54 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:54.107495 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81d76e-3480-49b4-8c91-3962d6f30b40 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.117076 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81d76e-3480-49b4-8c91-3962d6f30b40 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.172942 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7d3a8-9383-4738-a76a-5bea2c05a1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.173663 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7d3a8-9383-4738-a76a-5bea2c05a1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.173945 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7d3a8-9383-4738-a76a-5bea2c05a1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.174220 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7d3a8-9383-4738-a76a-5bea2c05a1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.174908 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7d3a8-9383-4738-a76a-5bea2c05a1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.176855 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7d3a8-9383-4738-a76a-5bea2c05a1a0 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.195913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1362/2743] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:55:54 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:54.199956 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc7f4-8350-490d-ac67-4ad71bd4698e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.210576 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc7f4-8350-490d-ac67-4ad71bd4698e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.215133 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66098e31-10e7-4b8f-8373-20b662405fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.215823 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66098e31-10e7-4b8f-8373-20b662405fbe admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.216105 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66098e31-10e7-4b8f-8373-20b662405fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.216378 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66098e31-10e7-4b8f-8373-20b662405fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.217099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66098e31-10e7-4b8f-8373-20b662405fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.218723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66098e31-10e7-4b8f-8373-20b662405fbe admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.228707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1382/2744] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:54.232291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7d3a8-9383-4738-a76a-5bea2c05a1a0 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.241948 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7d3a8-9383-4738-a76a-5bea2c05a1a0 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.246681 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c90eab-d0ed-470f-be8f-15830fff0be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.247360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c90eab-d0ed-470f-be8f-15830fff0be4 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.247641 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c90eab-d0ed-470f-be8f-15830fff0be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.247912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c90eab-d0ed-470f-be8f-15830fff0be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.248625 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c90eab-d0ed-470f-be8f-15830fff0be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.250346 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c90eab-d0ed-470f-be8f-15830fff0be4 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.261101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1363/2745] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:54.265269 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66098e31-10e7-4b8f-8373-20b662405fbe admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.275489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66098e31-10e7-4b8f-8373-20b662405fbe admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.280050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e662b-17b4-4a40-b22c-dd5106169aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.280908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e662b-17b4-4a40-b22c-dd5106169aea admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.281188 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e662b-17b4-4a40-b22c-dd5106169aea admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.281461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e662b-17b4-4a40-b22c-dd5106169aea admin admin] PATH_INFO: `/v3/projects/6e7dc25569924d6580dbcfa96646cc27/users/957e58da5d7a482f897c90e8c5065695/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.295539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e662b-17b4-4a40-b22c-dd5106169aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7dc25569924d6580dbcfa96646cc27, user_id=957e58da5d7a482f897c90e8c5065695, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.298166 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e662b-17b4-4a40-b22c-dd5106169aea admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.310671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1383/2746] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:54 2022] PUT /identity/v3/projects/6e7dc25569924d6580dbcfa96646cc27/users/957e58da5d7a482f897c90e8c5065695/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:54.321869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44d9ab-a71f-4e38-90c8-5aa8257e09dd None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.322167 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44d9ab-a71f-4e38-90c8-5aa8257e09dd None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.322448 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44d9ab-a71f-4e38-90c8-5aa8257e09dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.349366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-7b44d9ab-a71f-4e38-90c8-5aa8257e09dd None None] MFA Rules not processed for user `957e58da5d7a482f897c90e8c5065695`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:54.350968 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7b44d9ab-a71f-4e38-90c8-5aa8257e09dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:54.413862 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1364/2747] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:54.418181 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e662b-17b4-4a40-b22c-dd5106169aea admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.478283 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e662b-17b4-4a40-b22c-dd5106169aea admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.482989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ca818-9f8d-4838-a208-f0c026e75ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.483667 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca818-9f8d-4838-a208-f0c026e75ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.483948 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca818-9f8d-4838-a208-f0c026e75ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.484223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ca818-9f8d-4838-a208-f0c026e75ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.484908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ca818-9f8d-4838-a208-f0c026e75ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.486927 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ca818-9f8d-4838-a208-f0c026e75ae7 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.515731 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1384/2748] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:55:54 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:54.520132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44d9ab-a71f-4e38-90c8-5aa8257e09dd None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.530375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44d9ab-a71f-4e38-90c8-5aa8257e09dd None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.584186 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5476bbd-5041-435a-ad39-a8a1e608d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.584842 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5476bbd-5041-435a-ad39-a8a1e608d23c admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.585127 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5476bbd-5041-435a-ad39-a8a1e608d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.585402 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5476bbd-5041-435a-ad39-a8a1e608d23c admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.586090 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5476bbd-5041-435a-ad39-a8a1e608d23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.588025 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5476bbd-5041-435a-ad39-a8a1e608d23c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.607516 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1365/2749] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:55:54 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:54.612148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ca818-9f8d-4838-a208-f0c026e75ae7 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.622237 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ca818-9f8d-4838-a208-f0c026e75ae7 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.627462 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc29e2-5b1a-42b6-82ca-0e9822bd5f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.628113 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc29e2-5b1a-42b6-82ca-0e9822bd5f30 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.628390 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc29e2-5b1a-42b6-82ca-0e9822bd5f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.628660 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc29e2-5b1a-42b6-82ca-0e9822bd5f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.629383 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc29e2-5b1a-42b6-82ca-0e9822bd5f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.630944 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc29e2-5b1a-42b6-82ca-0e9822bd5f30 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.641173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1385/2750] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:54.644899 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5476bbd-5041-435a-ad39-a8a1e608d23c admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.655027 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5476bbd-5041-435a-ad39-a8a1e608d23c admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.659612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dd83e-cf7a-42cf-bf60-f964f74261ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.660393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dd83e-cf7a-42cf-bf60-f964f74261ef admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.660683 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dd83e-cf7a-42cf-bf60-f964f74261ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.660960 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dd83e-cf7a-42cf-bf60-f964f74261ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.661678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dd83e-cf7a-42cf-bf60-f964f74261ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.663290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dd83e-cf7a-42cf-bf60-f964f74261ef admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.672944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1366/2751] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:54.677340 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc29e2-5b1a-42b6-82ca-0e9822bd5f30 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.687008 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc29e2-5b1a-42b6-82ca-0e9822bd5f30 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.692519 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbfc10-6191-46f1-8ab2-fd8ab965d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.693379 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbfc10-6191-46f1-8ab2-fd8ab965d595 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.693661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbfc10-6191-46f1-8ab2-fd8ab965d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.693934 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbfc10-6191-46f1-8ab2-fd8ab965d595 admin admin] PATH_INFO: `/v3/projects/fcde38f537ad45b9a87a7fa6946655e4/users/b00b9bc90ec4495d83c9682ed5ac7c78/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.707820 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbfc10-6191-46f1-8ab2-fd8ab965d595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcde38f537ad45b9a87a7fa6946655e4, user_id=b00b9bc90ec4495d83c9682ed5ac7c78, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.710423 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbfc10-6191-46f1-8ab2-fd8ab965d595 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.722539 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1386/2752] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:54 2022] PUT /identity/v3/projects/fcde38f537ad45b9a87a7fa6946655e4/users/b00b9bc90ec4495d83c9682ed5ac7c78/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:54.732736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fcbf4-63e1-462e-86d1-57defb0e3de6 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.733028 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fcbf4-63e1-462e-86d1-57defb0e3de6 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.733526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fcbf4-63e1-462e-86d1-57defb0e3de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.759993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-ed3fcbf4-63e1-462e-86d1-57defb0e3de6 None None] MFA Rules not processed for user `b00b9bc90ec4495d83c9682ed5ac7c78`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:54.761165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-ed3fcbf4-63e1-462e-86d1-57defb0e3de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:54.822524 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1367/2753] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:54.826998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbfc10-6191-46f1-8ab2-fd8ab965d595 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.888750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbfc10-6191-46f1-8ab2-fd8ab965d595 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.894162 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82663b84-fce0-4c67-8ba2-939a97d825cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.894819 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82663b84-fce0-4c67-8ba2-939a97d825cc admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.895101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82663b84-fce0-4c67-8ba2-939a97d825cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.895415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82663b84-fce0-4c67-8ba2-939a97d825cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.896101 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82663b84-fce0-4c67-8ba2-939a97d825cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.897989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82663b84-fce0-4c67-8ba2-939a97d825cc admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:54.922766 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1387/2754] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:55:54 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:54.926949 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fcbf4-63e1-462e-86d1-57defb0e3de6 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:54.937806 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fcbf4-63e1-462e-86d1-57defb0e3de6 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:54.993795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf806ebc-6c34-44ff-8e1d-f222b9978358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:54.994487 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf806ebc-6c34-44ff-8e1d-f222b9978358 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:54.994770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf806ebc-6c34-44ff-8e1d-f222b9978358 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:54.995045 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf806ebc-6c34-44ff-8e1d-f222b9978358 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:54.995770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf806ebc-6c34-44ff-8e1d-f222b9978358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:54.997680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf806ebc-6c34-44ff-8e1d-f222b9978358 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:55.019845 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1368/2755] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:55:54 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:55:55.023853 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82663b84-fce0-4c67-8ba2-939a97d825cc admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:55.033907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82663b84-fce0-4c67-8ba2-939a97d825cc admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:55.039534 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e24e2-dd21-444a-99ef-e7eefa25d704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:55.040199 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e24e2-dd21-444a-99ef-e7eefa25d704 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:55.040485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e24e2-dd21-444a-99ef-e7eefa25d704 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:55.040887 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e24e2-dd21-444a-99ef-e7eefa25d704 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:55.041752 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e24e2-dd21-444a-99ef-e7eefa25d704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:55.043368 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e24e2-dd21-444a-99ef-e7eefa25d704 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:55.054424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1388/2756] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:55.058646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf806ebc-6c34-44ff-8e1d-f222b9978358 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:55.069504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf806ebc-6c34-44ff-8e1d-f222b9978358 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:55.074178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf3c2c-7daf-4468-a0df-a81a112696b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:55.075141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf3c2c-7daf-4468-a0df-a81a112696b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:55.075456 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf3c2c-7daf-4468-a0df-a81a112696b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:55.075735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf3c2c-7daf-4468-a0df-a81a112696b1 admin admin] PATH_INFO: `/v3/projects/25233cdc32854bea8bea6288d7d3a65f/users/0a0ea68915f640aabec74c1fc9c5ec54/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:55.091808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf3c2c-7daf-4468-a0df-a81a112696b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25233cdc32854bea8bea6288d7d3a65f, user_id=0a0ea68915f640aabec74c1fc9c5ec54, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:55.094680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf3c2c-7daf-4468-a0df-a81a112696b1 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:55.106423 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1369/2757] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:55 2022] PUT /identity/v3/projects/25233cdc32854bea8bea6288d7d3a65f/users/0a0ea68915f640aabec74c1fc9c5ec54/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:55:55.110444 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e24e2-dd21-444a-99ef-e7eefa25d704 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:55.120363 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e24e2-dd21-444a-99ef-e7eefa25d704 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:55.182074 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f60f7-3346-4d33-9990-c00f084ef054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:55.182688 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f60f7-3346-4d33-9990-c00f084ef054 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:55.182969 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f60f7-3346-4d33-9990-c00f084ef054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:55.183261 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f60f7-3346-4d33-9990-c00f084ef054 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:55.183991 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f60f7-3346-4d33-9990-c00f084ef054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:55.185538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f60f7-3346-4d33-9990-c00f084ef054 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:55.199315 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1389/2758] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:55:55.203543 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf3c2c-7daf-4468-a0df-a81a112696b1 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:55.214314 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf3c2c-7daf-4468-a0df-a81a112696b1 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:55.218959 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90184863-8dd2-40d0-8d6f-cbcc15f09e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:55.219859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90184863-8dd2-40d0-8d6f-cbcc15f09e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:55.220138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90184863-8dd2-40d0-8d6f-cbcc15f09e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:55.220407 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90184863-8dd2-40d0-8d6f-cbcc15f09e21 admin admin] PATH_INFO: `/v3/projects/25233cdc32854bea8bea6288d7d3a65f/users/0a0ea68915f640aabec74c1fc9c5ec54/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:55.222332 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90184863-8dd2-40d0-8d6f-cbcc15f09e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25233cdc32854bea8bea6288d7d3a65f, user_id=0a0ea68915f640aabec74c1fc9c5ec54, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:55.224961 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90184863-8dd2-40d0-8d6f-cbcc15f09e21 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:55.235143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1370/2759] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:55:55 2022] PUT /identity/v3/projects/25233cdc32854bea8bea6288d7d3a65f/users/0a0ea68915f640aabec74c1fc9c5ec54/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:55:55.246036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3b715-f7ca-4352-8652-181d6b6eadcb None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:55.246325 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3b715-f7ca-4352-8652-181d6b6eadcb None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:55.246600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3b715-f7ca-4352-8652-181d6b6eadcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:55.273589 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-9ba3b715-f7ca-4352-8652-181d6b6eadcb None None] MFA Rules not processed for user `0a0ea68915f640aabec74c1fc9c5ec54`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:55:55.274793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-9ba3b715-f7ca-4352-8652-181d6b6eadcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:55.343367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1390/2760] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:55:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:55:55.354262 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90184863-8dd2-40d0-8d6f-cbcc15f09e21 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:55.355967 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-90184863-8dd2-40d0-8d6f-cbcc15f09e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:55:55.414024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90184863-8dd2-40d0-8d6f-cbcc15f09e21 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:55.417584 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d665a3-aec8-4e28-adfb-d7e8168fce49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:55.418210 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d665a3-aec8-4e28-adfb-d7e8168fce49 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:55.418489 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d665a3-aec8-4e28-adfb-d7e8168fce49 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:55.418763 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d665a3-aec8-4e28-adfb-d7e8168fce49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:55.427988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d665a3-aec8-4e28-adfb-d7e8168fce49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:55.429411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d665a3-aec8-4e28-adfb-d7e8168fce49 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:55.438450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1371/2761] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:55.906707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3b715-f7ca-4352-8652-181d6b6eadcb None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:55.916555 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3b715-f7ca-4352-8652-181d6b6eadcb None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:55.920036 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d7f8b-f6f5-4e49-b030-a67d721f354d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:55.920669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d7f8b-f6f5-4e49-b030-a67d721f354d service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:55.920947 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d7f8b-f6f5-4e49-b030-a67d721f354d service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:55.921224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d7f8b-f6f5-4e49-b030-a67d721f354d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:55.975050 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d7f8b-f6f5-4e49-b030-a67d721f354d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:55.976493 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d7f8b-f6f5-4e49-b030-a67d721f354d service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:55.985015 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1391/2762] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:55:59.918762 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d665a3-aec8-4e28-adfb-d7e8168fce49 service cinder] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:55:59.927266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d665a3-aec8-4e28-adfb-d7e8168fce49 service cinder] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:55:59.930887 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72320d65-b84a-45ae-9e25-4d2ef9dac21f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:55:59.931572 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72320d65-b84a-45ae-9e25-4d2ef9dac21f service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:55:59.931858 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72320d65-b84a-45ae-9e25-4d2ef9dac21f service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:55:59.932137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72320d65-b84a-45ae-9e25-4d2ef9dac21f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:55:59.986945 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72320d65-b84a-45ae-9e25-4d2ef9dac21f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:55:59.988337 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72320d65-b84a-45ae-9e25-4d2ef9dac21f service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:55:59.997251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1372/2763] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:55:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:02.003191 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d7f8b-f6f5-4e49-b030-a67d721f354d service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:02.064554 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d7f8b-f6f5-4e49-b030-a67d721f354d service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:02.069320 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:02.070181 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:02.070464 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:02.070739 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] PATH_INFO: `/v3/users/957e58da5d7a482f897c90e8c5065695` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:02.071974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=957e58da5d7a482f897c90e8c5065695)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:02.073866 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:02.118413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957e58da5d7a482f897c90e8c5065695'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:02.125554 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957e58da5d7a482f897c90e8c5065695'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:02.126164 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957e58da5d7a482f897c90e8c5065695'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:02.133385 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957e58da5d7a482f897c90e8c5065695'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:02.144642 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957e58da5d7a482f897c90e8c5065695'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:02.150364 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1392/2764] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:56:02 2022] DELETE /identity/v3/users/957e58da5d7a482f897c90e8c5065695 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:56:02.155189 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac07865-a604-431f-8272-2f68207025d8 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:02.155707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac07865-a604-431f-8272-2f68207025d8 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:02.155828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac07865-a604-431f-8272-2f68207025d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:02.172261 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-eac07865-a604-431f-8272-2f68207025d8 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:02.173950 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-eac07865-a604-431f-8272-2f68207025d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:02.230350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1373/2765] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:02.240502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:02.241909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:02.298982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d642cfd-109c-4e35-aca2-9e97ad18dfdf admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:02.302943 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c7712-c41e-46a7-9034-546fe136110c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:02.303629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c7712-c41e-46a7-9034-546fe136110c service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:02.303911 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c7712-c41e-46a7-9034-546fe136110c service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:02.304182 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c7712-c41e-46a7-9034-546fe136110c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:02.314840 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c7712-c41e-46a7-9034-546fe136110c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:02.317428 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c7712-c41e-46a7-9034-546fe136110c service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:02.327163 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1393/2766] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:02.841334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac07865-a604-431f-8272-2f68207025d8 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:02.842759 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-eac07865-a604-431f-8272-2f68207025d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:02.863333 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac07865-a604-431f-8272-2f68207025d8 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:02.870890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:02.872504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:02.872504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:02.872504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] PATH_INFO: `/v3/projects/6e7dc25569924d6580dbcfa96646cc27` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:02.874095 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7dc25569924d6580dbcfa96646cc27)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:02.878590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:02.927787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7dc25569924d6580dbcfa96646cc27', 'request_id': 'req-6a926c65-df91-4701-ad9b-5fb007dc43ec'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:02.934138 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7dc25569924d6580dbcfa96646cc27', 'request_id': 'req-6a926c65-df91-4701-ad9b-5fb007dc43ec'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:02.941916 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7dc25569924d6580dbcfa96646cc27', 'request_id': 'req-6a926c65-df91-4701-ad9b-5fb007dc43ec'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:02.951785 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] The token cache is being invalidate because project 6e7dc25569924d6580dbcfa96646cc27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:56:02.952101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:02.952728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:02.957689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1374/2767] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:56:02 2022] DELETE /identity/v3/projects/6e7dc25569924d6580dbcfa96646cc27 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:56:02.959046 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c7712-c41e-46a7-9034-546fe136110c service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:02.968424 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c7712-c41e-46a7-9034-546fe136110c service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:03.025193 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:03.026019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:03.026322 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:03.026618 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] PATH_INFO: `/v3/users/b00b9bc90ec4495d83c9682ed5ac7c78` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:03.027850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00b9bc90ec4495d83c9682ed5ac7c78)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:03.029754 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:03.076762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00b9bc90ec4495d83c9682ed5ac7c78'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.085909 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00b9bc90ec4495d83c9682ed5ac7c78'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.086540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00b9bc90ec4495d83c9682ed5ac7c78'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.093724 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00b9bc90ec4495d83c9682ed5ac7c78'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.105651 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00b9bc90ec4495d83c9682ed5ac7c78'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.111534 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1394/2768] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:56:02 2022] DELETE /identity/v3/users/b00b9bc90ec4495d83c9682ed5ac7c78 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:56:03.374659 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:03.376208 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:03.389619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a926c65-df91-4701-ad9b-5fb007dc43ec admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:03.448251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:03.449099 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:03.449379 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:03.449652 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] PATH_INFO: `/v3/projects/fcde38f537ad45b9a87a7fa6946655e4` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:03.450799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcde38f537ad45b9a87a7fa6946655e4)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:03.452717 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:03.495523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcde38f537ad45b9a87a7fa6946655e4', 'request_id': 'req-62608d96-e4d6-4a56-9ea1-88e27fe1698f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.501244 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcde38f537ad45b9a87a7fa6946655e4', 'request_id': 'req-62608d96-e4d6-4a56-9ea1-88e27fe1698f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.508658 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcde38f537ad45b9a87a7fa6946655e4', 'request_id': 'req-62608d96-e4d6-4a56-9ea1-88e27fe1698f'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.518827 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] The token cache is being invalidate because project fcde38f537ad45b9a87a7fa6946655e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:56:03.519112 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.519744 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.521248 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1375/2769] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:56:03 2022] DELETE /identity/v3/projects/fcde38f537ad45b9a87a7fa6946655e4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:56:03.525225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:03.526625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:03.538908 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97243a-9f89-4048-b11c-86a88f9b0ea3 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:03.592501 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af0a8c-7f54-44f1-b439-81251a00c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:03.593290 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af0a8c-7f54-44f1-b439-81251a00c501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:03.593570 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af0a8c-7f54-44f1-b439-81251a00c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:03.593839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af0a8c-7f54-44f1-b439-81251a00c501 admin admin] PATH_INFO: `/v3/users/0a0ea68915f640aabec74c1fc9c5ec54` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:03.595003 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af0a8c-7f54-44f1-b439-81251a00c501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0ea68915f640aabec74c1fc9c5ec54)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:03.596941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af0a8c-7f54-44f1-b439-81251a00c501 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:03.641560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f5af0a8c-7f54-44f1-b439-81251a00c501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0ea68915f640aabec74c1fc9c5ec54'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.647958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f5af0a8c-7f54-44f1-b439-81251a00c501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0ea68915f640aabec74c1fc9c5ec54'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.648686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f5af0a8c-7f54-44f1-b439-81251a00c501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0ea68915f640aabec74c1fc9c5ec54'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.656032 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f5af0a8c-7f54-44f1-b439-81251a00c501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0ea68915f640aabec74c1fc9c5ec54'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.667416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f5af0a8c-7f54-44f1-b439-81251a00c501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0ea68915f640aabec74c1fc9c5ec54'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:03.673706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1395/2770] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:56:03 2022] DELETE /identity/v3/users/0a0ea68915f640aabec74c1fc9c5ec54 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:56:03.991796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:03.993213 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:04.006173 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62608d96-e4d6-4a56-9ea1-88e27fe1698f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:04.066673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bf307-79ce-4739-8603-abd270cb26a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:04.067576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bf307-79ce-4739-8603-abd270cb26a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.067862 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bf307-79ce-4739-8603-abd270cb26a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.068141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bf307-79ce-4739-8603-abd270cb26a9 admin admin] PATH_INFO: `/v3/projects/25233cdc32854bea8bea6288d7d3a65f` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.069324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bf307-79ce-4739-8603-abd270cb26a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25233cdc32854bea8bea6288d7d3a65f)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:04.071252 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bf307-79ce-4739-8603-abd270cb26a9 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:04.116912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d32bf307-79ce-4739-8603-abd270cb26a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25233cdc32854bea8bea6288d7d3a65f', 'request_id': 'req-d32bf307-79ce-4739-8603-abd270cb26a9'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:04.122890 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d32bf307-79ce-4739-8603-abd270cb26a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25233cdc32854bea8bea6288d7d3a65f', 'request_id': 'req-d32bf307-79ce-4739-8603-abd270cb26a9'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:04.130614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d32bf307-79ce-4739-8603-abd270cb26a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25233cdc32854bea8bea6288d7d3a65f', 'request_id': 'req-d32bf307-79ce-4739-8603-abd270cb26a9'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:04.140764 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d32bf307-79ce-4739-8603-abd270cb26a9 admin admin] The token cache is being invalidate because project 25233cdc32854bea8bea6288d7d3a65f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:56:04.141046 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d32bf307-79ce-4739-8603-abd270cb26a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:04.141685 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-d32bf307-79ce-4739-8603-abd270cb26a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:04.143277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1376/2771] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:56:03 2022] DELETE /identity/v3/projects/25233cdc32854bea8bea6288d7d3a65f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:56:04.150084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaa694-4d4d-4992-83e4-3519acddc8d3 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.150623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaa694-4d4d-4992-83e4-3519acddc8d3 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.150623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaa694-4d4d-4992-83e4-3519acddc8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.168508 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-f0eaa694-4d4d-4992-83e4-3519acddc8d3 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:04.169707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-f0eaa694-4d4d-4992-83e4-3519acddc8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:04.225024 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1396/2772] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:04.233479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1213a3a-132a-4322-8718-f601a4428747 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.233765 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1213a3a-132a-4322-8718-f601a4428747 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.234040 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1213a3a-132a-4322-8718-f601a4428747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.252997 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-d1213a3a-132a-4322-8718-f601a4428747 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:04.254197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d1213a3a-132a-4322-8718-f601a4428747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:04.261903 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1377/2773] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:04.266180 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaa694-4d4d-4992-83e4-3519acddc8d3 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:04.275765 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaa694-4d4d-4992-83e4-3519acddc8d3 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:04.280307 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da81ae-330d-4a16-9893-d59ec23b0b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:04.280954 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da81ae-330d-4a16-9893-d59ec23b0b08 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.281242 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da81ae-330d-4a16-9893-d59ec23b0b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.281523 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da81ae-330d-4a16-9893-d59ec23b0b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.282246 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da81ae-330d-4a16-9893-d59ec23b0b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:56:04.282552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da81ae-330d-4a16-9893-d59ec23b0b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:04.289140 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da81ae-330d-4a16-9893-d59ec23b0b08 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:04.304492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1397/2774] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:56:04.308535 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1213a3a-132a-4322-8718-f601a4428747 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:04.318802 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1213a3a-132a-4322-8718-f601a4428747 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:04.323887 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf9b9e-b83b-4ba0-bee4-630a63e3e366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:04.324585 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf9b9e-b83b-4ba0-bee4-630a63e3e366 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.324869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf9b9e-b83b-4ba0-bee4-630a63e3e366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.325278 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf9b9e-b83b-4ba0-bee4-630a63e3e366 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.326205 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf9b9e-b83b-4ba0-bee4-630a63e3e366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:04.328272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf9b9e-b83b-4ba0-bee4-630a63e3e366 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:04.357841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1378/2775] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:56:04 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 13:56:04.358949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da81ae-330d-4a16-9893-d59ec23b0b08 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:04.369147 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da81ae-330d-4a16-9893-d59ec23b0b08 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:04.424268 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb90a1-da40-490d-9314-9187c49fffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:04.424933 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb90a1-da40-490d-9314-9187c49fffab admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.425217 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb90a1-da40-490d-9314-9187c49fffab admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.425492 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb90a1-da40-490d-9314-9187c49fffab admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.426172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb90a1-da40-490d-9314-9187c49fffab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:04.428103 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb90a1-da40-490d-9314-9187c49fffab admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:04.447002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1398/2776] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:56:04 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:56:04.451093 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf9b9e-b83b-4ba0-bee4-630a63e3e366 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:04.461882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf9b9e-b83b-4ba0-bee4-630a63e3e366 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:04.466428 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00264823-4c0a-4b08-908b-d9f80de29326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:04.467080 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00264823-4c0a-4b08-908b-d9f80de29326 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.467401 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00264823-4c0a-4b08-908b-d9f80de29326 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.467682 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00264823-4c0a-4b08-908b-d9f80de29326 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.468421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00264823-4c0a-4b08-908b-d9f80de29326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:04.469991 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00264823-4c0a-4b08-908b-d9f80de29326 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:04.480704 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1379/2777] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:56:04.484421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb90a1-da40-490d-9314-9187c49fffab admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:04.494084 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb90a1-da40-490d-9314-9187c49fffab admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:04.498625 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde12df-f6d1-4e23-b48e-19841107cb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:04.499293 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde12df-f6d1-4e23-b48e-19841107cb75 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.499577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde12df-f6d1-4e23-b48e-19841107cb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.499850 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde12df-f6d1-4e23-b48e-19841107cb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.500573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde12df-f6d1-4e23-b48e-19841107cb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:04.502224 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde12df-f6d1-4e23-b48e-19841107cb75 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:04.511905 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1399/2778] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:56:04.515664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00264823-4c0a-4b08-908b-d9f80de29326 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:04.525696 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00264823-4c0a-4b08-908b-d9f80de29326 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:04.530199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e80f2f-4195-4030-a61e-a4fd0130f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:04.531060 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e80f2f-4195-4030-a61e-a4fd0130f0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.531384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e80f2f-4195-4030-a61e-a4fd0130f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.531666 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e80f2f-4195-4030-a61e-a4fd0130f0c4 admin admin] PATH_INFO: `/v3/projects/67ab5b3c48344845a068a0263dcc44a1/users/9d5ab3e006ec4876a13382195825c8f0/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.545879 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e80f2f-4195-4030-a61e-a4fd0130f0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ab5b3c48344845a068a0263dcc44a1, user_id=9d5ab3e006ec4876a13382195825c8f0, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:04.548528 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e80f2f-4195-4030-a61e-a4fd0130f0c4 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:04.561251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1380/2779] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:56:04 2022] PUT /identity/v3/projects/67ab5b3c48344845a068a0263dcc44a1/users/9d5ab3e006ec4876a13382195825c8f0/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:56:04.573329 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b01d9-8de1-4120-95fe-7dfbb94a634a None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.573617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b01d9-8de1-4120-95fe-7dfbb94a634a None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.573890 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b01d9-8de1-4120-95fe-7dfbb94a634a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.600082 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-e80b01d9-8de1-4120-95fe-7dfbb94a634a None None] MFA Rules not processed for user `9d5ab3e006ec4876a13382195825c8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:04.601262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-e80b01d9-8de1-4120-95fe-7dfbb94a634a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:04.667234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1400/2780] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:04.678592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e80f2f-4195-4030-a61e-a4fd0130f0c4 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:04.680351 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-97e80f2f-4195-4030-a61e-a4fd0130f0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:04.735833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e80f2f-4195-4030-a61e-a4fd0130f0c4 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:04.739556 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39adbc0-cce5-41ff-a2c4-e21f4f85a9c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:04.740217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39adbc0-cce5-41ff-a2c4-e21f4f85a9c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.740498 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39adbc0-cce5-41ff-a2c4-e21f4f85a9c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.740770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39adbc0-cce5-41ff-a2c4-e21f4f85a9c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.748799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39adbc0-cce5-41ff-a2c4-e21f4f85a9c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:04.750218 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39adbc0-cce5-41ff-a2c4-e21f4f85a9c6 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:04.759231 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1381/2781] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:56:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:56:04.779562 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b01d9-8de1-4120-95fe-7dfbb94a634a None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:04.840922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b01d9-8de1-4120-95fe-7dfbb94a634a None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:04.845989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:04.846846 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.847124 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.847421 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] PATH_INFO: `/v3/users/9d5ab3e006ec4876a13382195825c8f0` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.848616 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5ab3e006ec4876a13382195825c8f0)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:04.850518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:04.894906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5ab3e006ec4876a13382195825c8f0'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:04.902007 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5ab3e006ec4876a13382195825c8f0'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:04.902710 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5ab3e006ec4876a13382195825c8f0'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:04.909917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5ab3e006ec4876a13382195825c8f0'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:04.921581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5ab3e006ec4876a13382195825c8f0'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:04.928026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1401/2782] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:56:04 2022] DELETE /identity/v3/users/9d5ab3e006ec4876a13382195825c8f0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:56:04.932447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94794df-d400-411f-bdac-acb67e0255dc None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:04.932741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94794df-d400-411f-bdac-acb67e0255dc None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:04.933024 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94794df-d400-411f-bdac-acb67e0255dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:04.955182 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f94794df-d400-411f-bdac-acb67e0255dc None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:04.956430 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f94794df-d400-411f-bdac-acb67e0255dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:05.018339 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1382/2783] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:05.027547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:05.028906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:05.086413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ad8cd-0008-4265-bade-de0928323e9b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:05.090057 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f013789-c5df-4f8c-83a3-1102023fa89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:05.090706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f013789-c5df-4f8c-83a3-1102023fa89b service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:05.090994 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f013789-c5df-4f8c-83a3-1102023fa89b service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:05.091308 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f013789-c5df-4f8c-83a3-1102023fa89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:05.100949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f013789-c5df-4f8c-83a3-1102023fa89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:05.102406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f013789-c5df-4f8c-83a3-1102023fa89b service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:05.111867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1402/2784] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:05.421523 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94794df-d400-411f-bdac-acb67e0255dc None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:05.423178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f94794df-d400-411f-bdac-acb67e0255dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:05.435152 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94794df-d400-411f-bdac-acb67e0255dc None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:05.440993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc7d03-7ad5-4f2e-8f58-f7f680781580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:05.442196 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc7d03-7ad5-4f2e-8f58-f7f680781580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:05.442585 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc7d03-7ad5-4f2e-8f58-f7f680781580 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:05.442892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc7d03-7ad5-4f2e-8f58-f7f680781580 admin admin] PATH_INFO: `/v3/projects/67ab5b3c48344845a068a0263dcc44a1` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:05.444111 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc7d03-7ad5-4f2e-8f58-f7f680781580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ab5b3c48344845a068a0263dcc44a1)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:05.446048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc7d03-7ad5-4f2e-8f58-f7f680781580 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:05.489900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87fc7d03-7ad5-4f2e-8f58-f7f680781580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ab5b3c48344845a068a0263dcc44a1', 'request_id': 'req-87fc7d03-7ad5-4f2e-8f58-f7f680781580'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:05.495668 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87fc7d03-7ad5-4f2e-8f58-f7f680781580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ab5b3c48344845a068a0263dcc44a1', 'request_id': 'req-87fc7d03-7ad5-4f2e-8f58-f7f680781580'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:05.503457 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87fc7d03-7ad5-4f2e-8f58-f7f680781580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ab5b3c48344845a068a0263dcc44a1', 'request_id': 'req-87fc7d03-7ad5-4f2e-8f58-f7f680781580'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:05.513179 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87fc7d03-7ad5-4f2e-8f58-f7f680781580 admin admin] The token cache is being invalidate because project 67ab5b3c48344845a068a0263dcc44a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:56:05.513466 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87fc7d03-7ad5-4f2e-8f58-f7f680781580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:05.514083 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-87fc7d03-7ad5-4f2e-8f58-f7f680781580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:56:05.515641 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1383/2785] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:56:05 2022] DELETE /identity/v3/projects/67ab5b3c48344845a068a0263dcc44a1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:56:18.928814 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f013789-c5df-4f8c-83a3-1102023fa89b service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:18.930756 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-1f013789-c5df-4f8c-83a3-1102023fa89b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:18.992208 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f013789-c5df-4f8c-83a3-1102023fa89b service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:19.039502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0742a1-35bc-4dc4-890b-6aa7750fda1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:19.040204 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0742a1-35bc-4dc4-890b-6aa7750fda1e service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:19.040486 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0742a1-35bc-4dc4-890b-6aa7750fda1e service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:19.040755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0742a1-35bc-4dc4-890b-6aa7750fda1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:19.042597 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-be0742a1-35bc-4dc4-890b-6aa7750fda1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:19.099786 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0742a1-35bc-4dc4-890b-6aa7750fda1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:19.101236 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0742a1-35bc-4dc4-890b-6aa7750fda1e service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:19.109855 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1403/2786] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:56:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:24.936805 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bddd8-37c9-4103-96bc-10c5d6f15a3d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:24.937393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bddd8-37c9-4103-96bc-10c5d6f15a3d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:24.937393 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bddd8-37c9-4103-96bc-10c5d6f15a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:24.956736 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-462bddd8-37c9-4103-96bc-10c5d6f15a3d None None] MFA Rules not processed for user `5267381c1521479d92a861283e9b31f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:56:24.957912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-462bddd8-37c9-4103-96bc-10c5d6f15a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:24.964840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1384/2787] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:56:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:56:24.968143 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0742a1-35bc-4dc4-890b-6aa7750fda1e service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:24.969530 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-be0742a1-35bc-4dc4-890b-6aa7750fda1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:25.037400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0742a1-35bc-4dc4-890b-6aa7750fda1e service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:25.042213 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dc57b-210f-4629-9a2c-d8d75be3d53f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735744b9ea1f429399b914f3e00d166f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:25.042861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dc57b-210f-4629-9a2c-d8d75be3d53f service placement] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:25.043140 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dc57b-210f-4629-9a2c-d8d75be3d53f service placement] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:25.044067 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dc57b-210f-4629-9a2c-d8d75be3d53f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:25.045831 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-496dc57b-210f-4629-9a2c-d8d75be3d53f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:25.057917 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dc57b-210f-4629-9a2c-d8d75be3d53f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:25.059521 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dc57b-210f-4629-9a2c-d8d75be3d53f service placement] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:25.069758 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1404/2788] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:56:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:25.274660 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bddd8-37c9-4103-96bc-10c5d6f15a3d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:25.276058 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-462bddd8-37c9-4103-96bc-10c5d6f15a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:25.330710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bddd8-37c9-4103-96bc-10c5d6f15a3d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:25.334199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5ae62-8d34-447c-82fa-11f2fd49fb2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:25.334831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5ae62-8d34-447c-82fa-11f2fd49fb2b service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:25.335110 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5ae62-8d34-447c-82fa-11f2fd49fb2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:25.335411 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5ae62-8d34-447c-82fa-11f2fd49fb2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:25.337124 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-d7c5ae62-8d34-447c-82fa-11f2fd49fb2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:25.346199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5ae62-8d34-447c-82fa-11f2fd49fb2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:25.348190 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5ae62-8d34-447c-82fa-11f2fd49fb2b service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:25.355928 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1385/2789] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:56:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:56:41.336425 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dc57b-210f-4629-9a2c-d8d75be3d53f service placement] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:56:41.345639 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dc57b-210f-4629-9a2c-d8d75be3d53f service placement] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:56:41.349238 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82605a-7100-4569-9006-1496f14c3168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:56:41.349867 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82605a-7100-4569-9006-1496f14c3168 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:56:41.350153 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82605a-7100-4569-9006-1496f14c3168 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:56:41.350429 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82605a-7100-4569-9006-1496f14c3168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:56:41.352207 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-af82605a-7100-4569-9006-1496f14c3168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:56:41.413234 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82605a-7100-4569-9006-1496f14c3168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:56:41.414656 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82605a-7100-4569-9006-1496f14c3168 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:56:41.423992 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1405/2790] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:56:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:57:29.157708 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5ae62-8d34-447c-82fa-11f2fd49fb2b service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:29.166129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5ae62-8d34-447c-82fa-11f2fd49fb2b service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:29.169672 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c830bde-4a49-4f14-9917-d513342e9bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:29.170291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c830bde-4a49-4f14-9917-d513342e9bda service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:29.170568 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c830bde-4a49-4f14-9917-d513342e9bda service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:29.170837 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c830bde-4a49-4f14-9917-d513342e9bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:29.172622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7c830bde-4a49-4f14-9917-d513342e9bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:29.232203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c830bde-4a49-4f14-9917-d513342e9bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:29.233630 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c830bde-4a49-4f14-9917-d513342e9bda service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:29.242867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1386/2791] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:57:35.821617 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82605a-7100-4569-9006-1496f14c3168 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:35.823505 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-af82605a-7100-4569-9006-1496f14c3168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:35.843862 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82605a-7100-4569-9006-1496f14c3168 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:35.848711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:35.849810 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:35.850081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:35.850356 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] PATH_INFO: `/v3/users/025715e81fde4ed8b8d62f900cfd3f45` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:35.852069 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=025715e81fde4ed8b8d62f900cfd3f45)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:35.853979 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:35.901225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025715e81fde4ed8b8d62f900cfd3f45'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:35.909173 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025715e81fde4ed8b8d62f900cfd3f45'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:35.909861 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025715e81fde4ed8b8d62f900cfd3f45'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:35.917661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025715e81fde4ed8b8d62f900cfd3f45'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:35.930079 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025715e81fde4ed8b8d62f900cfd3f45'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:35.936118 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1406/2792] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:57:35 2022] DELETE /identity/v3/users/025715e81fde4ed8b8d62f900cfd3f45 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:57:36.104541 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c830bde-4a49-4f14-9917-d513342e9bda service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:36.114359 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c830bde-4a49-4f14-9917-d513342e9bda service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:36.174251 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:36.175107 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:36.175444 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:36.175722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] PATH_INFO: `/v3/projects/e954f6233f084ff0a0972369ec806b34` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:36.176883 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e954f6233f084ff0a0972369ec806b34)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:36.178766 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:36.222301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e954f6233f084ff0a0972369ec806b34', 'request_id': 'req-10e32502-7e7e-42d6-80dd-c1a404ea3724'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.228906 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e954f6233f084ff0a0972369ec806b34', 'request_id': 'req-10e32502-7e7e-42d6-80dd-c1a404ea3724'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.235786 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e954f6233f084ff0a0972369ec806b34', 'request_id': 'req-10e32502-7e7e-42d6-80dd-c1a404ea3724'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.245824 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] The token cache is being invalidate because project e954f6233f084ff0a0972369ec806b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:57:36.246113 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.246728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.248290 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1387/2793] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:57:36 2022] DELETE /identity/v3/projects/e954f6233f084ff0a0972369ec806b34 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:57:36.252438 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:36.253835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:36.266509 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39566943-0071-4fbc-be42-cc9f0c54f2d1 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:36.320802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0d17c-8298-487a-8099-c7122b94379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:36.321671 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0d17c-8298-487a-8099-c7122b94379a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:36.321949 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0d17c-8298-487a-8099-c7122b94379a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:36.322222 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0d17c-8298-487a-8099-c7122b94379a admin admin] PATH_INFO: `/v3/users/ad62203e91064d24943acdbfe2a177ce` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:36.323547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0d17c-8298-487a-8099-c7122b94379a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad62203e91064d24943acdbfe2a177ce)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:36.325454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0d17c-8298-487a-8099-c7122b94379a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:36.369090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-16f0d17c-8298-487a-8099-c7122b94379a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad62203e91064d24943acdbfe2a177ce'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.376012 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-16f0d17c-8298-487a-8099-c7122b94379a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad62203e91064d24943acdbfe2a177ce'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.376614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-16f0d17c-8298-487a-8099-c7122b94379a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad62203e91064d24943acdbfe2a177ce'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.383291 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-16f0d17c-8298-487a-8099-c7122b94379a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad62203e91064d24943acdbfe2a177ce'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.394359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-16f0d17c-8298-487a-8099-c7122b94379a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad62203e91064d24943acdbfe2a177ce'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.400582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1407/2794] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:57:36 2022] DELETE /identity/v3/users/ad62203e91064d24943acdbfe2a177ce => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:57:36.564326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:57:36.565962 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:36.579877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e32502-7e7e-42d6-80dd-c1a404ea3724 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:57:36.637366 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:57:36.638141 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:36.638425 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:36.638702 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] PATH_INFO: `/v3/projects/a57584c2eb7f41b1ad25b26cb9ff3c24` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:36.639891 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57584c2eb7f41b1ad25b26cb9ff3c24)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:57:36.641784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:57:36.684758 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57584c2eb7f41b1ad25b26cb9ff3c24', 'request_id': 'req-bc8fff30-e694-452c-968a-a5d59143b8dc'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.690577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57584c2eb7f41b1ad25b26cb9ff3c24', 'request_id': 'req-bc8fff30-e694-452c-968a-a5d59143b8dc'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.698072 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57584c2eb7f41b1ad25b26cb9ff3c24', 'request_id': 'req-bc8fff30-e694-452c-968a-a5d59143b8dc'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.707797 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] The token cache is being invalidate because project a57584c2eb7f41b1ad25b26cb9ff3c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:57:36.708082 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.708715 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:57:36.710238 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1388/2795] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:57:36 2022] DELETE /identity/v3/projects/a57584c2eb7f41b1ad25b26cb9ff3c24 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:57:56.644083 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534de384-3926-4ed4-8067-8b63f0819161 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:57:56.644620 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534de384-3926-4ed4-8067-8b63f0819161 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:57:56.644761 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534de384-3926-4ed4-8067-8b63f0819161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:57:56.661965 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-534de384-3926-4ed4-8067-8b63f0819161 None None] MFA Rules not processed for user `e199af656b654fb9b6738ad597339e01`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:57:56.663175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-534de384-3926-4ed4-8067-8b63f0819161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:57:56.715982 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1408/2796] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:57:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:58:24.314597 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:58:24.318174 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:58:24.377476 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fff30-e694-452c-968a-a5d59143b8dc admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:58:24.380804 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fcaac-23a0-4808-a1b0-04763076fc34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:58:24.381450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fcaac-23a0-4808-a1b0-04763076fc34 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:58:24.381732 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fcaac-23a0-4808-a1b0-04763076fc34 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:58:24.382575 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fcaac-23a0-4808-a1b0-04763076fc34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:58:24.384377 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a55fcaac-23a0-4808-a1b0-04763076fc34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:58:24.455917 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fcaac-23a0-4808-a1b0-04763076fc34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:58:24.457700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fcaac-23a0-4808-a1b0-04763076fc34 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:58:24.469657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1389/2797] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:58:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:58:25.659510 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534de384-3926-4ed4-8067-8b63f0819161 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:58:25.669197 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534de384-3926-4ed4-8067-8b63f0819161 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:58:25.672869 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e376c3-cf67-4037-bf1d-61c67bd5f843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:58:25.673510 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e376c3-cf67-4037-bf1d-61c67bd5f843 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:58:25.673792 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e376c3-cf67-4037-bf1d-61c67bd5f843 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:58:25.674069 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e376c3-cf67-4037-bf1d-61c67bd5f843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:58:25.675864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-90e376c3-cf67-4037-bf1d-61c67bd5f843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:58:25.689632 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e376c3-cf67-4037-bf1d-61c67bd5f843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:58:25.691367 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e376c3-cf67-4037-bf1d-61c67bd5f843 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:58:25.703102 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1409/2798] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:58:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:58:36.468128 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fcaac-23a0-4808-a1b0-04763076fc34 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:58:36.477497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fcaac-23a0-4808-a1b0-04763076fc34 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:58:36.481121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557ec20-446f-4c1b-9724-c30704e88478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:58:36.481750 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ec20-446f-4c1b-9724-c30704e88478 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:58:36.482059 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ec20-446f-4c1b-9724-c30704e88478 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:58:36.482334 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ec20-446f-4c1b-9724-c30704e88478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:58:36.484089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3557ec20-446f-4c1b-9724-c30704e88478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:58:36.543835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ec20-446f-4c1b-9724-c30704e88478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:58:36.545178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ec20-446f-4c1b-9724-c30704e88478 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:58:36.554384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1390/2799] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:58:42.538030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e376c3-cf67-4037-bf1d-61c67bd5f843 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:58:42.540212 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-90e376c3-cf67-4037-bf1d-61c67bd5f843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:58:42.555650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e376c3-cf67-4037-bf1d-61c67bd5f843 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:58:42.560081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:58:42.561020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:58:42.561253 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:58:42.561507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] PATH_INFO: `/v3/users/5267381c1521479d92a861283e9b31f4` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:58:42.566709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5267381c1521479d92a861283e9b31f4)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:58:42.566709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:58:42.614572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5267381c1521479d92a861283e9b31f4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:42.623864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5267381c1521479d92a861283e9b31f4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:42.624489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5267381c1521479d92a861283e9b31f4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:42.631960 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5267381c1521479d92a861283e9b31f4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:42.645029 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5267381c1521479d92a861283e9b31f4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:42.651916 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1410/2800] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:58:42 2022] DELETE /identity/v3/users/5267381c1521479d92a861283e9b31f4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:58:43.082822 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557ec20-446f-4c1b-9724-c30704e88478 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:58:43.092920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557ec20-446f-4c1b-9724-c30704e88478 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:58:43.148360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:58:43.149211 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:58:43.149489 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:58:43.149760 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] PATH_INFO: `/v3/projects/3a581986e7304b35a1e08ebdd059c318` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:58:43.150921 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a581986e7304b35a1e08ebdd059c318)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:58:43.152839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:58:43.196022 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a581986e7304b35a1e08ebdd059c318', 'request_id': 'req-7f6bc030-0dd1-466d-aae3-1d1030216d8b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.201778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a581986e7304b35a1e08ebdd059c318', 'request_id': 'req-7f6bc030-0dd1-466d-aae3-1d1030216d8b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.208531 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a581986e7304b35a1e08ebdd059c318', 'request_id': 'req-7f6bc030-0dd1-466d-aae3-1d1030216d8b'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.218792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] The token cache is being invalidate because project 3a581986e7304b35a1e08ebdd059c318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:58:43.219073 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.219710 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.221203 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1391/2801] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:58:43 2022] DELETE /identity/v3/projects/3a581986e7304b35a1e08ebdd059c318 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 13:58:43.225104 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:58:43.227026 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:58:43.239602 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c1ab1-7a7b-4aed-af3e-68c12d5b4be4 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:58:43.293706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:58:43.294537 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:58:43.294871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:58:43.295185 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] PATH_INFO: `/v3/users/c1947ba73a25442b97844d66b0bdade4` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:58:43.296467 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1947ba73a25442b97844d66b0bdade4)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:58:43.298338 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:58:43.342729 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1947ba73a25442b97844d66b0bdade4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.349669 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1947ba73a25442b97844d66b0bdade4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.350292 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1947ba73a25442b97844d66b0bdade4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.356957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1947ba73a25442b97844d66b0bdade4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.368020 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1947ba73a25442b97844d66b0bdade4'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.373937 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1411/2802] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:58:43 2022] DELETE /identity/v3/users/c1947ba73a25442b97844d66b0bdade4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:58:43.537460 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:58:43.538892 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:58:43.551647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bc030-0dd1-466d-aae3-1d1030216d8b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:58:43.607975 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:58:43.608920 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:58:43.609223 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:58:43.609504 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] PATH_INFO: `/v3/projects/2e92cfcc27444a759d88108e1d321f7a` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:58:43.610677 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e92cfcc27444a759d88108e1d321f7a)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:58:43.612654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:58:43.656226 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e92cfcc27444a759d88108e1d321f7a', 'request_id': 'req-3b162acb-9ace-4fb4-8740-9ba98d4f2407'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.661970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e92cfcc27444a759d88108e1d321f7a', 'request_id': 'req-3b162acb-9ace-4fb4-8740-9ba98d4f2407'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.668679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e92cfcc27444a759d88108e1d321f7a', 'request_id': 'req-3b162acb-9ace-4fb4-8740-9ba98d4f2407'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.678224 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] The token cache is being invalidate because project 2e92cfcc27444a759d88108e1d321f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:58:43.678503 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.679633 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:58:43.681122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1392/2803] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:58:43 2022] DELETE /identity/v3/projects/2e92cfcc27444a759d88108e1d321f7a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:59:09.569262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:09.570754 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:09.650744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bd49b-c92c-4665-8c23-035c0bc67017 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:09.722878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a6457-00bb-49d8-9839-9c3e79617b15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:09.723560 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a6457-00bb-49d8-9839-9c3e79617b15 service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:09.723841 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a6457-00bb-49d8-9839-9c3e79617b15 service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:09.724136 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a6457-00bb-49d8-9839-9c3e79617b15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:09.726566 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-aa3a6457-00bb-49d8-9839-9c3e79617b15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:09.739619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a6457-00bb-49d8-9839-9c3e79617b15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:09.741854 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a6457-00bb-49d8-9839-9c3e79617b15 service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:09.752795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1412/2804] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:59:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:59:18.343741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:18.345910 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:18.421062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b162acb-9ace-4fb4-8740-9ba98d4f2407 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:18.426158 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e4823-8134-46fd-8dab-036803e970ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:18.427042 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e4823-8134-46fd-8dab-036803e970ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:18.427375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e4823-8134-46fd-8dab-036803e970ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:18.427657 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e4823-8134-46fd-8dab-036803e970ab admin admin] PATH_INFO: `/v3/users/e199af656b654fb9b6738ad597339e01` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:18.428879 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e4823-8134-46fd-8dab-036803e970ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e199af656b654fb9b6738ad597339e01)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:18.430789 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e4823-8134-46fd-8dab-036803e970ab admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:18.476577 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b32e4823-8134-46fd-8dab-036803e970ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e199af656b654fb9b6738ad597339e01'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:18.483039 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b32e4823-8134-46fd-8dab-036803e970ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e199af656b654fb9b6738ad597339e01'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:18.489619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b32e4823-8134-46fd-8dab-036803e970ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e199af656b654fb9b6738ad597339e01'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:18.490233 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b32e4823-8134-46fd-8dab-036803e970ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e199af656b654fb9b6738ad597339e01'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:18.490828 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-b32e4823-8134-46fd-8dab-036803e970ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e199af656b654fb9b6738ad597339e01'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:18.507598 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1393/2805] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 13:59:18 2022] DELETE /identity/v3/users/e199af656b654fb9b6738ad597339e01 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:59:18.676944 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a6457-00bb-49d8-9839-9c3e79617b15 service nova] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:18.689548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a6457-00bb-49d8-9839-9c3e79617b15 service nova] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:18.745638 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f81b2-0ade-4058-ba05-96625a26b8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:18.746878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f81b2-0ade-4058-ba05-96625a26b8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:18.747167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f81b2-0ade-4058-ba05-96625a26b8be admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:18.747478 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f81b2-0ade-4058-ba05-96625a26b8be admin admin] PATH_INFO: `/v3/projects/6333cfd15a5149a885d2904e86172a52` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:18.748661 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f81b2-0ade-4058-ba05-96625a26b8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=6333cfd15a5149a885d2904e86172a52)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:18.750554 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f81b2-0ade-4058-ba05-96625a26b8be admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:18.796093 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-364f81b2-0ade-4058-ba05-96625a26b8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6333cfd15a5149a885d2904e86172a52', 'request_id': 'req-364f81b2-0ade-4058-ba05-96625a26b8be'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:18.802018 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-364f81b2-0ade-4058-ba05-96625a26b8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6333cfd15a5149a885d2904e86172a52', 'request_id': 'req-364f81b2-0ade-4058-ba05-96625a26b8be'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:18.809122 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-364f81b2-0ade-4058-ba05-96625a26b8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6333cfd15a5149a885d2904e86172a52', 'request_id': 'req-364f81b2-0ade-4058-ba05-96625a26b8be'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:18.819732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-364f81b2-0ade-4058-ba05-96625a26b8be admin admin] The token cache is being invalidate because project 6333cfd15a5149a885d2904e86172a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86423) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 13:59:18.820017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-364f81b2-0ade-4058-ba05-96625a26b8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:18.820629 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-364f81b2-0ade-4058-ba05-96625a26b8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 13:59:18.822148 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1413/2806] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 13:59:18 2022] DELETE /identity/v3/projects/6333cfd15a5149a885d2904e86172a52 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:59:18.827048 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79799a04-0b5a-4dbd-a69a-10be3c2716ba None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:18.827375 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79799a04-0b5a-4dbd-a69a-10be3c2716ba None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:18.827673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79799a04-0b5a-4dbd-a69a-10be3c2716ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:18.847298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-79799a04-0b5a-4dbd-a69a-10be3c2716ba None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:59:18.848497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-79799a04-0b5a-4dbd-a69a-10be3c2716ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:18.918689 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1394/2807] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:59:18.926504 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c819-49e5-40d6-b7d1-5e960590630d None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:18.926834 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c819-49e5-40d6-b7d1-5e960590630d None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:18.927108 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c819-49e5-40d6-b7d1-5e960590630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:18.946538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-5c07c819-49e5-40d6-b7d1-5e960590630d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:59:18.947774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-5c07c819-49e5-40d6-b7d1-5e960590630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:18.955541 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1414/2808] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:59:18.959795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79799a04-0b5a-4dbd-a69a-10be3c2716ba None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:18.969015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79799a04-0b5a-4dbd-a69a-10be3c2716ba None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:18.973431 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5548945-b34a-4d60-ba3e-a91dd9d3855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:18.974067 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5548945-b34a-4d60-ba3e-a91dd9d3855b admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:18.974345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5548945-b34a-4d60-ba3e-a91dd9d3855b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:18.974617 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5548945-b34a-4d60-ba3e-a91dd9d3855b admin admin] PATH_INFO: `/v3/domains` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:18.975364 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5548945-b34a-4d60-ba3e-a91dd9d3855b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 13:59:18.975669 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5548945-b34a-4d60-ba3e-a91dd9d3855b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:18.977267 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5548945-b34a-4d60-ba3e-a91dd9d3855b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:18.988198 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1395/2809] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 13:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 13:59:18.993001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07c819-49e5-40d6-b7d1-5e960590630d None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:19.002064 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07c819-49e5-40d6-b7d1-5e960590630d None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:19.007394 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf451d-d9b3-4611-8cfb-484ca6b6bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:19.008062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf451d-d9b3-4611-8cfb-484ca6b6bcd3 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:19.008348 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf451d-d9b3-4611-8cfb-484ca6b6bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:19.008626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf451d-d9b3-4611-8cfb-484ca6b6bcd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:19.009312 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf451d-d9b3-4611-8cfb-484ca6b6bcd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:19.011172 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf451d-d9b3-4611-8cfb-484ca6b6bcd3 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:19.035709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1415/2810] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 13:59:18 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:59:19.039342 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5548945-b34a-4d60-ba3e-a91dd9d3855b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:19.048902 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5548945-b34a-4d60-ba3e-a91dd9d3855b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:19.103463 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d8291-72de-40a7-a83a-238646b70f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:19.104107 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d8291-72de-40a7-a83a-238646b70f15 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:19.104388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d8291-72de-40a7-a83a-238646b70f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:19.104662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d8291-72de-40a7-a83a-238646b70f15 admin admin] PATH_INFO: `/v3/users` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:19.105330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d8291-72de-40a7-a83a-238646b70f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:19.107246 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d8291-72de-40a7-a83a-238646b70f15 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:19.125664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1396/2811] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 13:59:19 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 13:59:19.129793 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf451d-d9b3-4611-8cfb-484ca6b6bcd3 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:19.139833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf451d-d9b3-4611-8cfb-484ca6b6bcd3 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:19.144507 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f79a0b-00df-45eb-ab34-331f740736dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:19.145328 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f79a0b-00df-45eb-ab34-331f740736dd admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:19.145619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f79a0b-00df-45eb-ab34-331f740736dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:19.145900 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f79a0b-00df-45eb-ab34-331f740736dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:19.146626 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f79a0b-00df-45eb-ab34-331f740736dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:19.148750 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f79a0b-00df-45eb-ab34-331f740736dd admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:19.158780 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1416/2812] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:59:19.163143 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d8291-72de-40a7-a83a-238646b70f15 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:19.172678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d8291-72de-40a7-a83a-238646b70f15 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:19.177192 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ab5e-0aa3-4b3a-a349-6bbc27b67a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:19.177835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ab5e-0aa3-4b3a-a349-6bbc27b67a09 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:19.178140 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ab5e-0aa3-4b3a-a349-6bbc27b67a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:19.178418 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ab5e-0aa3-4b3a-a349-6bbc27b67a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:19.179137 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855ab5e-0aa3-4b3a-a349-6bbc27b67a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:19.180897 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855ab5e-0aa3-4b3a-a349-6bbc27b67a09 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:19.190848 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1397/2813] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 13:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 13:59:19.194878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f79a0b-00df-45eb-ab34-331f740736dd admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:19.204619 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f79a0b-00df-45eb-ab34-331f740736dd admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:19.209244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6b5a1-bdc9-4d02-bf7d-7c55287461f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:19.210649 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6b5a1-bdc9-4d02-bf7d-7c55287461f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:19.210932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6b5a1-bdc9-4d02-bf7d-7c55287461f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:19.211232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6b5a1-bdc9-4d02-bf7d-7c55287461f7 admin admin] PATH_INFO: `/v3/projects/d25ef9a7e9464aeab7ef6b71947f8228/users/0303ac321e504d2d8233ef58f52c0228/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:19.226033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6b5a1-bdc9-4d02-bf7d-7c55287461f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25ef9a7e9464aeab7ef6b71947f8228, user_id=0303ac321e504d2d8233ef58f52c0228, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:19.228795 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6b5a1-bdc9-4d02-bf7d-7c55287461f7 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:19.241932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1417/2814] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 13:59:19 2022] PUT /identity/v3/projects/d25ef9a7e9464aeab7ef6b71947f8228/users/0303ac321e504d2d8233ef58f52c0228/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 13:59:19.248839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfbb39-34e9-4c79-bdb4-b334485ccc0d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:19.249132 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfbb39-34e9-4c79-bdb4-b334485ccc0d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:19.249412 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfbb39-34e9-4c79-bdb4-b334485ccc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:19.269282 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-e3dfbb39-34e9-4c79-bdb4-b334485ccc0d None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:59:19.270467 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e3dfbb39-34e9-4c79-bdb4-b334485ccc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:19.328416 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1398/2815] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:59:19.338543 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6b5a1-bdc9-4d02-bf7d-7c55287461f7 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:19.340259 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-13f6b5a1-bdc9-4d02-bf7d-7c55287461f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:19.394844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6b5a1-bdc9-4d02-bf7d-7c55287461f7 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:19.400033 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96e577-b83e-4f1e-9266-1f04c962e5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:19.400684 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96e577-b83e-4f1e-9266-1f04c962e5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:19.400968 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96e577-b83e-4f1e-9266-1f04c962e5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:19.401243 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96e577-b83e-4f1e-9266-1f04c962e5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:19.410680 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96e577-b83e-4f1e-9266-1f04c962e5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:19.412942 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96e577-b83e-4f1e-9266-1f04c962e5a5 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:19.422478 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1418/2816] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 13:59:23.368558 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2ef86-c8da-47e6-a2e7-bcd59de4496f None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:23.369054 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2ef86-c8da-47e6-a2e7-bcd59de4496f None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:23.369153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2ef86-c8da-47e6-a2e7-bcd59de4496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:23.397881 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-f9c2ef86-c8da-47e6-a2e7-bcd59de4496f None None] MFA Rules not processed for user `0303ac321e504d2d8233ef58f52c0228`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:59:23.399099 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-f9c2ef86-c8da-47e6-a2e7-bcd59de4496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:23.464451 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1399/2817] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:59:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:59:23.476706 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96e577-b83e-4f1e-9266-1f04c962e5a5 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:23.478265 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6a96e577-b83e-4f1e-9266-1f04c962e5a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:23.551359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96e577-b83e-4f1e-9266-1f04c962e5a5 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:23.556897 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54fb36-f584-42c6-b750-27a211a5e8e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:23.557538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54fb36-f584-42c6-b750-27a211a5e8e4 service nova] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:23.557822 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54fb36-f584-42c6-b750-27a211a5e8e4 service nova] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:23.558095 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54fb36-f584-42c6-b750-27a211a5e8e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:23.566813 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54fb36-f584-42c6-b750-27a211a5e8e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:23.568615 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54fb36-f584-42c6-b750-27a211a5e8e4 service nova] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:23.578754 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1419/2818] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:59:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:59:24.917745 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059622-152d-4446-9d4a-f412610eed4a None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:24.918252 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059622-152d-4446-9d4a-f412610eed4a None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:24.918368 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059622-152d-4446-9d4a-f412610eed4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:24.935497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-4d059622-152d-4446-9d4a-f412610eed4a None None] MFA Rules not processed for user `0303ac321e504d2d8233ef58f52c0228`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 13:59:24.936770 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4d059622-152d-4446-9d4a-f412610eed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:24.944288 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1400/2819] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 13:59:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 13:59:25.285720 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54fb36-f584-42c6-b750-27a211a5e8e4 service nova] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:25.305225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54fb36-f584-42c6-b750-27a211a5e8e4 service nova] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:25.309243 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3824dc0-8796-4a2a-82a9-11944dadd512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:25.310126 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3824dc0-8796-4a2a-82a9-11944dadd512 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:25.310645 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3824dc0-8796-4a2a-82a9-11944dadd512 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:25.311159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3824dc0-8796-4a2a-82a9-11944dadd512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:25.315247 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c3824dc0-8796-4a2a-82a9-11944dadd512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:25.327839 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3824dc0-8796-4a2a-82a9-11944dadd512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:25.329281 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3824dc0-8796-4a2a-82a9-11944dadd512 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:25.339159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1420/2820] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:59:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:59:25.693809 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059622-152d-4446-9d4a-f412610eed4a None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:25.695450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-4d059622-152d-4446-9d4a-f412610eed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:25.769116 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059622-152d-4446-9d4a-f412610eed4a None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:25.774643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09102b01-81d1-4bac-aa6a-bcc2d503136b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735744b9ea1f429399b914f3e00d166f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:25.775320 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09102b01-81d1-4bac-aa6a-bcc2d503136b service placement] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:25.775605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09102b01-81d1-4bac-aa6a-bcc2d503136b service placement] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:25.775882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09102b01-81d1-4bac-aa6a-bcc2d503136b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:25.777644 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-09102b01-81d1-4bac-aa6a-bcc2d503136b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:25.789722 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09102b01-81d1-4bac-aa6a-bcc2d503136b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:25.791396 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09102b01-81d1-4bac-aa6a-bcc2d503136b service placement] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:25.801671 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1401/2821] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:59:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:59:27.610817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3824dc0-8796-4a2a-82a9-11944dadd512 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:27.612567 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-c3824dc0-8796-4a2a-82a9-11944dadd512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:27.622871 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3824dc0-8796-4a2a-82a9-11944dadd512 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:27.626568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f112c67-c54e-479a-8a68-360ac9d6b17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:27.627228 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f112c67-c54e-479a-8a68-360ac9d6b17a service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:27.627525 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f112c67-c54e-479a-8a68-360ac9d6b17a service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:27.627802 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f112c67-c54e-479a-8a68-360ac9d6b17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:27.629591 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-4f112c67-c54e-479a-8a68-360ac9d6b17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:27.640540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f112c67-c54e-479a-8a68-360ac9d6b17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:27.642037 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f112c67-c54e-479a-8a68-360ac9d6b17a service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:27.651776 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1421/2822] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:59:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 13:59:33.406718 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09102b01-81d1-4bac-aa6a-bcc2d503136b service placement] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 13:59:33.420274 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09102b01-81d1-4bac-aa6a-bcc2d503136b service placement] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 13:59:33.425647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bc8d7-781e-429a-b059-17036d5f5dc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 13:59:33.426297 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bc8d7-781e-429a-b059-17036d5f5dc6 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 13:59:33.426565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bc8d7-781e-429a-b059-17036d5f5dc6 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 13:59:33.426839 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bc8d7-781e-429a-b059-17036d5f5dc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 13:59:33.428636 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-097bc8d7-781e-429a-b059-17036d5f5dc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 13:59:33.440915 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bc8d7-781e-429a-b059-17036d5f5dc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 13:59:33.442483 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bc8d7-781e-429a-b059-17036d5f5dc6 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 13:59:33.452796 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1402/2823] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 13:59:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:00:23.669344 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57846137-b63d-4323-8ec2-077e8144edb9 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:00:23.669875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57846137-b63d-4323-8ec2-077e8144edb9 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:00:23.669875 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57846137-b63d-4323-8ec2-077e8144edb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:00:23.687225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-57846137-b63d-4323-8ec2-077e8144edb9 None None] MFA Rules not processed for user `0303ac321e504d2d8233ef58f52c0228`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:00:23.688678 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-57846137-b63d-4323-8ec2-077e8144edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:00:23.695538 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1422/2824] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:00:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:00:35.787646 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bc8d7-781e-429a-b059-17036d5f5dc6 service nova] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:00:35.789043 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-097bc8d7-781e-429a-b059-17036d5f5dc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:00:35.861200 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bc8d7-781e-429a-b059-17036d5f5dc6 service nova] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:00:35.866721 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744dc6f-c6ec-4499-8a58-347ed38c7897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d07b370370461a90cab0b182938292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:00:35.868005 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744dc6f-c6ec-4499-8a58-347ed38c7897 service nova] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:00:35.868291 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744dc6f-c6ec-4499-8a58-347ed38c7897 service nova] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:00:35.868565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744dc6f-c6ec-4499-8a58-347ed38c7897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:00:35.870360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-5744dc6f-c6ec-4499-8a58-347ed38c7897 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:00:35.882332 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744dc6f-c6ec-4499-8a58-347ed38c7897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:00:35.884562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744dc6f-c6ec-4499-8a58-347ed38c7897 service nova] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:00:35.895072 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1403/2825] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 14:00:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:01:23.281712 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8da5ea-32d2-4e79-8c9f-3a51673f9d21 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:23.282251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8da5ea-32d2-4e79-8c9f-3a51673f9d21 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:23.282251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8da5ea-32d2-4e79-8c9f-3a51673f9d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:23.299983 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-ca8da5ea-32d2-4e79-8c9f-3a51673f9d21 None None] MFA Rules not processed for user `0303ac321e504d2d8233ef58f52c0228`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:01:23.301159 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ca8da5ea-32d2-4e79-8c9f-3a51673f9d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:23.308635 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1423/2826] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:01:25.339808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744dc6f-c6ec-4499-8a58-347ed38c7897 service nova] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:01:25.341199 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-5744dc6f-c6ec-4499-8a58-347ed38c7897 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:25.376369 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744dc6f-c6ec-4499-8a58-347ed38c7897 service nova] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:01:25.381360 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5d284-2d0c-4512-b449-649cc9859514 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735744b9ea1f429399b914f3e00d166f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:01:25.381988 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5d284-2d0c-4512-b449-649cc9859514 service placement] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:01:25.382266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5d284-2d0c-4512-b449-649cc9859514 service placement] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:01:25.382536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5d284-2d0c-4512-b449-649cc9859514 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:01:25.384849 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-7ac5d284-2d0c-4512-b449-649cc9859514 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:01:25.395943 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5d284-2d0c-4512-b449-649cc9859514 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:01:25.397596 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5d284-2d0c-4512-b449-649cc9859514 service placement] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:01:25.407284 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1404/2827] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 14:01:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:02:26.248062 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e52a-b61b-48d6-8c52-4b3d72bff289 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:02:26.248606 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e52a-b61b-48d6-8c52-4b3d72bff289 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:02:26.248606 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e52a-b61b-48d6-8c52-4b3d72bff289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:02:26.265353 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-66f5e52a-b61b-48d6-8c52-4b3d72bff289 None None] MFA Rules not processed for user `0303ac321e504d2d8233ef58f52c0228`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:02:26.266518 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-66f5e52a-b61b-48d6-8c52-4b3d72bff289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:02:26.273336 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1424/2828] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:02:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:02:26.574146 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5d284-2d0c-4512-b449-649cc9859514 service placement] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:02:26.592648 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5d284-2d0c-4512-b449-649cc9859514 service placement] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:02:26.596164 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fe799-dd85-4f71-9de4-366c25dd9dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:02:26.596795 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fe799-dd85-4f71-9de4-366c25dd9dcd service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:02:26.597077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fe799-dd85-4f71-9de4-366c25dd9dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:02:26.597357 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fe799-dd85-4f71-9de4-366c25dd9dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:02:26.599084 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-a41fe799-dd85-4f71-9de4-366c25dd9dcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:02:26.620314 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fe799-dd85-4f71-9de4-366c25dd9dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:02:26.621794 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fe799-dd85-4f71-9de4-366c25dd9dcd service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:02:26.629592 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1405/2829] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 14:02:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:25.981037 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5e52a-b61b-48d6-8c52-4b3d72bff289 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:25.991025 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5e52a-b61b-48d6-8c52-4b3d72bff289 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:25.994479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071960-b98c-4e59-92b4-adcf32deb809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:25.995106 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071960-b98c-4e59-92b4-adcf32deb809 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:25.995413 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071960-b98c-4e59-92b4-adcf32deb809 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:25.995689 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071960-b98c-4e59-92b4-adcf32deb809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:25.997454 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-7f071960-b98c-4e59-92b4-adcf32deb809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:26.028847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f071960-b98c-4e59-92b4-adcf32deb809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:26.030251 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f071960-b98c-4e59-92b4-adcf32deb809 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:26.050354 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1425/2830] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 14:03:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:27.219979 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fe799-dd85-4f71-9de4-366c25dd9dcd service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:27.228716 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fe799-dd85-4f71-9de4-366c25dd9dcd service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:27.233107 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a74271-c479-40a5-9661-86e246b4fc6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:27.233735 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a74271-c479-40a5-9661-86e246b4fc6e service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:27.234013 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a74271-c479-40a5-9661-86e246b4fc6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:27.234287 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a74271-c479-40a5-9661-86e246b4fc6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:27.236077 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-e5a74271-c479-40a5-9661-86e246b4fc6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:27.249421 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a74271-c479-40a5-9661-86e246b4fc6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:27.251036 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a74271-c479-40a5-9661-86e246b4fc6e service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:27.261784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1406/2831] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 14:03:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:36.903167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071960-b98c-4e59-92b4-adcf32deb809 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:36.932402 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071960-b98c-4e59-92b4-adcf32deb809 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:36.937774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8b829-5bd9-4b92-a83e-a96f34573138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:36.938662 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8b829-5bd9-4b92-a83e-a96f34573138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:36.938947 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8b829-5bd9-4b92-a83e-a96f34573138 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:36.939245 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8b829-5bd9-4b92-a83e-a96f34573138 admin admin] PATH_INFO: `/v3/users/0303ac321e504d2d8233ef58f52c0228` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:36.940456 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8b829-5bd9-4b92-a83e-a96f34573138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0303ac321e504d2d8233ef58f52c0228)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:36.942360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8b829-5bd9-4b92-a83e-a96f34573138 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:36.990252 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f0e8b829-5bd9-4b92-a83e-a96f34573138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0303ac321e504d2d8233ef58f52c0228'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:36.997691 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f0e8b829-5bd9-4b92-a83e-a96f34573138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0303ac321e504d2d8233ef58f52c0228'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:36.998709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f0e8b829-5bd9-4b92-a83e-a96f34573138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0303ac321e504d2d8233ef58f52c0228'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:37.006098 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f0e8b829-5bd9-4b92-a83e-a96f34573138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0303ac321e504d2d8233ef58f52c0228'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:37.018596 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-f0e8b829-5bd9-4b92-a83e-a96f34573138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0303ac321e504d2d8233ef58f52c0228'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:37.027280 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1426/2832] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 14:03:36 2022] DELETE /identity/v3/users/0303ac321e504d2d8233ef58f52c0228 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:37.193989 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a74271-c479-40a5-9661-86e246b4fc6e service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:37.204868 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a74271-c479-40a5-9661-86e246b4fc6e service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:37.258991 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f7957-1871-4203-bb92-a66e56f2cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:37.259880 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f7957-1871-4203-bb92-a66e56f2cfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:37.260165 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f7957-1871-4203-bb92-a66e56f2cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:37.260439 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f7957-1871-4203-bb92-a66e56f2cfcf admin admin] PATH_INFO: `/v3/projects/d25ef9a7e9464aeab7ef6b71947f8228` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:37.261604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f7957-1871-4203-bb92-a66e56f2cfcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25ef9a7e9464aeab7ef6b71947f8228)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:37.264160 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f7957-1871-4203-bb92-a66e56f2cfcf admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:37.308972 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e04f7957-1871-4203-bb92-a66e56f2cfcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25ef9a7e9464aeab7ef6b71947f8228', 'request_id': 'req-e04f7957-1871-4203-bb92-a66e56f2cfcf'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:37.315622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e04f7957-1871-4203-bb92-a66e56f2cfcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25ef9a7e9464aeab7ef6b71947f8228', 'request_id': 'req-e04f7957-1871-4203-bb92-a66e56f2cfcf'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:37.322877 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e04f7957-1871-4203-bb92-a66e56f2cfcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25ef9a7e9464aeab7ef6b71947f8228', 'request_id': 'req-e04f7957-1871-4203-bb92-a66e56f2cfcf'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:37.344831 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e04f7957-1871-4203-bb92-a66e56f2cfcf admin admin] The token cache is being invalidate because project d25ef9a7e9464aeab7ef6b71947f8228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:03:37.345115 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e04f7957-1871-4203-bb92-a66e56f2cfcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:37.345741 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-e04f7957-1871-4203-bb92-a66e56f2cfcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:37.347298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1407/2833] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 14:03:37 2022] DELETE /identity/v3/projects/d25ef9a7e9464aeab7ef6b71947f8228 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:37.352286 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b43ab-0af3-47f1-b6d2-1f560afdc98c None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:37.352577 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b43ab-0af3-47f1-b6d2-1f560afdc98c None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:37.352856 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b43ab-0af3-47f1-b6d2-1f560afdc98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:37.408358 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-340b43ab-0af3-47f1-b6d2-1f560afdc98c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:37.409859 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-340b43ab-0af3-47f1-b6d2-1f560afdc98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:37.467844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1427/2834] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:37.475384 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6eaff-bf70-42bb-a785-26b5401f776c None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:37.475673 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6eaff-bf70-42bb-a785-26b5401f776c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:37.475952 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6eaff-bf70-42bb-a785-26b5401f776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:37.493788 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-b5c6eaff-bf70-42bb-a785-26b5401f776c None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:37.494971 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-b5c6eaff-bf70-42bb-a785-26b5401f776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:37.503446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1408/2835] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:37.507552 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b43ab-0af3-47f1-b6d2-1f560afdc98c None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:37.516955 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b43ab-0af3-47f1-b6d2-1f560afdc98c None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:37.521447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efd1b1-ba8a-4047-924e-0ab6cf669dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:37.522092 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efd1b1-ba8a-4047-924e-0ab6cf669dfc admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:37.522371 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efd1b1-ba8a-4047-924e-0ab6cf669dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:37.522643 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efd1b1-ba8a-4047-924e-0ab6cf669dfc admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:37.523400 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efd1b1-ba8a-4047-924e-0ab6cf669dfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:37.523702 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efd1b1-ba8a-4047-924e-0ab6cf669dfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:37.525266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efd1b1-ba8a-4047-924e-0ab6cf669dfc admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:37.536540 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1428/2836] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 14:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:37.540588 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6eaff-bf70-42bb-a785-26b5401f776c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:37.550101 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6eaff-bf70-42bb-a785-26b5401f776c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:37.554690 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36a054-ee60-4e76-8670-b6873e4fb880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:37.555361 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36a054-ee60-4e76-8670-b6873e4fb880 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:37.555647 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36a054-ee60-4e76-8670-b6873e4fb880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:37.555927 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36a054-ee60-4e76-8670-b6873e4fb880 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:37.556623 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36a054-ee60-4e76-8670-b6873e4fb880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:37.558514 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36a054-ee60-4e76-8670-b6873e4fb880 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:37.584019 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1409/2837] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 14:03:37 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:03:37.587974 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efd1b1-ba8a-4047-924e-0ab6cf669dfc admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:37.597595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efd1b1-ba8a-4047-924e-0ab6cf669dfc admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:37.650801 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d13f7c-5fce-4a2c-aa2d-ad404875e88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:37.651481 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d13f7c-5fce-4a2c-aa2d-ad404875e88e admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:37.651765 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d13f7c-5fce-4a2c-aa2d-ad404875e88e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:37.652040 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d13f7c-5fce-4a2c-aa2d-ad404875e88e admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:37.652736 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d13f7c-5fce-4a2c-aa2d-ad404875e88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:37.654611 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d13f7c-5fce-4a2c-aa2d-ad404875e88e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:37.673769 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1429/2838] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 14:03:37 2022] POST /identity/v3/users => generated 303 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:37.677808 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36a054-ee60-4e76-8670-b6873e4fb880 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:37.688907 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36a054-ee60-4e76-8670-b6873e4fb880 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:37.693422 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2ddcb-271e-4200-bc6c-4f8d37cb327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:37.694063 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2ddcb-271e-4200-bc6c-4f8d37cb327b admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:37.694343 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2ddcb-271e-4200-bc6c-4f8d37cb327b admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:37.694615 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2ddcb-271e-4200-bc6c-4f8d37cb327b admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:37.695388 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2ddcb-271e-4200-bc6c-4f8d37cb327b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:37.696977 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2ddcb-271e-4200-bc6c-4f8d37cb327b admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:37.706462 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1410/2839] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 14:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:37.710175 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d13f7c-5fce-4a2c-aa2d-ad404875e88e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:37.720313 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d13f7c-5fce-4a2c-aa2d-ad404875e88e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:37.724781 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2479c-5c2c-49a2-8bfb-107e397a1b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:37.725426 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2479c-5c2c-49a2-8bfb-107e397a1b3e admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:37.725709 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2479c-5c2c-49a2-8bfb-107e397a1b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:37.725984 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2479c-5c2c-49a2-8bfb-107e397a1b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:37.726732 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2479c-5c2c-49a2-8bfb-107e397a1b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:37.728326 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2479c-5c2c-49a2-8bfb-107e397a1b3e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:37.738474 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1430/2840] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 14:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:37.742272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2ddcb-271e-4200-bc6c-4f8d37cb327b admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:37.751727 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2ddcb-271e-4200-bc6c-4f8d37cb327b admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:37.756162 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986adb6-8cef-43fc-8e6e-ad4b4255c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:37.757015 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986adb6-8cef-43fc-8e6e-ad4b4255c53c admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:37.757294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986adb6-8cef-43fc-8e6e-ad4b4255c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:37.757565 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986adb6-8cef-43fc-8e6e-ad4b4255c53c admin admin] PATH_INFO: `/v3/projects/9856e86737e64797a68b979e16e34be0/users/fd7245a615534a77941821ff32c77b73/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:37.771604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986adb6-8cef-43fc-8e6e-ad4b4255c53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9856e86737e64797a68b979e16e34be0, user_id=fd7245a615534a77941821ff32c77b73, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:37.774206 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986adb6-8cef-43fc-8e6e-ad4b4255c53c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:37.787003 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1411/2841] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 14:03:37 2022] PUT /identity/v3/projects/9856e86737e64797a68b979e16e34be0/users/fd7245a615534a77941821ff32c77b73/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:37.792215 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbd045-de4a-4c6b-8728-0a86492621ba None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:37.792534 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbd045-de4a-4c6b-8728-0a86492621ba None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:37.792845 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbd045-de4a-4c6b-8728-0a86492621ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:37.810975 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-45fbd045-de4a-4c6b-8728-0a86492621ba None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:37.812216 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-45fbd045-de4a-4c6b-8728-0a86492621ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:37.868416 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1431/2842] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:37.877834 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986adb6-8cef-43fc-8e6e-ad4b4255c53c admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:37.879499 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-0986adb6-8cef-43fc-8e6e-ad4b4255c53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:37.934134 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986adb6-8cef-43fc-8e6e-ad4b4255c53c admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:37.937664 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd45fc-40c6-4e99-a1b9-cdaeb7dc22e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:37.938315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd45fc-40c6-4e99-a1b9-cdaeb7dc22e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:37.938594 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd45fc-40c6-4e99-a1b9-cdaeb7dc22e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:37.938867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd45fc-40c6-4e99-a1b9-cdaeb7dc22e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:37.947532 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd45fc-40c6-4e99-a1b9-cdaeb7dc22e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:37.948944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd45fc-40c6-4e99-a1b9-cdaeb7dc22e0 service neutron] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:37.958188 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1412/2843] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 14:03:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:38.582907 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790bac2-c3ce-4aee-960d-61c831bb2341 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:38.583502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790bac2-c3ce-4aee-960d-61c831bb2341 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:38.583502 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790bac2-c3ce-4aee-960d-61c831bb2341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:38.609181 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-b790bac2-c3ce-4aee-960d-61c831bb2341 None None] MFA Rules not processed for user `fd7245a615534a77941821ff32c77b73`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:38.610428 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-b790bac2-c3ce-4aee-960d-61c831bb2341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:38.672972 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1432/2844] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:38.677441 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd45fc-40c6-4e99-a1b9-cdaeb7dc22e0 service neutron] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:38.687479 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd45fc-40c6-4e99-a1b9-cdaeb7dc22e0 service neutron] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:38.693604 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dda38-0716-48cf-97f9-41f50f469b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:38.694326 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dda38-0716-48cf-97f9-41f50f469b99 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:38.694672 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dda38-0716-48cf-97f9-41f50f469b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:38.695012 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dda38-0716-48cf-97f9-41f50f469b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:38.695832 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006dda38-0716-48cf-97f9-41f50f469b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:38.697919 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006dda38-0716-48cf-97f9-41f50f469b99 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:38.723302 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1413/2845] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 14:03:38 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:38.727161 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790bac2-c3ce-4aee-960d-61c831bb2341 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:38.737738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790bac2-c3ce-4aee-960d-61c831bb2341 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:38.791233 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63c366-e9b4-4bf7-982a-fd088d13c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:38.791835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63c366-e9b4-4bf7-982a-fd088d13c340 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:38.792266 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63c366-e9b4-4bf7-982a-fd088d13c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:38.792435 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63c366-e9b4-4bf7-982a-fd088d13c340 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:38.793081 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63c366-e9b4-4bf7-982a-fd088d13c340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:38.794964 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63c366-e9b4-4bf7-982a-fd088d13c340 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:38.814711 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1433/2846] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 14:03:38 2022] POST /identity/v3/users => generated 308 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:38.818609 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dda38-0716-48cf-97f9-41f50f469b99 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:38.829163 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dda38-0716-48cf-97f9-41f50f469b99 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:38.833654 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa87845-6a21-4fea-a141-4186017f2a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:38.834301 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa87845-6a21-4fea-a141-4186017f2a9a admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:38.834586 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa87845-6a21-4fea-a141-4186017f2a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:38.834866 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa87845-6a21-4fea-a141-4186017f2a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:38.835622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa87845-6a21-4fea-a141-4186017f2a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:38.837197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa87845-6a21-4fea-a141-4186017f2a9a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:38.847320 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1414/2847] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 14:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:38.851485 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63c366-e9b4-4bf7-982a-fd088d13c340 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:38.861710 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63c366-e9b4-4bf7-982a-fd088d13c340 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:38.866228 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af204c5e-47a1-4374-997f-c6cd2fddac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:38.867094 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af204c5e-47a1-4374-997f-c6cd2fddac97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:38.867409 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af204c5e-47a1-4374-997f-c6cd2fddac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:38.867685 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af204c5e-47a1-4374-997f-c6cd2fddac97 admin admin] PATH_INFO: `/v3/projects/47c102f585c347cc9d0c5d88aff3ba68/users/1393286d8d4b4871aa881c727c874138/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:38.882220 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af204c5e-47a1-4374-997f-c6cd2fddac97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c102f585c347cc9d0c5d88aff3ba68, user_id=1393286d8d4b4871aa881c727c874138, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:38.884858 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af204c5e-47a1-4374-997f-c6cd2fddac97 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:38.897272 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1434/2848] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 14:03:38 2022] PUT /identity/v3/projects/47c102f585c347cc9d0c5d88aff3ba68/users/1393286d8d4b4871aa881c727c874138/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:38.901181 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa87845-6a21-4fea-a141-4186017f2a9a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:38.910908 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa87845-6a21-4fea-a141-4186017f2a9a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:38.970680 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0efe8-894d-4c22-a3ce-6a9710267228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:38.971376 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0efe8-894d-4c22-a3ce-6a9710267228 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:38.971662 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0efe8-894d-4c22-a3ce-6a9710267228 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:38.971944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0efe8-894d-4c22-a3ce-6a9710267228 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:38.972676 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0efe8-894d-4c22-a3ce-6a9710267228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:38.974266 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0efe8-894d-4c22-a3ce-6a9710267228 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:38.984570 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1415/2849] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 14:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:38.988703 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af204c5e-47a1-4374-997f-c6cd2fddac97 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:38.999549 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af204c5e-47a1-4374-997f-c6cd2fddac97 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:39.004223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d06a6-0415-4143-b747-fd044f4ab00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:39.005091 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d06a6-0415-4143-b747-fd044f4ab00c admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:39.005360 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d06a6-0415-4143-b747-fd044f4ab00c admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:39.005627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d06a6-0415-4143-b747-fd044f4ab00c admin admin] PATH_INFO: `/v3/projects/47c102f585c347cc9d0c5d88aff3ba68/users/1393286d8d4b4871aa881c727c874138/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:39.007599 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d06a6-0415-4143-b747-fd044f4ab00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c102f585c347cc9d0c5d88aff3ba68, user_id=1393286d8d4b4871aa881c727c874138, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:39.010192 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d06a6-0415-4143-b747-fd044f4ab00c admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:39.020166 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1435/2850] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 14:03:38 2022] PUT /identity/v3/projects/47c102f585c347cc9d0c5d88aff3ba68/users/1393286d8d4b4871aa881c727c874138/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:39.599626 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf9e31-e619-4a13-92b9-094b850bc71d None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:39.599923 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf9e31-e619-4a13-92b9-094b850bc71d None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:39.600205 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf9e31-e619-4a13-92b9-094b850bc71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:39.634429 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-3ebf9e31-e619-4a13-92b9-094b850bc71d None None] MFA Rules not processed for user `1393286d8d4b4871aa881c727c874138`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:39.636250 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3ebf9e31-e619-4a13-92b9-094b850bc71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:39.707590 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1416/2851] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:40.682582 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d06a6-0415-4143-b747-fd044f4ab00c admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:40.743674 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d06a6-0415-4143-b747-fd044f4ab00c admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:40.748223 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:40.749171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:40.749447 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:40.749723 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] PATH_INFO: `/v3/users/fd7245a615534a77941821ff32c77b73` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:40.750902 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7245a615534a77941821ff32c77b73)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:40.752844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:40.799692 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7245a615534a77941821ff32c77b73'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:40.807145 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7245a615534a77941821ff32c77b73'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:40.807774 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7245a615534a77941821ff32c77b73'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:40.815573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7245a615534a77941821ff32c77b73'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:40.827573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7245a615534a77941821ff32c77b73'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:40.833403 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1436/2852] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 14:03:40 2022] DELETE /identity/v3/users/fd7245a615534a77941821ff32c77b73 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:40.999619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf9e31-e619-4a13-92b9-094b850bc71d None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:41.010126 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf9e31-e619-4a13-92b9-094b850bc71d None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:41.065235 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:41.066090 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.066371 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.066643 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] PATH_INFO: `/v3/projects/9856e86737e64797a68b979e16e34be0` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.067821 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9856e86737e64797a68b979e16e34be0)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:41.069707 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:41.112970 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9856e86737e64797a68b979e16e34be0', 'request_id': 'req-281d3a62-afed-456a-b7eb-fa14fc240fd4'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.118773 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9856e86737e64797a68b979e16e34be0', 'request_id': 'req-281d3a62-afed-456a-b7eb-fa14fc240fd4'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.125854 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9856e86737e64797a68b979e16e34be0', 'request_id': 'req-281d3a62-afed-456a-b7eb-fa14fc240fd4'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.135981 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] The token cache is being invalidate because project 9856e86737e64797a68b979e16e34be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:03:41.136297 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.136913 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.138455 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1417/2853] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 14:03:40 2022] DELETE /identity/v3/projects/9856e86737e64797a68b979e16e34be0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:41.142397 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:41.143785 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:41.156277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28a523-6042-4ca4-80f8-562424b56bb8 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:41.210574 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a8963-4f08-4425-9dc2-9ed46d20fc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:41.211406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a8963-4f08-4425-9dc2-9ed46d20fc75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.211690 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a8963-4f08-4425-9dc2-9ed46d20fc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.211963 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a8963-4f08-4425-9dc2-9ed46d20fc75 admin admin] PATH_INFO: `/v3/users/1393286d8d4b4871aa881c727c874138` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.213131 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a8963-4f08-4425-9dc2-9ed46d20fc75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1393286d8d4b4871aa881c727c874138)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:41.215019 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a8963-4f08-4425-9dc2-9ed46d20fc75 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:41.260705 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5f3a8963-4f08-4425-9dc2-9ed46d20fc75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1393286d8d4b4871aa881c727c874138'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.267565 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5f3a8963-4f08-4425-9dc2-9ed46d20fc75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1393286d8d4b4871aa881c727c874138'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.268166 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5f3a8963-4f08-4425-9dc2-9ed46d20fc75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1393286d8d4b4871aa881c727c874138'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.274893 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5f3a8963-4f08-4425-9dc2-9ed46d20fc75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1393286d8d4b4871aa881c727c874138'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.286017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-5f3a8963-4f08-4425-9dc2-9ed46d20fc75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1393286d8d4b4871aa881c727c874138'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.291914 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1437/2854] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 14:03:41 2022] DELETE /identity/v3/users/1393286d8d4b4871aa881c727c874138 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:41.460838 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:41.462272 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:41.475536 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d3a62-afed-456a-b7eb-fa14fc240fd4 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:41.530619 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c3934-3f08-4dd4-b1ef-26a957118755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:41.531505 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3934-3f08-4dd4-b1ef-26a957118755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.531787 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3934-3f08-4dd4-b1ef-26a957118755 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.532060 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3934-3f08-4dd4-b1ef-26a957118755 admin admin] PATH_INFO: `/v3/projects/47c102f585c347cc9d0c5d88aff3ba68` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.533324 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c3934-3f08-4dd4-b1ef-26a957118755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c102f585c347cc9d0c5d88aff3ba68)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:41.535241 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c3934-3f08-4dd4-b1ef-26a957118755 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:41.579521 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b5c3934-3f08-4dd4-b1ef-26a957118755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c102f585c347cc9d0c5d88aff3ba68', 'request_id': 'req-1b5c3934-3f08-4dd4-b1ef-26a957118755'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.585426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b5c3934-3f08-4dd4-b1ef-26a957118755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c102f585c347cc9d0c5d88aff3ba68', 'request_id': 'req-1b5c3934-3f08-4dd4-b1ef-26a957118755'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.592973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b5c3934-3f08-4dd4-b1ef-26a957118755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c102f585c347cc9d0c5d88aff3ba68', 'request_id': 'req-1b5c3934-3f08-4dd4-b1ef-26a957118755'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.605074 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b5c3934-3f08-4dd4-b1ef-26a957118755 admin admin] The token cache is being invalidate because project 47c102f585c347cc9d0c5d88aff3ba68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:03:41.605356 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b5c3934-3f08-4dd4-b1ef-26a957118755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.605980 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-1b5c3934-3f08-4dd4-b1ef-26a957118755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:41.608338 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1418/2855] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 14:03:41 2022] DELETE /identity/v3/projects/47c102f585c347cc9d0c5d88aff3ba68 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:41.614644 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8651c61-9ee9-4189-b6a2-3d681102fd79 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.614930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8651c61-9ee9-4189-b6a2-3d681102fd79 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.615221 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8651c61-9ee9-4189-b6a2-3d681102fd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.632090 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-d8651c61-9ee9-4189-b6a2-3d681102fd79 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:41.633289 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-d8651c61-9ee9-4189-b6a2-3d681102fd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:41.688767 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1438/2856] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:41.697044 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db560c6-7536-4555-88eb-ccf1cf44d3af None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.697330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db560c6-7536-4555-88eb-ccf1cf44d3af None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.697606 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db560c6-7536-4555-88eb-ccf1cf44d3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.715612 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-3db560c6-7536-4555-88eb-ccf1cf44d3af None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:41.717239 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-3db560c6-7536-4555-88eb-ccf1cf44d3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:41.725394 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1419/2857] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:41.729601 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8651c61-9ee9-4189-b6a2-3d681102fd79 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:41.739514 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8651c61-9ee9-4189-b6a2-3d681102fd79 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:41.743957 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667eb9a-f2fe-4360-a675-e23008fbc269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:41.744600 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667eb9a-f2fe-4360-a675-e23008fbc269 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.744878 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667eb9a-f2fe-4360-a675-e23008fbc269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.745151 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667eb9a-f2fe-4360-a675-e23008fbc269 admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.745864 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667eb9a-f2fe-4360-a675-e23008fbc269 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:41.746167 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667eb9a-f2fe-4360-a675-e23008fbc269 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:41.747804 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667eb9a-f2fe-4360-a675-e23008fbc269 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:41.758756 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1439/2858] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 14:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:41.762853 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db560c6-7536-4555-88eb-ccf1cf44d3af None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:41.771935 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db560c6-7536-4555-88eb-ccf1cf44d3af None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:41.776501 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e9703-f48e-4ee6-91b6-35e86572e57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:41.777129 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9703-f48e-4ee6-91b6-35e86572e57a admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.777406 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9703-f48e-4ee6-91b6-35e86572e57a admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.777728 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9703-f48e-4ee6-91b6-35e86572e57a admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.778419 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e9703-f48e-4ee6-91b6-35e86572e57a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:41.780869 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e9703-f48e-4ee6-91b6-35e86572e57a admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:41.805178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1420/2859] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 14:03:41 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:03:41.809445 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667eb9a-f2fe-4360-a675-e23008fbc269 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:41.819023 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667eb9a-f2fe-4360-a675-e23008fbc269 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:41.872415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1487f7-7876-40e0-9520-eaed6fee1b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:41.873092 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1487f7-7876-40e0-9520-eaed6fee1b1b admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.873369 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1487f7-7876-40e0-9520-eaed6fee1b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.873717 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1487f7-7876-40e0-9520-eaed6fee1b1b admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.874396 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1487f7-7876-40e0-9520-eaed6fee1b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:41.876311 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1487f7-7876-40e0-9520-eaed6fee1b1b admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:41.895494 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1440/2860] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 14:03:41 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:41.899569 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e9703-f48e-4ee6-91b6-35e86572e57a admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:41.910155 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e9703-f48e-4ee6-91b6-35e86572e57a admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:41.914684 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317047a0-ab0d-4769-823e-d47564be7fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:41.915351 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317047a0-ab0d-4769-823e-d47564be7fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.915629 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317047a0-ab0d-4769-823e-d47564be7fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.915901 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317047a0-ab0d-4769-823e-d47564be7fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.916614 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317047a0-ab0d-4769-823e-d47564be7fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:41.918175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317047a0-ab0d-4769-823e-d47564be7fe8 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:41.928125 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1421/2861] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 14:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:41.932016 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1487f7-7876-40e0-9520-eaed6fee1b1b admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:41.942006 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1487f7-7876-40e0-9520-eaed6fee1b1b admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:41.946710 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268872ad-2da3-4db8-876d-cc5c3b2cc848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:41.947433 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268872ad-2da3-4db8-876d-cc5c3b2cc848 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.947721 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268872ad-2da3-4db8-876d-cc5c3b2cc848 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.947998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268872ad-2da3-4db8-876d-cc5c3b2cc848 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:41.948744 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268872ad-2da3-4db8-876d-cc5c3b2cc848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:41.950343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268872ad-2da3-4db8-876d-cc5c3b2cc848 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:41.962489 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1441/2862] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 14:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:41.967822 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317047a0-ab0d-4769-823e-d47564be7fe8 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:41.979633 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317047a0-ab0d-4769-823e-d47564be7fe8 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:41.984830 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9cf91-eae9-440b-905f-03eb146ba8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:41.985742 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9cf91-eae9-440b-905f-03eb146ba8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:41.986031 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9cf91-eae9-440b-905f-03eb146ba8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:41.986311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9cf91-eae9-440b-905f-03eb146ba8bb admin admin] PATH_INFO: `/v3/projects/6943a2bfb0654b93883dfc66d29fa015/users/1fea0ef2f2e74bc09692bcb59a03a8c2/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:42.000623 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9cf91-eae9-440b-905f-03eb146ba8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6943a2bfb0654b93883dfc66d29fa015, user_id=1fea0ef2f2e74bc09692bcb59a03a8c2, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:42.003299 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9cf91-eae9-440b-905f-03eb146ba8bb admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:42.016465 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1422/2863] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 14:03:41 2022] PUT /identity/v3/projects/6943a2bfb0654b93883dfc66d29fa015/users/1fea0ef2f2e74bc09692bcb59a03a8c2/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 14:03:42.027701 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e8df0-0784-49f6-8fd0-a265def0c9e0 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:42.028017 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e8df0-0784-49f6-8fd0-a265def0c9e0 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:42.028282 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e8df0-0784-49f6-8fd0-a265def0c9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:42.054244 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-eb1e8df0-0784-49f6-8fd0-a265def0c9e0 None None] MFA Rules not processed for user `1fea0ef2f2e74bc09692bcb59a03a8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:42.055484 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-eb1e8df0-0784-49f6-8fd0-a265def0c9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:42.116165 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1442/2864] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:42.120562 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9cf91-eae9-440b-905f-03eb146ba8bb admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:42.180175 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9cf91-eae9-440b-905f-03eb146ba8bb admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:42.184995 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16f23e-f41c-4d4a-96d0-a4bd898e4d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:42.186148 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f23e-f41c-4d4a-96d0-a4bd898e4d70 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:42.186426 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f23e-f41c-4d4a-96d0-a4bd898e4d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:42.186700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f23e-f41c-4d4a-96d0-a4bd898e4d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:42.187414 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16f23e-f41c-4d4a-96d0-a4bd898e4d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:42.189294 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16f23e-f41c-4d4a-96d0-a4bd898e4d70 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:42.212698 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1423/2865] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 14:03:42 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 14:03:42.216722 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e8df0-0784-49f6-8fd0-a265def0c9e0 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:42.227013 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e8df0-0784-49f6-8fd0-a265def0c9e0 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:42.281154 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c55f7a-1bcd-417e-9f42-c48756e92a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:42.281817 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c55f7a-1bcd-417e-9f42-c48756e92a63 admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:42.282123 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c55f7a-1bcd-417e-9f42-c48756e92a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:42.282398 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c55f7a-1bcd-417e-9f42-c48756e92a63 admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:42.283086 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c55f7a-1bcd-417e-9f42-c48756e92a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:42.285010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c55f7a-1bcd-417e-9f42-c48756e92a63 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:42.305032 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1443/2866] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 14:03:42 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:42.309276 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16f23e-f41c-4d4a-96d0-a4bd898e4d70 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:42.320120 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16f23e-f41c-4d4a-96d0-a4bd898e4d70 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:42.324678 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e71f4d-a53f-40c8-93e6-2a6c167e91ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:42.325330 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e71f4d-a53f-40c8-93e6-2a6c167e91ee admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:42.325611 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e71f4d-a53f-40c8-93e6-2a6c167e91ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:42.326458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e71f4d-a53f-40c8-93e6-2a6c167e91ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:42.327178 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e71f4d-a53f-40c8-93e6-2a6c167e91ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:42.328792 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e71f4d-a53f-40c8-93e6-2a6c167e91ee admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:42.338903 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1424/2867] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 14:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 14:03:42.343110 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c55f7a-1bcd-417e-9f42-c48756e92a63 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:42.352977 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c55f7a-1bcd-417e-9f42-c48756e92a63 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:42.357443 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bf05c-34fb-4d01-929d-5adb0e24ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:42.358359 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bf05c-34fb-4d01-929d-5adb0e24ad31 admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:42.358628 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bf05c-34fb-4d01-929d-5adb0e24ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:42.358906 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bf05c-34fb-4d01-929d-5adb0e24ad31 admin admin] PATH_INFO: `/v3/projects/2c479aeab2c047db8fe931323b3b2084/users/36aaf9bc2c344ae1897e16bcdae93177/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:42.373738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bf05c-34fb-4d01-929d-5adb0e24ad31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c479aeab2c047db8fe931323b3b2084, user_id=36aaf9bc2c344ae1897e16bcdae93177, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:42.376377 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bf05c-34fb-4d01-929d-5adb0e24ad31 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:42.389195 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1444/2868] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 14:03:42 2022] PUT /identity/v3/projects/2c479aeab2c047db8fe931323b3b2084/users/36aaf9bc2c344ae1897e16bcdae93177/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:42.393121 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e71f4d-a53f-40c8-93e6-2a6c167e91ee admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:42.403047 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e71f4d-a53f-40c8-93e6-2a6c167e91ee admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:42.455870 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c83ea-1bed-4eda-b390-11e3f5b663be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:42.456520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c83ea-1bed-4eda-b390-11e3f5b663be admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:42.456799 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c83ea-1bed-4eda-b390-11e3f5b663be admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:42.457071 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c83ea-1bed-4eda-b390-11e3f5b663be admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:42.457784 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c83ea-1bed-4eda-b390-11e3f5b663be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:42.459392 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c83ea-1bed-4eda-b390-11e3f5b663be admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:42.468672 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1425/2869] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 14:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:42.472755 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bf05c-34fb-4d01-929d-5adb0e24ad31 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:42.482696 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bf05c-34fb-4d01-929d-5adb0e24ad31 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:42.487107 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c94ad-c6f4-4ea2-92e6-d13d9b38df6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:42.488001 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c94ad-c6f4-4ea2-92e6-d13d9b38df6a admin admin] REQUEST_METHOD: `PUT` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:42.488277 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c94ad-c6f4-4ea2-92e6-d13d9b38df6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:42.488544 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c94ad-c6f4-4ea2-92e6-d13d9b38df6a admin admin] PATH_INFO: `/v3/projects/2c479aeab2c047db8fe931323b3b2084/users/36aaf9bc2c344ae1897e16bcdae93177/roles/70e67f35994843ae942d4f1703d5619e` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:42.490461 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c94ad-c6f4-4ea2-92e6-d13d9b38df6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c479aeab2c047db8fe931323b3b2084, user_id=36aaf9bc2c344ae1897e16bcdae93177, role_id=70e67f35994843ae942d4f1703d5619e)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:42.493128 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c94ad-c6f4-4ea2-92e6-d13d9b38df6a admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:42.503411 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1445/2870] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 14:03:42 2022] PUT /identity/v3/projects/2c479aeab2c047db8fe931323b3b2084/users/36aaf9bc2c344ae1897e16bcdae93177/roles/70e67f35994843ae942d4f1703d5619e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:42.513197 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e0421-5fbd-4594-b017-b9088457337c None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:42.514062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e0421-5fbd-4594-b017-b9088457337c None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:42.514345 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e0421-5fbd-4594-b017-b9088457337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:42.539445 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-eb3e0421-5fbd-4594-b017-b9088457337c None None] MFA Rules not processed for user `36aaf9bc2c344ae1897e16bcdae93177`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:42.540627 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-eb3e0421-5fbd-4594-b017-b9088457337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:42.605103 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1426/2871] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:42.618431 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c94ad-c6f4-4ea2-92e6-d13d9b38df6a admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:42.620232 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-949c94ad-c6f4-4ea2-92e6-d13d9b38df6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:42.674595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c94ad-c6f4-4ea2-92e6-d13d9b38df6a admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:42.678262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea6d6f-6cbe-429e-8c59-63c10feeaae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:42.678894 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea6d6f-6cbe-429e-8c59-63c10feeaae8 service cinder] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:42.679171 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea6d6f-6cbe-429e-8c59-63c10feeaae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:42.679479 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea6d6f-6cbe-429e-8c59-63c10feeaae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:42.689112 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea6d6f-6cbe-429e-8c59-63c10feeaae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:42.690513 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea6d6f-6cbe-429e-8c59-63c10feeaae8 service cinder] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:42.699922 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1446/2872] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 14:03:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:42.767886 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e0421-5fbd-4594-b017-b9088457337c None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:42.777315 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e0421-5fbd-4594-b017-b9088457337c None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:42.780931 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d71fe-c4f7-45a9-b37a-742dcfa873a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:42.781557 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d71fe-c4f7-45a9-b37a-742dcfa873a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:42.781835 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d71fe-c4f7-45a9-b37a-742dcfa873a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:42.782106 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d71fe-c4f7-45a9-b37a-742dcfa873a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:42.835999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d71fe-c4f7-45a9-b37a-742dcfa873a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:42.837464 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d71fe-c4f7-45a9-b37a-742dcfa873a7 service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:42.846131 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1427/2873] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 14:03:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:43.092313 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea6d6f-6cbe-429e-8c59-63c10feeaae8 service cinder] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:43.151118 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea6d6f-6cbe-429e-8c59-63c10feeaae8 service cinder] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:43.156080 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:43.156930 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:43.157203 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:43.157470 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] PATH_INFO: `/v3/users/1fea0ef2f2e74bc09692bcb59a03a8c2` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:43.158627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fea0ef2f2e74bc09692bcb59a03a8c2)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:43.160548 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:43.203904 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fea0ef2f2e74bc09692bcb59a03a8c2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.210645 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fea0ef2f2e74bc09692bcb59a03a8c2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.211262 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fea0ef2f2e74bc09692bcb59a03a8c2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.218650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fea0ef2f2e74bc09692bcb59a03a8c2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.229686 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fea0ef2f2e74bc09692bcb59a03a8c2'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.236010 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1447/2874] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 14:03:43 2022] DELETE /identity/v3/users/1fea0ef2f2e74bc09692bcb59a03a8c2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:43.240453 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af390775-fca8-4dc7-83a2-418b87e95743 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:43.240944 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af390775-fca8-4dc7-83a2-418b87e95743 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:43.241056 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af390775-fca8-4dc7-83a2-418b87e95743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:43.257270 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-af390775-fca8-4dc7-83a2-418b87e95743 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:43.258477 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-af390775-fca8-4dc7-83a2-418b87e95743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:43.315078 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1428/2875] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:43.324650 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:43.326627 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:43.381581 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f54cda-06fd-4083-9918-ae6863521c2e admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:43.385184 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c915b5-5c07-4d32-b4f1-f0efe2db1f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:43.385816 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c915b5-5c07-4d32-b4f1-f0efe2db1f01 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:43.386095 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c915b5-5c07-4d32-b4f1-f0efe2db1f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:43.386373 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c915b5-5c07-4d32-b4f1-f0efe2db1f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:43.395738 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c915b5-5c07-4d32-b4f1-f0efe2db1f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:43.397142 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c915b5-5c07-4d32-b4f1-f0efe2db1f01 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:43.406948 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1448/2876] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 14:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:03:43.661667 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af390775-fca8-4dc7-83a2-418b87e95743 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:43.663102 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-af390775-fca8-4dc7-83a2-418b87e95743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:43.675458 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af390775-fca8-4dc7-83a2-418b87e95743 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:43.680079 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:43.680929 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:43.681217 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:43.681497 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] PATH_INFO: `/v3/projects/6943a2bfb0654b93883dfc66d29fa015` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:43.682709 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6943a2bfb0654b93883dfc66d29fa015)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:43.684882 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:43.731000 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6943a2bfb0654b93883dfc66d29fa015', 'request_id': 'req-8abf2936-73fd-420d-abca-d4b87bac9c6c'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.737520 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6943a2bfb0654b93883dfc66d29fa015', 'request_id': 'req-8abf2936-73fd-420d-abca-d4b87bac9c6c'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.744526 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6943a2bfb0654b93883dfc66d29fa015', 'request_id': 'req-8abf2936-73fd-420d-abca-d4b87bac9c6c'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.754144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] The token cache is being invalidate because project 6943a2bfb0654b93883dfc66d29fa015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:03:43.754427 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.755038 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.756576 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1429/2877] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 14:03:43 2022] DELETE /identity/v3/projects/6943a2bfb0654b93883dfc66d29fa015 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:43.760496 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c915b5-5c07-4d32-b4f1-f0efe2db1f01 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:43.769835 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c915b5-5c07-4d32-b4f1-f0efe2db1f01 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:43.823895 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5042bad-a210-4c49-beb3-494de0ff9f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:43.824751 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5042bad-a210-4c49-beb3-494de0ff9f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:43.825030 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5042bad-a210-4c49-beb3-494de0ff9f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:43.825300 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5042bad-a210-4c49-beb3-494de0ff9f40 admin admin] PATH_INFO: `/v3/users/36aaf9bc2c344ae1897e16bcdae93177` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:43.826998 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5042bad-a210-4c49-beb3-494de0ff9f40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36aaf9bc2c344ae1897e16bcdae93177)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:43.828925 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5042bad-a210-4c49-beb3-494de0ff9f40 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:43.874304 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c5042bad-a210-4c49-beb3-494de0ff9f40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36aaf9bc2c344ae1897e16bcdae93177'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.884083 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c5042bad-a210-4c49-beb3-494de0ff9f40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36aaf9bc2c344ae1897e16bcdae93177'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.884707 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c5042bad-a210-4c49-beb3-494de0ff9f40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36aaf9bc2c344ae1897e16bcdae93177'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.892100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c5042bad-a210-4c49-beb3-494de0ff9f40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36aaf9bc2c344ae1897e16bcdae93177'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.903510 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-c5042bad-a210-4c49-beb3-494de0ff9f40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36aaf9bc2c344ae1897e16bcdae93177'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:43.909874 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1449/2878] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 14:03:43 2022] DELETE /identity/v3/users/36aaf9bc2c344ae1897e16bcdae93177 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:44.169790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:44.171253 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:44.184013 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf2936-73fd-420d-abca-d4b87bac9c6c admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.239311 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dc0d1-a70a-4e62-b83b-02db1bd72083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.240168 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dc0d1-a70a-4e62-b83b-02db1bd72083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.240447 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dc0d1-a70a-4e62-b83b-02db1bd72083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.240721 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dc0d1-a70a-4e62-b83b-02db1bd72083 admin admin] PATH_INFO: `/v3/projects/2c479aeab2c047db8fe931323b3b2084` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.241867 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dc0d1-a70a-4e62-b83b-02db1bd72083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c479aeab2c047db8fe931323b3b2084)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.243790 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dc0d1-a70a-4e62-b83b-02db1bd72083 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.288966 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-218dc0d1-a70a-4e62-b83b-02db1bd72083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c479aeab2c047db8fe931323b3b2084', 'request_id': 'req-218dc0d1-a70a-4e62-b83b-02db1bd72083'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:44.294876 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-218dc0d1-a70a-4e62-b83b-02db1bd72083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c479aeab2c047db8fe931323b3b2084', 'request_id': 'req-218dc0d1-a70a-4e62-b83b-02db1bd72083'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:44.304122 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-218dc0d1-a70a-4e62-b83b-02db1bd72083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c479aeab2c047db8fe931323b3b2084', 'request_id': 'req-218dc0d1-a70a-4e62-b83b-02db1bd72083'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:44.314701 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-218dc0d1-a70a-4e62-b83b-02db1bd72083 admin admin] The token cache is being invalidate because project 2c479aeab2c047db8fe931323b3b2084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:03:44.314990 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-218dc0d1-a70a-4e62-b83b-02db1bd72083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:44.315705 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-218dc0d1-a70a-4e62-b83b-02db1bd72083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:03:44.317279 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1430/2879] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 14:03:44 2022] DELETE /identity/v3/projects/2c479aeab2c047db8fe931323b3b2084 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:44.323436 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42224149-edf9-4723-8c6b-0063140acc05 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.323733 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42224149-edf9-4723-8c6b-0063140acc05 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.324014 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42224149-edf9-4723-8c6b-0063140acc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.341472 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-42224149-edf9-4723-8c6b-0063140acc05 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:44.343327 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-42224149-edf9-4723-8c6b-0063140acc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:44.399225 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1450/2880] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 14:03:44.408052 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e879742-b85c-4aad-9ebb-460c4f7aa322 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.408344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e879742-b85c-4aad-9ebb-460c4f7aa322 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.408622 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e879742-b85c-4aad-9ebb-460c4f7aa322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.426679 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-1e879742-b85c-4aad-9ebb-460c4f7aa322 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:44.427844 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1e879742-b85c-4aad-9ebb-460c4f7aa322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:44.436605 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1431/2881] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:44.440526 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42224149-edf9-4723-8c6b-0063140acc05 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:44.449978 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42224149-edf9-4723-8c6b-0063140acc05 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.455100 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43303b3a-3dc5-4381-b6a2-61e846b6ccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.455783 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43303b3a-3dc5-4381-b6a2-61e846b6ccdf admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.456066 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43303b3a-3dc5-4381-b6a2-61e846b6ccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.456343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43303b3a-3dc5-4381-b6a2-61e846b6ccdf admin admin] PATH_INFO: `/v3/domains` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.457099 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43303b3a-3dc5-4381-b6a2-61e846b6ccdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86423) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 14:03:44.457386 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43303b3a-3dc5-4381-b6a2-61e846b6ccdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.458958 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43303b3a-3dc5-4381-b6a2-61e846b6ccdf admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.470748 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1451/2882] 10.222.0.73 () {58 vars in 1152 bytes} [Wed May 4 14:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 14:03:44.474840 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e879742-b85c-4aad-9ebb-460c4f7aa322 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:44.484437 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e879742-b85c-4aad-9ebb-460c4f7aa322 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.489075 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036f65e-13ad-4e9d-9198-c9c57bc706d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.489713 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036f65e-13ad-4e9d-9198-c9c57bc706d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.489999 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036f65e-13ad-4e9d-9198-c9c57bc706d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.490277 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036f65e-13ad-4e9d-9198-c9c57bc706d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.490973 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036f65e-13ad-4e9d-9198-c9c57bc706d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.492910 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036f65e-13ad-4e9d-9198-c9c57bc706d3 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.516677 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1432/2883] 10.222.0.73 () {60 vars in 1152 bytes} [Wed May 4 14:03:44 2022] POST /identity/v3/projects => generated 389 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:44.520727 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43303b3a-3dc5-4381-b6a2-61e846b6ccdf admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:44.530901 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43303b3a-3dc5-4381-b6a2-61e846b6ccdf admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.583918 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84ab1b-8d00-464d-864c-60769e1a9bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.584568 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84ab1b-8d00-464d-864c-60769e1a9bfe admin admin] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.584847 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84ab1b-8d00-464d-864c-60769e1a9bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.585118 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84ab1b-8d00-464d-864c-60769e1a9bfe admin admin] PATH_INFO: `/v3/users` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.585919 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84ab1b-8d00-464d-864c-60769e1a9bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.587836 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84ab1b-8d00-464d-864c-60769e1a9bfe admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.607000 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1452/2884] 10.222.0.73 () {60 vars in 1143 bytes} [Wed May 4 14:03:44 2022] POST /identity/v3/users => generated 295 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 14:03:44.611677 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036f65e-13ad-4e9d-9198-c9c57bc706d3 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:44.621711 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036f65e-13ad-4e9d-9198-c9c57bc706d3 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.626195 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a01edf-8531-453d-a2dd-37364a27127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.626838 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a01edf-8531-453d-a2dd-37364a27127f admin admin] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.627144 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a01edf-8531-453d-a2dd-37364a27127f admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.627450 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a01edf-8531-453d-a2dd-37364a27127f admin admin] PATH_INFO: `/v3/roles` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.628171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a01edf-8531-453d-a2dd-37364a27127f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.629763 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a01edf-8531-453d-a2dd-37364a27127f admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.639697 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1433/2885] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 14:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:44.643343 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84ab1b-8d00-464d-864c-60769e1a9bfe admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:44.652921 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84ab1b-8d00-464d-864c-60769e1a9bfe admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.657989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de3580-773c-4d7a-8b04-8e071d489041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.658631 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de3580-773c-4d7a-8b04-8e071d489041 admin admin] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.658912 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de3580-773c-4d7a-8b04-8e071d489041 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.659188 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de3580-773c-4d7a-8b04-8e071d489041 admin admin] PATH_INFO: `/v3/roles` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.659932 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de3580-773c-4d7a-8b04-8e071d489041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.661487 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de3580-773c-4d7a-8b04-8e071d489041 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.671670 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1453/2886] 10.222.0.73 () {58 vars in 1121 bytes} [Wed May 4 14:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 14:03:44.675433 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a01edf-8531-453d-a2dd-37364a27127f admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:44.685298 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a01edf-8531-453d-a2dd-37364a27127f admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.689841 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32775b32-f4ea-4965-a3b7-d95049d88063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.690700 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32775b32-f4ea-4965-a3b7-d95049d88063 admin admin] REQUEST_METHOD: `PUT` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.690978 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32775b32-f4ea-4965-a3b7-d95049d88063 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.691285 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32775b32-f4ea-4965-a3b7-d95049d88063 admin admin] PATH_INFO: `/v3/projects/dd92c09cf05c419f8714f12ee939a622/users/68b431da93824d8c8a46ed90b5b759d0/roles/2f5b0d90f1814fe8a58210b5cd048bf7` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.705089 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32775b32-f4ea-4965-a3b7-d95049d88063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd92c09cf05c419f8714f12ee939a622, user_id=68b431da93824d8c8a46ed90b5b759d0, role_id=2f5b0d90f1814fe8a58210b5cd048bf7)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.707730 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32775b32-f4ea-4965-a3b7-d95049d88063 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.720307 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1434/2887] 10.222.0.73 () {60 vars in 1482 bytes} [Wed May 4 14:03:44 2022] PUT /identity/v3/projects/dd92c09cf05c419f8714f12ee939a622/users/68b431da93824d8c8a46ed90b5b759d0/roles/2f5b0d90f1814fe8a58210b5cd048bf7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:03:44.731372 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67254f-8f16-41b1-8827-f8094a9eebf2 None None] REQUEST_METHOD: `POST` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.731687 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67254f-8f16-41b1-8827-f8094a9eebf2 None None] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.731970 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67254f-8f16-41b1-8827-f8094a9eebf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.757749 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.auth.core [None req-2b67254f-8f16-41b1-8827-f8094a9eebf2 None None] MFA Rules not processed for user `68b431da93824d8c8a46ed90b5b759d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86423) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:03:44.758941 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2b67254f-8f16-41b1-8827-f8094a9eebf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:44.820130 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1454/2888] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:03:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:03:44.831071 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32775b32-f4ea-4965-a3b7-d95049d88063 admin admin] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:03:44.832859 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-32775b32-f4ea-4965-a3b7-d95049d88063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:03:44.888070 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32775b32-f4ea-4965-a3b7-d95049d88063 admin admin] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:03:44.892255 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0787cb-3375-4341-8e03-18e49676bc6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '962dca9381254a08b18ea171183190d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:03:44.892889 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0787cb-3375-4341-8e03-18e49676bc6d service cinder] REQUEST_METHOD: `GET` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:03:44.893171 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0787cb-3375-4341-8e03-18e49676bc6d service cinder] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:03:44.893446 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0787cb-3375-4341-8e03-18e49676bc6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:03:44.901807 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0787cb-3375-4341-8e03-18e49676bc6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:03:44.903306 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0787cb-3375-4341-8e03-18e49676bc6d service cinder] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:03:44.912498 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1435/2889] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 14:03:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:01.131999 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67254f-8f16-41b1-8827-f8094a9eebf2 None None] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:01.191951 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67254f-8f16-41b1-8827-f8094a9eebf2 None None] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:01.196415 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:01.197270 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:01.197547 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:01.197844 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] PATH_INFO: `/v3/users/68b431da93824d8c8a46ed90b5b759d0` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:01.199002 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b431da93824d8c8a46ed90b5b759d0)` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:01.200925 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:01.245826 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b431da93824d8c8a46ed90b5b759d0'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.252645 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b431da93824d8c8a46ed90b5b759d0'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.253257 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b431da93824d8c8a46ed90b5b759d0'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.259903 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b431da93824d8c8a46ed90b5b759d0'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.271614 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.notifications [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b431da93824d8c8a46ed90b5b759d0'} {{(pid=86423) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.277595 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1455/2890] 10.222.0.73 () {58 vars in 1223 bytes} [Wed May 4 14:04:01 2022] DELETE /identity/v3/users/68b431da93824d8c8a46ed90b5b759d0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:04:01.283062 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c034209-4b25-4008-afcc-5b0acbfca596 None None] REQUEST_METHOD: `POST` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:01.283591 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c034209-4b25-4008-afcc-5b0acbfca596 None None] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:01.283691 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c034209-4b25-4008-afcc-5b0acbfca596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:01.304397 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.auth.core [None req-1c034209-4b25-4008-afcc-5b0acbfca596 None None] MFA Rules not processed for user `9672a6cf62bd46598e30f140bf9a1184`. Rule list: `[]` (Enabled: `True`). {{(pid=86422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 14:04:01.305900 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1c034209-4b25-4008-afcc-5b0acbfca596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:01.368912 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1436/2891] 10.222.0.73 () {58 vars in 957 bytes} [Wed May 4 14:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 14:04:01.378573 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:01.379961 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:01.434762 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e6db6-0a71-402a-b85b-46e538936c02 admin admin] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:01.438406 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd27d4-6429-46b2-9d40-169f3ef6f626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '963a38e769674dbba95a231e47a7191f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:01.439041 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd27d4-6429-46b2-9d40-169f3ef6f626 service neutron] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:01.439350 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd27d4-6429-46b2-9d40-169f3ef6f626 service neutron] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:01.439623 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd27d4-6429-46b2-9d40-169f3ef6f626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:01.448273 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd27d4-6429-46b2-9d40-169f3ef6f626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:01.449675 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd27d4-6429-46b2-9d40-169f3ef6f626 service neutron] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:01.459469 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1456/2892] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 14:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 14:04:01.727793 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c034209-4b25-4008-afcc-5b0acbfca596 None None] Authenticating user token {{(pid=86422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:04:01.729350 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.fernet_utils [None req-1c034209-4b25-4008-afcc-5b0acbfca596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:04:01.741344 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c034209-4b25-4008-afcc-5b0acbfca596 None None] Validating token access rules against request {{(pid=86422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:04:01.745918 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f925353-999c-4295-acf1-c4c78e4e8ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9672a6cf62bd46598e30f140bf9a1184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f25742121cef4f95a3f20f4e6e3a0601', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:04:01.746778 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f925353-999c-4295-acf1-c4c78e4e8ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:04:01.747086 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f925353-999c-4295-acf1-c4c78e4e8ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:04:01.747399 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f925353-999c-4295-acf1-c4c78e4e8ee7 admin admin] PATH_INFO: `/v3/projects/dd92c09cf05c419f8714f12ee939a622` {{(pid=86422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:04:01.748589 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f925353-999c-4295-acf1-c4c78e4e8ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd92c09cf05c419f8714f12ee939a622)` {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:04:01.751033 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f925353-999c-4295-acf1-c4c78e4e8ee7 admin admin] RBAC: Authorization granted {{(pid=86422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:04:01.796250 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7f925353-999c-4295-acf1-c4c78e4e8ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd92c09cf05c419f8714f12ee939a622', 'request_id': 'req-7f925353-999c-4295-acf1-c4c78e4e8ee7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.802153 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7f925353-999c-4295-acf1-c4c78e4e8ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd92c09cf05c419f8714f12ee939a622', 'request_id': 'req-7f925353-999c-4295-acf1-c4c78e4e8ee7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.808993 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7f925353-999c-4295-acf1-c4c78e4e8ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd92c09cf05c419f8714f12ee939a622', 'request_id': 'req-7f925353-999c-4295-acf1-c4c78e4e8ee7'} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.819408 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7f925353-999c-4295-acf1-c4c78e4e8ee7 admin admin] The token cache is being invalidate because project dd92c09cf05c419f8714f12ee939a622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 14:04:01.819695 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7f925353-999c-4295-acf1-c4c78e4e8ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.820313 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: DEBUG keystone.notifications [None req-7f925353-999c-4295-acf1-c4c78e4e8ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 14:04:01.821833 dv-cinder-839793-6-iscsi devstack@keystone.service[86422]: [pid: 86422|app: 0|req: 1437/2893] 10.222.0.73 () {58 vars in 1232 bytes} [Wed May 4 14:04:01 2022] DELETE /identity/v3/projects/dd92c09cf05c419f8714f12ee939a622 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 14:06:34.970743 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd27d4-6429-46b2-9d40-169f3ef6f626 service neutron] Authenticating user token {{(pid=86423) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 14:06:34.973176 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-2bbd27d4-6429-46b2-9d40-169f3ef6f626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:35.045653 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd27d4-6429-46b2-9d40-169f3ef6f626 service neutron] Validating token access rules against request {{(pid=86423) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 14:06:35.102608 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b62113-8afd-452e-861c-1b8fdfae0ca3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '735744b9ea1f429399b914f3e00d166f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbace3b0d2f54a408012ccc368865c82', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86423) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 14:06:35.103278 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b62113-8afd-452e-861c-1b8fdfae0ca3 service placement] REQUEST_METHOD: `GET` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 14:06:35.103561 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b62113-8afd-452e-861c-1b8fdfae0ca3 service placement] SCRIPT_NAME: `/identity` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 14:06:35.103833 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b62113-8afd-452e-861c-1b8fdfae0ca3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86423) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 14:06:35.105572 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.fernet_utils [None req-71b62113-8afd-452e-861c-1b8fdfae0ca3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86423) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 14:06:35.116989 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b62113-8afd-452e-861c-1b8fdfae0ca3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 14:06:35.118532 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b62113-8afd-452e-861c-1b8fdfae0ca3 service placement] RBAC: Authorization granted {{(pid=86423) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 14:06:35.128851 dv-cinder-839793-6-iscsi devstack@keystone.service[86423]: [pid: 86423|app: 0|req: 1457/2894] 10.222.0.73 () {60 vars in 1365 bytes} [Wed May 4 14:06:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)